-- Logs begin at Sat 2022-02-12 20:01:13 UTC, end at Sat 2022-02-12 22:22:04 UTC. -- Feb 12 20:50:59.731210 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Feb 12 20:50:59.741496 ncdv-master-1 devstack@n-api.service[125765]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 12 20:50:59 2022] *** Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: nodename: ncdv-master-1 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: machine: x86_64 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: clock source: unix Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: pcre jit disabled Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: detected number of CPU cores: 4 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: current working directory: / Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: detected binary path: /usr/bin/uwsgi-core Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: your processes number limit is 47680 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: your memory page size is 4096 bytes Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: detected max file descriptor number: 2048 Feb 12 20:50:59.743479 ncdv-master-1 devstack@n-api.service[125765]: lock engine: pthread robust mutexes Feb 12 20:50:59.744389 ncdv-master-1 devstack@n-api.service[125765]: thunder lock: enabled Feb 12 20:50:59.744389 ncdv-master-1 devstack@n-api.service[125765]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 12 20:50:59.744389 ncdv-master-1 devstack@n-api.service[125765]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 12 20:50:59.794012 ncdv-master-1 devstack@n-api.service[125765]: Python main interpreter initialized at 0x55ce3a23c9c0 Feb 12 20:50:59.794012 ncdv-master-1 devstack@n-api.service[125765]: python threads support enabled Feb 12 20:50:59.794012 ncdv-master-1 devstack@n-api.service[125765]: your server socket listen backlog is limited to 100 connections Feb 12 20:50:59.794012 ncdv-master-1 devstack@n-api.service[125765]: your mercy for graceful operations on workers is 90 seconds Feb 12 20:50:59.794353 ncdv-master-1 devstack@n-api.service[125765]: mapped 403077 bytes (393 KB) for 2 cores Feb 12 20:50:59.794429 ncdv-master-1 devstack@n-api.service[125765]: *** Operational MODE: preforking *** Feb 12 20:50:59.794663 ncdv-master-1 devstack@n-api.service[125765]: *** uWSGI is running in multiple interpreter mode *** Feb 12 20:50:59.794663 ncdv-master-1 devstack@n-api.service[125765]: spawned uWSGI master process (pid: 125765) Feb 12 20:50:59.794855 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Feb 12 20:50:59.798298 ncdv-master-1 devstack@n-api.service[125765]: spawned uWSGI worker 1 (pid: 125766, cores: 1) Feb 12 20:50:59.798298 ncdv-master-1 devstack@n-api.service[125765]: spawned uWSGI worker 2 (pid: 125767, cores: 1) Feb 12 20:50:59.798298 ncdv-master-1 devstack@n-api.service[125765]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 12 20:51:01.665687 ncdv-master-1 devstack@n-api.service[125766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 20:51:01.665687 ncdv-master-1 devstack@n-api.service[125766]: from cryptography.utils import int_from_bytes Feb 12 20:51:01.666346 ncdv-master-1 devstack@n-api.service[125766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 20:51:01.666346 ncdv-master-1 devstack@n-api.service[125766]: from cryptography.utils import int_from_bytes Feb 12 20:51:01.691959 ncdv-master-1 devstack@n-api.service[125767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 20:51:01.691959 ncdv-master-1 devstack@n-api.service[125767]: from cryptography.utils import int_from_bytes Feb 12 20:51:01.692478 ncdv-master-1 devstack@n-api.service[125767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 20:51:01.692478 ncdv-master-1 devstack@n-api.service[125767]: from cryptography.utils import int_from_bytes Feb 12 20:51:04.315110 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 20:51:04.315643 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 20:51:04.315851 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 20:51:04.316311 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 20:51:04.316579 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 20:51:04.316964 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.317289 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.317642 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.317964 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.318297 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.318609 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.318907 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 20:51:04.319272 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.319376 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 20:51:04.319462 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.319529 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.319658 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 20:51:04.319787 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.320025 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 20:51:04.320112 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.320287 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 20:51:04.320408 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.320677 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.320772 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321012 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321164 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321317 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321438 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321657 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321756 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.321968 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.322066 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.322290 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.322382 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.322593 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.322679 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.322933 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.323083 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.323473 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.323611 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.323729 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.323835 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.323940 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.324108 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.324230 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.324447 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.324587 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.324756 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.324882 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.325060 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.325145 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.325395 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.325486 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.325705 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.325790 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.326026 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.326124 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.326332 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.326417 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.326722 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.326841 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.327036 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.327160 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.327348 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.327473 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.327664 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.327767 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.328073 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.328155 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.328383 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.328474 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.328690 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.328828 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329009 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329094 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329321 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329441 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329661 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329746 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.329976 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.330066 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.330298 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.330435 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.330616 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.330758 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.330937 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.331025 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.331238 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.331330 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.331544 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.332224 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.332394 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.332539 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.332712 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.332948 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333041 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333281 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333399 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333579 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333674 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333887 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.333993 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.334210 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.334304 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.334532 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.334647 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.334855 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335015 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335110 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335199 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335339 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335485 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335656 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335801 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.335976 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.336118 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.336284 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.336446 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.336591 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.336758 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.336898 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337068 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337205 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337325 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337542 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337648 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337851 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.337982 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.338157 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.338310 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.338465 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.338631 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.338784 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.338872 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.339097 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.339190 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.339416 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.339513 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.339726 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.339812 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340045 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340130 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340356 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340441 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340674 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340759 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.340978 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.341071 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.341289 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.341402 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.341630 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.341729 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.341942 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342036 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342252 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342345 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342576 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342668 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342884 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.342979 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.343188 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.343273 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.343494 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.343579 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.343815 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.343931 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.344149 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.344241 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.344454 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.344544 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.344704 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.344805 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345004 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345149 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345309 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345437 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345652 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345740 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.345958 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346043 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346268 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346360 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346577 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346664 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346876 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.346968 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.347273 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.347879 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.348123 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.348210 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.348431 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.348517 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.348741 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.348839 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349050 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349147 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349374 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349471 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349685 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349782 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.349991 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.350124 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.350297 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.350382 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.350608 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.350706 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.350926 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351012 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351232 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351317 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351541 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351640 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351850 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.351944 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.352158 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.352253 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.352468 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.352562 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.352779 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.352864 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.353087 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.353172 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.353419 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.353526 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.353730 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.353814 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354037 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354122 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354357 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354453 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354663 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354807 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.354969 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355055 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355285 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355370 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355581 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355666 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355887 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.355974 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.356206 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.356306 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.356514 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.356602 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.356819 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.356905 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.357122 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.357220 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.357447 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.357546 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.357753 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.357847 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358058 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358145 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358358 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358443 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358660 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358746 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.358959 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359091 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359274 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359359 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359590 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359676 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359895 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.359980 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.360202 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.360287 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.360507 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.360601 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.360811 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.360897 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.361121 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.361214 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.361483 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.361586 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.361824 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.361912 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.362134 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.362220 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.362443 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.362539 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.362750 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.362845 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.363175 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.363262 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.363507 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.363593 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.364076 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.364168 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.364390 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.364477 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.364702 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.364816 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.365012 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.365100 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 20:51:04.365326 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.365470 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.365672 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.365760 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.365996 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.366082 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.366332 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.366417 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.366651 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.366738 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.366967 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.367062 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.367288 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.367383 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.367603 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.367689 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.367921 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368019 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368247 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368357 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368564 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368649 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368875 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.368984 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.369191 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.369284 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.369545 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.369649 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.369875 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.369962 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.370197 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.370293 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.370521 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.370608 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.370834 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.370919 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.371153 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.371257 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.371451 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.371546 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.371773 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.371867 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.372106 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.372201 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.372420 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.372514 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.372740 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.372825 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.373052 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.373174 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.373381 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.373483 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.373700 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.373794 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374013 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374108 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374327 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374421 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374663 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374756 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.374980 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.375067 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.375291 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.375427 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.375602 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.375696 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.375921 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376015 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376234 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376319 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376546 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376631 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376858 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.376945 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.377164 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.377260 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.377495 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.377600 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.377802 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.377888 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.378114 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.378209 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.378419 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.378548 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.378819 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.378941 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.379139 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.379242 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.379439 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.379539 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.379768 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.379852 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380070 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380154 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380380 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380481 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380691 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380777 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.380999 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.381082 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.381300 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.381429 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.381636 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.381736 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.381945 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382029 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382249 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382337 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382573 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382657 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382881 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.382973 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.383187 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.383275 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.383510 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.383601 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.383816 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.383903 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.384122 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.384209 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.384433 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.384525 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.384742 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.384835 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.385050 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.385135 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.385378 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.385505 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.385697 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.385797 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386007 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386100 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386320 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386406 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386635 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386733 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.386950 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387045 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387260 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387345 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387581 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387674 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387894 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.387980 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.388208 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.388293 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.388512 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.388611 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.388822 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.388909 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.389127 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.389213 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.389468 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.389560 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.389775 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.389870 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390084 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390177 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390388 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390476 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390697 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390789 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.390999 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.391084 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.391302 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.391390 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.391605 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.391692 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.391926 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392061 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392233 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392319 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392541 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392627 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392844 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.392938 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.393147 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.393234 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.393488 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.393577 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.393805 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.393905 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.394651 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.394749 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395020 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395198 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395341 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395517 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395653 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395830 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.395964 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.396143 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.396279 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.396478 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.396586 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.396796 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.396889 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.397109 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.397207 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.397453 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.397542 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.397770 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.397855 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.398120 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.398216 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.398434 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.398520 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.398741 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.398825 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.399066 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.399160 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.399377 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.399533 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.399699 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.399797 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400004 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400100 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400320 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400406 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400652 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400736 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.400973 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.401066 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.401288 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.401433 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.401634 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.401719 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.401945 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402031 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402262 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402347 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402572 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402665 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402884 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.402971 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.403202 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.403296 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.403514 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.403606 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.403835 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.403928 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.404142 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.404228 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.404458 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.404551 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.404770 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.404867 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.405090 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.405178 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.405422 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.405525 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.405747 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.405906 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.406053 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.406146 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.406365 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.406460 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.406691 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.406775 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407012 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407097 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407317 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407411 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407628 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407721 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.407950 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408038 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408260 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408347 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408569 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408655 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408880 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.408973 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.409183 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.409271 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.409510 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.409642 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.410443 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.410564 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.410754 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.410841 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411065 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411223 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411378 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411563 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411684 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411905 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.411991 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.412224 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.412310 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.412546 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.412640 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.412867 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.412952 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.413182 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.413274 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.413528 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.413618 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.413840 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.413924 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.414149 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.414233 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.414462 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.414551 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.414762 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.414846 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415065 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415159 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415386 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415472 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415691 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415839 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.415995 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.416083 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.416299 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.416388 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.416606 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.416702 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.416913 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417007 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417224 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417310 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417565 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417651 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417883 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.417982 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.418198 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.418283 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.418504 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.418589 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.418820 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.418915 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.419133 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.419219 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.419441 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.419527 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.419762 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.419909 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420077 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420161 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420383 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420474 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420691 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420777 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.420999 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.421091 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.421311 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.421433 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.421646 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.421734 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.421970 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422056 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422277 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422360 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422588 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422676 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422899 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.422984 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.423208 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.423294 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.423519 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.423613 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.423832 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.423916 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.424161 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.424395 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.424483 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.424728 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.424815 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.425044 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.425137 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.425512 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.425756 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.425843 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.426091 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.426188 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.426413 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.426509 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.426748 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.426833 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.427065 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.427150 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.427388 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.427482 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.427701 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.427799 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428009 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428103 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428314 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428451 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428625 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428721 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.428933 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.429186 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.429274 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.429555 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.429656 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.429865 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.429959 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.430170 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.430261 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.430507 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.430699 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.430837 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431008 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431177 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431313 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431514 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431629 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431838 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.431931 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.432193 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.432278 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.432511 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.432606 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.432826 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.432919 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.433131 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.433215 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.433464 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.433568 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.433771 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.433858 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.434076 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.434169 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.434384 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.434481 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.434701 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.434786 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435012 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435097 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435323 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435409 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435631 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435718 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.435941 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436025 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436254 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436347 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436563 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436650 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436870 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.436953 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.437173 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.437260 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.437524 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.437706 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.437842 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438016 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438153 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438325 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438466 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438629 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438780 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.438943 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.439128 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.439255 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.439439 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.439566 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.439785 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.439876 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.440162 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.440285 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.440464 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.440598 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.440767 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.440919 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.441091 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.441214 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.441448 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.441725 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.441817 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.441987 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.442075 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.442303 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.442390 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.442612 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.442715 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.442914 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443002 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443224 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443318 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443532 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443632 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443846 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.443931 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.444164 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.444393 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.444478 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.444697 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.444784 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445001 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445085 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445311 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445410 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445645 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445741 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.445951 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446036 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446275 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446378 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446587 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446674 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446891 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.446983 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.447191 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.447284 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.447500 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.447586 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.447803 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.447898 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.448108 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.448202 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.448416 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.448507 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.448736 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.448821 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449041 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449137 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449340 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449458 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449673 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449768 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.449979 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450127 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450286 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450401 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450593 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450693 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450901 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.450989 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.451203 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.451291 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.451506 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.451592 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.451811 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.451957 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.452115 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.452201 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.452421 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.452505 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.452734 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.452821 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453041 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453125 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453346 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453491 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453675 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453773 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.453987 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454198 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454283 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454375 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454593 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454680 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454902 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.454996 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.455213 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.455308 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.455526 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.455612 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.455834 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.455922 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.456143 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.456242 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.456451 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.456537 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.457403 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.457494 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.457710 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.457796 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.457919 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458007 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458237 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458333 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458550 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458644 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458862 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.458956 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.459171 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.459256 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.459492 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.459587 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.459803 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.459890 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.460116 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.460202 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.460440 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.460547 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.460761 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.460848 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.461082 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.461180 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.461401 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.461491 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.461713 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.461800 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462025 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462125 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462333 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462420 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462641 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462771 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.462948 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463046 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463258 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463344 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463563 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463656 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463871 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.463956 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.464182 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.464258 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.464497 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.464574 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.464802 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.464897 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.465110 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.465196 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.465439 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.465527 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.465746 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.465842 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466070 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466157 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466378 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466463 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466700 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466802 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.466973 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467062 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467276 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467353 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467584 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467678 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467885 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.467971 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.468205 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.468312 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.468523 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.468621 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.468841 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.468935 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.469160 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.469256 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.469495 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.469600 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.469814 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.469892 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.470129 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.470235 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.470458 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.470596 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.470739 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.470834 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.471067 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.471162 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.471377 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.471465 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.471691 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.471779 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.472002 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.472096 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.472963 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.473063 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.473305 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.473516 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.473773 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.473862 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.474096 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.474184 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.474416 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.474513 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.474731 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.474821 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475032 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475125 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475354 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475441 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475659 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475747 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.475977 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.476061 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.476287 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.476387 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.476693 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.476779 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477002 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477088 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477318 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477439 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477661 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477749 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.477972 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.478059 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.478282 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.478376 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.478600 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.478687 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.478932 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479020 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479245 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479343 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479555 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479642 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479860 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.479946 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.480184 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.480279 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.480491 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.480580 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.480806 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.480891 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.481124 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.481213 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.481455 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.481548 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.481782 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.481870 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.482107 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.482269 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.482421 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.482587 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.482743 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.482904 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.483156 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.483244 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.483526 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.483627 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.483792 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.483880 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.484115 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.484201 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.484439 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.484539 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.484751 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.484845 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.485057 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.485145 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.485375 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.485477 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.485696 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.485789 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486002 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486102 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486325 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486424 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486631 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486720 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.486942 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.487038 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.487255 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.487343 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.487565 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.487660 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.487976 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.488074 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.488396 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.488508 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.488718 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.489102 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.489309 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.489419 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.489736 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.489823 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490050 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490134 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490359 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490447 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490678 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490760 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.490981 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.491072 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.491290 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.491377 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.491600 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.491685 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.491908 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492003 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492214 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492303 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492522 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492608 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492834 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.492928 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.493148 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.493237 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.493489 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.493579 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.493822 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.493927 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.494129 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.494225 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.494450 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.494536 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.494767 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.494865 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.495096 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.495184 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.495409 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.495503 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.495717 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.495812 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496039 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496133 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496346 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496433 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496650 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496795 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.496959 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497046 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497259 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497346 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497592 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497682 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497896 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.497983 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.498204 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.498300 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.498507 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.498596 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.498810 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.498896 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.499111 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.499198 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.499433 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.499531 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.499738 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.499835 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500062 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500160 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500371 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500459 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500675 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500761 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.500981 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.501075 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.501286 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.501423 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.501654 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.501742 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.501959 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502059 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502267 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502354 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502579 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502666 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502895 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.502990 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.503205 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.503292 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.503542 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.503632 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.503858 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.504070 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.504331 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.504425 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.504647 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.504749 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.504979 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.505068 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.505297 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.505418 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.505636 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.505724 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.505956 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506081 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506279 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506376 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506592 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506679 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506911 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.506998 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.507230 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.507317 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.507551 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.507640 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.507944 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.508091 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.508285 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.508420 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.508607 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.508736 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.508941 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.509049 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.509267 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.509403 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.509618 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.509717 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.509946 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.510033 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.510271 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.510357 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.510588 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.510731 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.510901 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511033 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511212 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511309 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511525 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511612 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511849 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.511935 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.512175 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.512274 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.512497 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.512590 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.512817 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.513040 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.513127 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.513395 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.513507 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.513721 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.513809 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.514050 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.514138 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.514371 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.514466 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.514696 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.514783 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515009 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515111 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515327 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515423 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515638 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515724 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.515950 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516076 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516265 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516359 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516576 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516670 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516890 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.516987 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.517202 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.517290 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.517537 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.517626 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.517851 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.517951 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.518211 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.518305 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.518534 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.518625 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.518859 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.518955 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.519733 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.519831 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.520055 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.520202 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.520366 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.520481 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.520682 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.520792 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.521121 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.521206 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.521484 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.521578 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.521809 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.521897 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.522130 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.522228 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.522453 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.522541 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.522765 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.522851 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.523078 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.523239 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.523398 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.523535 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.523700 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.523786 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524005 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524101 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524314 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524409 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524620 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524710 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.524924 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525020 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525250 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525337 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525586 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525676 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525891 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.525984 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.526211 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.526449 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.526537 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.526773 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.527033 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.527122 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.527384 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.527471 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.527702 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.527789 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528028 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528116 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528354 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528440 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528669 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528773 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.528975 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.529062 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.529284 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.529398 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.529619 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.529719 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.529925 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530020 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530235 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530325 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530542 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530647 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530845 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.530933 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.531146 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.531240 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.531455 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.531602 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.531763 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.531859 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.532065 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.532305 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.532405 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.532663 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.532751 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.532986 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.533085 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.533291 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.533440 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.533632 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.533719 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.533977 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.534072 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.534298 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.534394 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.534603 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.534712 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.535500 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.535637 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.535806 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.535909 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.536115 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.536203 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.536433 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.536531 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.536741 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.536830 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537050 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537179 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537371 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537461 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537690 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537779 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.537997 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.538084 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.538306 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.538400 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.538610 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.538709 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.538945 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539030 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539262 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539350 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539564 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539663 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539875 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.539960 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.540181 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.540275 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.540495 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.540581 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.540806 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.540893 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.541115 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.541211 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.541470 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.541561 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.541788 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.541874 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.542098 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.542319 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.542407 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.542651 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.542738 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.542973 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.543062 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.543308 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.543396 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.543622 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.543708 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.543932 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544029 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544237 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544326 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544542 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544636 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544863 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.544964 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.545174 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.545263 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.545513 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.545603 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.545825 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.545922 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.546134 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.546221 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.546443 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.546535 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.546752 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.546855 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.547060 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.547148 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.547372 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.547650 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.547747 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.547977 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.548070 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.548285 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.548372 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.548598 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.548699 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.548934 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.549022 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.549259 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.549343 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.549604 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.549704 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.549918 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.550006 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.550250 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.550371 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.550630 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.550725 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.550988 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.551073 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.551299 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.551435 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.551610 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.551699 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.551929 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552016 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552257 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552342 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552569 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552664 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552877 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.552964 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.553190 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.553377 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.553599 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.553696 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.553919 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554006 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554239 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554343 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554551 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554637 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554875 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.554968 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.555199 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.555295 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.555517 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.555605 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.555838 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.555927 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.556150 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.556247 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.556465 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.556551 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.556786 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.556873 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.557105 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.557193 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.557455 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.557545 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.557762 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.557849 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.558068 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.558157 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.558373 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.558460 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.558683 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.558822 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559017 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559129 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559349 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559445 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559664 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559768 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.559986 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.560084 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.560298 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.560390 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.560621 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.560722 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.560930 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.561024 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.561252 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.561343 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.561615 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.561722 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.561930 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562022 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562241 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562332 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562575 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562667 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562887 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.562979 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.563202 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.563295 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.563516 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.563608 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.563827 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.563920 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.564138 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.564230 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.564448 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.564546 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.564776 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.564868 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.565163 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.565256 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.565471 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.565577 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.565794 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.565888 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.566665 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.566771 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.566988 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.567226 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.567316 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.567565 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.567652 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.567900 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.567995 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.568222 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.568315 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.568538 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.568623 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.568848 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.568943 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.569161 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.569249 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.569514 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.569623 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.569834 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.569920 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.570155 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.570243 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.570476 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.570573 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.570797 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.570884 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.571120 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.571206 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.571454 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.571608 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.571769 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.571858 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.572103 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.572198 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.572430 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.572517 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.572744 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.572832 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.573058 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.573159 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.573397 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.573504 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.573631 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 20:51:04.573719 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.574033 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.574357 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.574687 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.575009 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.575337 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.575663 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.576001 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.576339 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.576677 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.577015 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.577390 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.577720 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.578071 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.578411 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.578734 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.579056 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.579371 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 20:51:04.579621 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 20:51:04.596984 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_db.sqlalchemy.engines [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.602870 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_db.sqlalchemy.engines [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.661674 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.context [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=125766) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 20:51:04.665878 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_concurrency.lockutils [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 20:51:04.666853 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.context [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=125767) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 20:51:04.667476 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_concurrency.lockutils [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 20:51:04.668290 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_concurrency.lockutils [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 20:51:04.670261 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_concurrency.lockutils [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 20:51:04.671072 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 20:51:04.672678 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 20:51:04.673532 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 20:51:04.676117 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 20:51:04.681119 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_db.sqlalchemy.engines [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.681966 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_db.sqlalchemy.engines [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.688539 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_db.sqlalchemy.engines [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.691678 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_db.sqlalchemy.engines [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.841286 ncdv-master-1 devstack@n-api.service[125766]: DEBUG oslo_db.sqlalchemy.engines [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:04.851184 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_db.sqlalchemy.engines [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 20:51:05.272931 ncdv-master-1 devstack@n-api.service[125766]: WARNING keystonemiddleware.auth_token [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 20:51:05.279550 ncdv-master-1 devstack@n-api.service[125766]: WARNING keystonemiddleware.auth_token [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 20:51:05.317276 ncdv-master-1 devstack@n-api.service[125767]: WARNING keystonemiddleware.auth_token [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 20:51:05.323869 ncdv-master-1 devstack@n-api.service[125767]: WARNING keystonemiddleware.auth_token [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 20:51:05.618183 ncdv-master-1 devstack@n-api.service[125766]: WARNING keystonemiddleware.auth_token [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 20:51:05.623369 ncdv-master-1 devstack@n-api.service[125766]: WARNING keystonemiddleware.auth_token [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 20:51:05.629049 ncdv-master-1 devstack@n-api.service[125766]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce3a23c9c0 pid: 125766 (default app) Feb 12 20:51:05.631107 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:51:05.632268 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001692 Feb 12 20:51:05.632676 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Sat Feb 12 20:51:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:51:05.665400 ncdv-master-1 devstack@n-api.service[125767]: WARNING keystonemiddleware.auth_token [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 20:51:05.670681 ncdv-master-1 devstack@n-api.service[125767]: WARNING keystonemiddleware.auth_token [None req-472a4b9d-ae83-4577-9b60-5228a686dbbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 20:51:05.676513 ncdv-master-1 devstack@n-api.service[125767]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce3a23c9c0 pid: 125767 (default app) Feb 12 20:52:31.216080 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:31.217886 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Feb 12 20:52:31.222445 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:31.654237 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-6ef2c992-306c-4fee-8a49-6eb00d1724f2 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:31.684092 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-6ef2c992-306c-4fee-8a49-6eb00d1724f2 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457034 Feb 12 20:52:31.688579 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 1/3] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 20:52:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 20:52:34.044176 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:34.045165 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-08bc24f6-d1f2-4500-93cd-9fdc2416b215 None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Feb 12 20:52:34.045607 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 3/4] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:34.106410 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-325d0eae-c115-4c5b-b8b5-688a0998acd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:34.125684 ncdv-master-1 devstack@n-api.service[125767]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 20:52:34.125684 ncdv-master-1 devstack@n-api.service[125767]: warnings.warn(msg) Feb 12 20:52:34.251192 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-325d0eae-c115-4c5b-b8b5-688a0998acd0 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.199071 Feb 12 20:52:34.252248 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 2/5] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:52:34.472793 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-75cae956-8b88-4208-b0a1-1afddead2e49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:34.475259 ncdv-master-1 devstack@n-api.service[125766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 20:52:34.475259 ncdv-master-1 devstack@n-api.service[125766]: warnings.warn(msg) Feb 12 20:52:34.594205 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-75cae956-8b88-4208-b0a1-1afddead2e49 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333257 Feb 12 20:52:34.595569 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 4/6] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 20:52:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 20:52:36.981258 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-325d0eae-c115-4c5b-b8b5-688a0998acd0 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:36.990476 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-325d0eae-c115-4c5b-b8b5-688a0998acd0 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001778 Feb 12 20:52:36.990476 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 3/7] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:37.095849 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-dc39d21c-43b5-4644-acf1-f614a3228482 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:37.114356 ncdv-master-1 devstack@n-api.service[125766]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 20:52:37.114356 ncdv-master-1 devstack@n-api.service[125766]: warnings.warn(msg) Feb 12 20:52:37.199775 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-dc39d21c-43b5-4644-acf1-f614a3228482 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.209141 Feb 12 20:52:37.200539 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 5/8] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 20:52:37.214984 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-c85eae61-3430-44e2-b0cb-5242f89e0d7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:37.216586 ncdv-master-1 devstack@n-api.service[125767]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 20:52:37.216586 ncdv-master-1 devstack@n-api.service[125767]: warnings.warn(msg) Feb 12 20:52:37.308877 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-c85eae61-3430-44e2-b0cb-5242f89e0d7a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098398 Feb 12 20:52:37.313875 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 4/9] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 20:52:37 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:52:39.758546 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-dc39d21c-43b5-4644-acf1-f614a3228482 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:39.759545 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-dc39d21c-43b5-4644-acf1-f614a3228482 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Feb 12 20:52:39.760235 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:39.826959 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-d3b782e6-aef8-4d40-b6bd-13410cb33308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "swap": 0}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:39.907049 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-d3b782e6-aef8-4d40-b6bd-13410cb33308 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139219 Feb 12 20:52:39.921688 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-e4363659-2426-43ca-81f7-062bcab1b2e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:39.926214 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 5/11] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:52:40.040323 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-e4363659-2426-43ca-81f7-062bcab1b2e1 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123219 Feb 12 20:52:40.067973 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 7/12] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 20:52:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:52:42.531513 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-d3b782e6-aef8-4d40-b6bd-13410cb33308 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:42.533482 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-d3b782e6-aef8-4d40-b6bd-13410cb33308 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Feb 12 20:52:42.537499 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 6/13] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:42.618121 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-0abde234-1eef-46e3-ab1b-239e61947094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G"}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:42.706157 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-0abde234-1eef-46e3-ab1b-239e61947094 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164865 Feb 12 20:52:42.706906 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 8/14] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:52:42.723373 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-203b4c02-59d0-4d3b-af33-22415d42b9eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:42.810942 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-203b4c02-59d0-4d3b-af33-22415d42b9eb admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091596 Feb 12 20:52:42.811630 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 7/15] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 20:52:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 20:52:45.211319 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-0abde234-1eef-46e3-ab1b-239e61947094 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:45.213152 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-0abde234-1eef-46e3-ab1b-239e61947094 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Feb 12 20:52:45.214402 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 9/16] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:45.287048 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-30820c91-3ed4-424d-9d0b-d6f08426a08c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 20}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:45.405245 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-30820c91-3ed4-424d-9d0b-d6f08426a08c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.184290 Feb 12 20:52:45.406098 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 8/17] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:52:45.418653 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-6c8a832f-645c-4e38-9091-2a70e211ced5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:45.515011 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-6c8a832f-645c-4e38-9091-2a70e211ced5 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099964 Feb 12 20:52:45.515951 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 10/18] 10.222.0.31 () {64 vars in 1335 bytes} [Sat Feb 12 20:52:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:52:47.931532 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-30820c91-3ed4-424d-9d0b-d6f08426a08c admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:47.932678 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-30820c91-3ed4-424d-9d0b-d6f08426a08c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Feb 12 20:52:47.933340 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 9/19] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:47.994343 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-9271c50c-204f-476b-b2e7-1c66dce4d547 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:48.018875 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-9271c50c-204f-476b-b2e7-1c66dce4d547 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077871 Feb 12 20:52:48.019408 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 11/20] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 20:52:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:52:50.490835 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-30820c91-3ed4-424d-9d0b-d6f08426a08c admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:50.494669 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-30820c91-3ed4-424d-9d0b-d6f08426a08c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Feb 12 20:52:50.494669 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 10/21] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:50.558343 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-48b72622-dfc3-4577-8153-a0ddb2b5a7be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:50.715429 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-48b72622-dfc3-4577-8153-a0ddb2b5a7be admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.216416 Feb 12 20:52:50.738265 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 12/22] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 20:52:50.738429 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-c46b191a-4730-4e37-b58c-e1727ae31ec2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:50.835490 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-c46b191a-4730-4e37-b58c-e1727ae31ec2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109756 Feb 12 20:52:50.851411 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 11/23] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 20:52:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:52:53.799376 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-48b72622-dfc3-4577-8153-a0ddb2b5a7be admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:53.800569 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-48b72622-dfc3-4577-8153-a0ddb2b5a7be admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Feb 12 20:52:53.801027 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 13/24] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 20:52:53.860911 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-8d7581c7-c1f3-4ee7-af06-be8f4cb393fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:53.986379 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-8d7581c7-c1f3-4ee7-af06-be8f4cb393fc admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.178592 Feb 12 20:52:53.987056 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 12/25] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 20:52:53.999035 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-2509f942-03fa-4650-b3f0-10e51d072361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:54.079392 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-2509f942-03fa-4650-b3f0-10e51d072361 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083782 Feb 12 20:52:54.080061 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 14/26] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 20:52:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:52:56.463602 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-8d7581c7-c1f3-4ee7-af06-be8f4cb393fc admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:56.464934 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-8d7581c7-c1f3-4ee7-af06-be8f4cb393fc admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001841 Feb 12 20:52:56.465472 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 13/27] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:56.530622 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-7299f87b-5e74-49ea-80b1-3ea731eadc44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:56.607382 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-7299f87b-5e74-49ea-80b1-3ea731eadc44 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.134922 Feb 12 20:52:56.608008 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 15/28] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 20:52:56.620839 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-c8912d81-b58c-4759-8bd4-ded487596824 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:56.687427 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-c8912d81-b58c-4759-8bd4-ded487596824 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070306 Feb 12 20:52:56.688001 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 14/29] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 20:52:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 20:52:59.151600 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-7299f87b-5e74-49ea-80b1-3ea731eadc44 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:52:59.152608 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-7299f87b-5e74-49ea-80b1-3ea731eadc44 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Feb 12 20:52:59.153225 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 16/30] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:52:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:52:59.213444 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-ecaf7934-6a35-411d-b898-d1d55f940355 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "disk": 80}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:59.326034 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-ecaf7934-6a35-411d-b898-d1d55f940355 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.166131 Feb 12 20:52:59.326599 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 15/31] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:52:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:52:59.341883 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-e1077fee-65fa-4ed6-9b77-fb62022c38a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:52:59.467424 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-e1077fee-65fa-4ed6-9b77-fb62022c38a1 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129180 Feb 12 20:52:59.468012 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 17/32] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 20:52:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:53:01.845881 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-ecaf7934-6a35-411d-b898-d1d55f940355 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:01.846886 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-ecaf7934-6a35-411d-b898-d1d55f940355 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Feb 12 20:53:01.847285 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 16/33] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:01.906742 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-761b43a7-1427-4c7c-813f-ede334a4151e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:53:02.036184 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-761b43a7-1427-4c7c-813f-ede334a4151e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.182810 Feb 12 20:53:02.037011 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 18/34] 10.222.0.31 () {64 vars in 1282 bytes} [Sat Feb 12 20:53:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:53:02.055481 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-74b73fac-8fba-47c3-b064-af1b5dda68f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:53:02.160084 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-74b73fac-8fba-47c3-b064-af1b5dda68f9 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114616 Feb 12 20:53:02.173673 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 17/35] 10.222.0.31 () {64 vars in 1332 bytes} [Sat Feb 12 20:53:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:53:29.509466 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-761b43a7-1427-4c7c-813f-ede334a4151e admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:29.510474 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-761b43a7-1427-4c7c-813f-ede334a4151e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Feb 12 20:53:29.510893 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 19/36] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:29.567655 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-04fbe01d-3335-477d-896f-43534ae66032 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:29.586054 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-04fbe01d-3335-477d-896f-43534ae66032 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068723 Feb 12 20:53:29.586549 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 18/37] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 20:53:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:53:31.073683 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-761b43a7-1427-4c7c-813f-ede334a4151e admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:31.074751 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-761b43a7-1427-4c7c-813f-ede334a4151e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Feb 12 20:53:31.075150 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 20/38] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:31.320041 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-e204e77e-58bc-44be-83a5-f117459e5261 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:31.325548 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.wsgi [None req-e204e77e-58bc-44be-83a5-f117459e5261 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 12 20:53:31.330279 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-e204e77e-58bc-44be-83a5-f117459e5261 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 20:53:31.330279 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-e204e77e-58bc-44be-83a5-f117459e5261 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058905 Feb 12 20:53:31.330279 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 19/39] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 20:53:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 20:53:31.336900 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-cdf45efe-7742-493b-931f-2d89506602be admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:31.360436 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-cdf45efe-7742-493b-931f-2d89506602be admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026439 Feb 12 20:53:31.362548 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 21/40] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 20:53:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:53:31.378752 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-6c45cf0e-8c14-49fb-9b9b-ffe6b903a458 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:31.399533 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-6c45cf0e-8c14-49fb-9b9b-ffe6b903a458 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025017 Feb 12 20:53:31.400072 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 20/41] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 20:53:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:53:31.409803 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-8693b3aa-f541-4f91-bd8c-843b78ea2410 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:31.415302 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.wsgi [None req-8693b3aa-f541-4f91-bd8c-843b78ea2410 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 12 20:53:31.415867 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-8693b3aa-f541-4f91-bd8c-843b78ea2410 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 20:53:31.416651 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-8693b3aa-f541-4f91-bd8c-843b78ea2410 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010808 Feb 12 20:53:31.417148 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 22/42] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 20:53:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 20:53:32.770139 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-6c45cf0e-8c14-49fb-9b9b-ffe6b903a458 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:32.771158 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-6c45cf0e-8c14-49fb-9b9b-ffe6b903a458 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Feb 12 20:53:32.771546 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 21/43] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:32.969867 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-6920d19a-7f18-4fa8-b984-b83115f4e0c4 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:32.975127 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.wsgi [None req-6920d19a-7f18-4fa8-b984-b83115f4e0c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 12 20:53:32.975684 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-6920d19a-7f18-4fa8-b984-b83115f4e0c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 20:53:32.976458 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-6920d19a-7f18-4fa8-b984-b83115f4e0c4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057756 Feb 12 20:53:32.977020 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 20:53:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 20:53:32.986774 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-bbac9f6a-ff79-49fa-8ed0-d0e645b16131 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:33.001162 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-bbac9f6a-ff79-49fa-8ed0-d0e645b16131 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018013 Feb 12 20:53:33.001707 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 20:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:53:33.010881 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-86481f21-2694-4a4d-8dc5-d13c9248361c admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:33.024306 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-86481f21-2694-4a4d-8dc5-d13c9248361c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016844 Feb 12 20:53:33.024824 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 24/46] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 20:53:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 20:53:33.033990 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-8777c517-1be9-49c8-8abd-18f65dd8b809 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:33.039068 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.wsgi [None req-8777c517-1be9-49c8-8abd-18f65dd8b809 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 12 20:53:33.039616 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-8777c517-1be9-49c8-8abd-18f65dd8b809 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 20:53:33.040380 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-8777c517-1be9-49c8-8abd-18f65dd8b809 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010078 Feb 12 20:53:33.040861 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 23/47] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 20:53:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 12 20:53:34.412688 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-86481f21-2694-4a4d-8dc5-d13c9248361c admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:34.413725 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-86481f21-2694-4a4d-8dc5-d13c9248361c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Feb 12 20:53:34.414120 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:34.612582 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-882552e4-f8a6-49fb-a743-a54836f0b2c4 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:34.618018 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.wsgi [None req-882552e4-f8a6-49fb-a743-a54836f0b2c4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 12 20:53:34.618567 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-882552e4-f8a6-49fb-a743-a54836f0b2c4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 20:53:34.619337 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-882552e4-f8a6-49fb-a743-a54836f0b2c4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058649 Feb 12 20:53:34.619829 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 24/49] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 20:53:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 20:53:34.629041 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-d16b5f22-5408-45cc-9dda-16146d76a231 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:34.642652 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-d16b5f22-5408-45cc-9dda-16146d76a231 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017274 Feb 12 20:53:34.643182 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 26/50] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 20:53:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:53:34.652900 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:34.666352 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017300 Feb 12 20:53:34.667315 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 20:53:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 20:53:34.677110 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-117d808e-b40d-409e-b30c-1056ab8d4616 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:34.682375 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.wsgi [None req-117d808e-b40d-409e-b30c-1056ab8d4616 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 12 20:53:34.682956 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-117d808e-b40d-409e-b30c-1056ab8d4616 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 20:53:34.683719 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-117d808e-b40d-409e-b30c-1056ab8d4616 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010062 Feb 12 20:53:34.684195 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 27/52] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 20:53:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 12 20:53:36.033032 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:36.034061 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Feb 12 20:53:36.034460 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 26/53] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:36.233922 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-6a4bfa52-9782-4f58-bc44-195a4e06ddd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:53:36.337431 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-6a4bfa52-9782-4f58-bc44-195a4e06ddd8 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.155360 Feb 12 20:53:36.337895 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 28/54] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 20:53:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:53:37.683755 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:37.684752 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Feb 12 20:53:37.685146 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:37.882546 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-47c0e322-fc23-402e-aeec-a564c59ecac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:53:37.965176 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-47c0e322-fc23-402e-aeec-a564c59ecac4 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.133666 Feb 12 20:53:37.965676 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 29/56] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 20:53:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:53:39.334602 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:39.335598 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Feb 12 20:53:39.335981 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 28/57] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:39.534722 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-990211cc-9c10-4495-91bc-7cfc2c9ce182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:53:39.617119 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-990211cc-9c10-4495-91bc-7cfc2c9ce182 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.134317 Feb 12 20:53:39.617701 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 30/58] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 20:53:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:53:40.980358 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:40.981391 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Feb 12 20:53:40.981786 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:41.179065 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-fb33dc1d-29d0-468a-b69e-299bc400d879 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 20:53:41.279257 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-fb33dc1d-29d0-468a-b69e-299bc400d879 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.151008 Feb 12 20:53:41.279801 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 31/60] 10.222.0.31 () {64 vars in 1235 bytes} [Sat Feb 12 20:53:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 20:53:42.646239 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:42.647265 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Feb 12 20:53:42.647714 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 30/61] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 20:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:53:42.847065 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-2926dd46-4385-4474-941d-31548f456e27 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:53:42.867525 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-2926dd46-4385-4474-941d-31548f456e27 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072964 Feb 12 20:53:42.867992 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 32/62] 10.222.0.31 () {60 vars in 1202 bytes} [Sat Feb 12 20:53:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:54:30.526680 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:54:30.527677 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f7992467-4fc8-4b5a-b4fb-6fc29218bb03 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Feb 12 20:54:30.528075 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 31/63] 10.222.0.31 () {54 vars in 930 bytes} [Sat Feb 12 20:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 20:54:30.585969 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-da6565df-9fbd-4d2d-92dc-d877b2839cc4 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:54:30.605651 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-da6565df-9fbd-4d2d-92dc-d877b2839cc4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070614 Feb 12 20:54:30.606187 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 33/64] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 20:54:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 20:54:30.629085 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-9ee4feaa-1d97-4792-aa5d-f156a530aae5 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:54:30.636687 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-9ee4feaa-1d97-4792-aa5d-f156a530aae5 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011111 Feb 12 20:54:30.637200 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 32/65] 10.222.0.31 () {60 vars in 1282 bytes} [Sat Feb 12 20:54:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:54:30.648608 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-8fc98ac5-1514-40eb-9741-93a78f379197 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:54:30.656737 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-8fc98ac5-1514-40eb-9741-93a78f379197 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011592 Feb 12 20:54:30.657239 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 34/66] 10.222.0.31 () {60 vars in 1285 bytes} [Sat Feb 12 20:54:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:54:30.668152 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-eef23b30-a05e-4549-a617-ff6f88f7c1d5 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:54:30.675620 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-eef23b30-a05e-4549-a617-ff6f88f7c1d5 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010885 Feb 12 20:54:30.676380 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 33/67] 10.222.0.31 () {60 vars in 1285 bytes} [Sat Feb 12 20:54:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 20:54:30.686970 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-aaee5487-da99-4683-be23-d616ba19b397 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:54:30.694372 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-aaee5487-da99-4683-be23-d616ba19b397 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010811 Feb 12 20:54:30.694873 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 35/68] 10.222.0.31 () {60 vars in 1282 bytes} [Sat Feb 12 20:54:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 20:56:08.180900 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-d7b2ec2f-0405-4f14-af0d-46741f277ed8 tempest-verify_tempest_config-1691258614 tempest-verify_tempest_config-1691258614-project] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 20:56:08.183014 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-d7b2ec2f-0405-4f14-af0d-46741f277ed8 tempest-verify_tempest_config-1691258614 tempest-verify_tempest_config-1691258614-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107741 Feb 12 20:56:08.183578 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 34/69] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 20:56:08 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:00:12.996632 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-aaee5487-da99-4683-be23-d616ba19b397 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:00:12.998730 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-aaee5487-da99-4683-be23-d616ba19b397 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001726 Feb 12 21:00:12.999496 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 36/70] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 21:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:00:13.260576 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-f2b75192-8516-45c3-8a2a-37c9503dda53 admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:00:13.262445 ncdv-master-1 devstack@n-api.service[125767]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:00:13.262445 ncdv-master-1 devstack@n-api.service[125767]: warnings.warn(msg) Feb 12 21:00:13.263960 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-f2b75192-8516-45c3-8a2a-37c9503dda53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:00:13.264396 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-f2b75192-8516-45c3-8a2a-37c9503dda53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:00:13.265217 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-f2b75192-8516-45c3-8a2a-37c9503dda53 admin admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:00:13.265685 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-f2b75192-8516-45c3-8a2a-37c9503dda53 admin admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:00:13.305067 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-f2b75192-8516-45c3-8a2a-37c9503dda53 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.158370 Feb 12 21:00:13.305592 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 35/71] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:00:13 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:00:14.664505 ncdv-master-1 devstack@n-api.service[125766]: DEBUG nova.api.openstack.wsgi [None req-aaee5487-da99-4683-be23-d616ba19b397 admin admin] Calling method '>' {{(pid=125766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:00:14.665548 ncdv-master-1 devstack@n-api.service[125766]: INFO nova.api.openstack.requestlog [None req-aaee5487-da99-4683-be23-d616ba19b397 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 12 21:00:14.665940 ncdv-master-1 devstack@n-api.service[125766]: [pid: 125766|app: 0|req: 37/72] 10.222.0.31 () {56 vars in 1074 bytes} [Sat Feb 12 21:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:00:14.864544 ncdv-master-1 devstack@n-api.service[125767]: DEBUG nova.api.openstack.wsgi [None req-7cb39aa3-cb89-49fd-ba7d-74250f4df6dc admin admin] Calling method '>' {{(pid=125767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:00:14.865722 ncdv-master-1 devstack@n-api.service[125767]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:00:14.865722 ncdv-master-1 devstack@n-api.service[125767]: warnings.warn(msg) Feb 12 21:00:14.867817 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-7cb39aa3-cb89-49fd-ba7d-74250f4df6dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:00:14.868265 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-7cb39aa3-cb89-49fd-ba7d-74250f4df6dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:00:14.869063 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-7cb39aa3-cb89-49fd-ba7d-74250f4df6dc admin admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:00:14.869678 ncdv-master-1 devstack@n-api.service[125767]: DEBUG oslo_concurrency.lockutils [None req-7cb39aa3-cb89-49fd-ba7d-74250f4df6dc admin admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:00:14.892237 ncdv-master-1 devstack@n-api.service[125767]: INFO nova.api.openstack.requestlog [None req-7cb39aa3-cb89-49fd-ba7d-74250f4df6dc admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079190 Feb 12 21:00:14.892804 ncdv-master-1 devstack@n-api.service[125767]: [pid: 125767|app: 0|req: 36/73] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:00:14 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:01:03.234141 ncdv-master-1 devstack@n-api.service[125765]: Sat Feb 12 21:01:03 2022 - graceful shutdown triggered... Feb 12 21:01:03.235248 ncdv-master-1 devstack@n-api.service[125766]: Gracefully killing worker 1 (pid: 125766)... Feb 12 21:01:03.234264 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Feb 12 21:01:03.236195 ncdv-master-1 devstack@n-api.service[125767]: Gracefully killing worker 2 (pid: 125767)... Feb 12 21:01:04.234468 ncdv-master-1 devstack@n-api.service[125765]: worker 1 buried after 1 seconds Feb 12 21:01:04.235023 ncdv-master-1 devstack@n-api.service[125765]: worker 2 buried after 1 seconds Feb 12 21:01:04.235023 ncdv-master-1 devstack@n-api.service[125765]: goodbye to uWSGI. Feb 12 21:01:04.236166 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Feb 12 21:01:04.236745 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Feb 12 21:01:04.239490 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Feb 12 21:01:04.278724 ncdv-master-1 devstack@n-api.service[141712]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 12 21:01:04 2022] *** Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: nodename: ncdv-master-1 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: machine: x86_64 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: clock source: unix Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: pcre jit disabled Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: detected number of CPU cores: 4 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: current working directory: / Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: detected binary path: /usr/bin/uwsgi-core Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: your processes number limit is 47680 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: your memory page size is 4096 bytes Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: detected max file descriptor number: 2048 Feb 12 21:01:04.299007 ncdv-master-1 devstack@n-api.service[141712]: lock engine: pthread robust mutexes Feb 12 21:01:04.300090 ncdv-master-1 devstack@n-api.service[141712]: thunder lock: enabled Feb 12 21:01:04.300090 ncdv-master-1 devstack@n-api.service[141712]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 12 21:01:04.300090 ncdv-master-1 devstack@n-api.service[141712]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 12 21:01:04.349960 ncdv-master-1 devstack@n-api.service[141712]: Python main interpreter initialized at 0x556acc6469c0 Feb 12 21:01:04.349960 ncdv-master-1 devstack@n-api.service[141712]: python threads support enabled Feb 12 21:01:04.349960 ncdv-master-1 devstack@n-api.service[141712]: your server socket listen backlog is limited to 100 connections Feb 12 21:01:04.349960 ncdv-master-1 devstack@n-api.service[141712]: your mercy for graceful operations on workers is 90 seconds Feb 12 21:01:04.350366 ncdv-master-1 devstack@n-api.service[141712]: mapped 403077 bytes (393 KB) for 2 cores Feb 12 21:01:04.350446 ncdv-master-1 devstack@n-api.service[141712]: *** Operational MODE: preforking *** Feb 12 21:01:04.350633 ncdv-master-1 devstack@n-api.service[141712]: *** uWSGI is running in multiple interpreter mode *** Feb 12 21:01:04.350633 ncdv-master-1 devstack@n-api.service[141712]: spawned uWSGI master process (pid: 141712) Feb 12 21:01:04.350837 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Feb 12 21:01:04.351907 ncdv-master-1 devstack@n-api.service[141712]: spawned uWSGI worker 1 (pid: 141726, cores: 1) Feb 12 21:01:04.352068 ncdv-master-1 devstack@n-api.service[141712]: spawned uWSGI worker 2 (pid: 141727, cores: 1) Feb 12 21:01:04.352283 ncdv-master-1 devstack@n-api.service[141712]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 12 21:01:06.412648 ncdv-master-1 devstack@n-api.service[141727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 21:01:06.412648 ncdv-master-1 devstack@n-api.service[141727]: from cryptography.utils import int_from_bytes Feb 12 21:01:06.413316 ncdv-master-1 devstack@n-api.service[141727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 21:01:06.413316 ncdv-master-1 devstack@n-api.service[141727]: from cryptography.utils import int_from_bytes Feb 12 21:01:06.428254 ncdv-master-1 devstack@n-api.service[141726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 21:01:06.428254 ncdv-master-1 devstack@n-api.service[141726]: from cryptography.utils import int_from_bytes Feb 12 21:01:06.428772 ncdv-master-1 devstack@n-api.service[141726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 21:01:06.428772 ncdv-master-1 devstack@n-api.service[141726]: from cryptography.utils import int_from_bytes Feb 12 21:01:08.853642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 21:01:08.854214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 21:01:08.854414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 21:01:08.854790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 21:01:08.855053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 21:01:08.855450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.855789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.856125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.856463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.856806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.857129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.857494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.857830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.858174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.858443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.858770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.859108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.859494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.859788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.860109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.860437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.860757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.861092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.861463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.861975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.862425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.862744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.863240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.863422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.863748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.864068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.864400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.864718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.865056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.865169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 21:01:08.865586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 21:01:08.865697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.865793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.865885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 21:01:08.866118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.866222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 21:01:08.866443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.866667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 21:01:08.866769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.866869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.867159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.867257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.867496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.867608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.867826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.867927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.868170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.868263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.868496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.868599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.868828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.868929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.869159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.869258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.869513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.869627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.869779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.869879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.870103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.870206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.870440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.870548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.870773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.870876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.871092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.871182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.871409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.871532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.871731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.871842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.872042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.872152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.872304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.872405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.872606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.872707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.873198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.873451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.873565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.873770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.873871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.874085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.874185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.874369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.874491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.874720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.874824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.875554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.875678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.875876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.875975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.876205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.876375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.876519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.876704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.876891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.877032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.877157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.877377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.877586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.877688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.877912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.878013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.878233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.878332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.878558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.878666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.878951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.879051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.879289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.879378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.879610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.879718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.879940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.880037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.880277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.880375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.880592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.880685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.880911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.881008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.881241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.881331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.881595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.881701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.881929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.882044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.882264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.882412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.882560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.882658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.882878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.883906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.884061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.884163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.884380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.884479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.884770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.884875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.885933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.886999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.887171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.887307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.887472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.887605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.887791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.887887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.888108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.888212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.888425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.888526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.888744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.888837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.889062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.889154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.889443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.889566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.889728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.889841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.890059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.890151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.890398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.891330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.891853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.891989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.892203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.892294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.892390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.892577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.892681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.892917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.893019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.893244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.893337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.893594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.893734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.893934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.894035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.894256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.894357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.894585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.894734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.894910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.895039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.895236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.895337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.895560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.895657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.895892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.896884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.897100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.897191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.897442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.897560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.897883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.897985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.898078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.898171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.898404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.898515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.898728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.898835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.899985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.900083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.900305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.900406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.900625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.900720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.900941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.901032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.901256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.901375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.901595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.901697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.901911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.902003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.902241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.902351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.902575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.902674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.902896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.903011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.903213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.903355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.903535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.903640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.903853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.903957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.904183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.904287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.904499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.904604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.904817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.904917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.905150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.905262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.905488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.905596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.905803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.905905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.906130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.906232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.906472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.906643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.906789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.907056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.907292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.907394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.907609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.907702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.907930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.908032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.908259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.908365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.908580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.908673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.908901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.909001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.909214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.909324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.909556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.909665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.909872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.909994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.910188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.910352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.910501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.910680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.910816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.911020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.911124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.911355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.911447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.911681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.911784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.912005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.912111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.912344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.912487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.912667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.912796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.912988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 21:01:08.913095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.913327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.913600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.913692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.913788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.914990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.915107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.915317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.915421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.915637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.915735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.915960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.916069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.916300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.916414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.916618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.916719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.916936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.917039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.917256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.917415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.917611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.917703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.917940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.918999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.919222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.919313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.919539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.919681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.919869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.919961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.920206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.920304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.920528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.920620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.920845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.920943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.921181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.921280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.921530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.921624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.921854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.922137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.922225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.922378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.922508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.922730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.922879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.923998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.924135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.924338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.924432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.924660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.924763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.924989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.925091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.925316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.925461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.925667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.925781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.925984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.926074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.926308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.926446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.926624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.926752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.926959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.927053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.927282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.927387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.927605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.927694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.927931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.928030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.928262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.928371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.928583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.928680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.928910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.929977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.930192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.930294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.930506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.930596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.930820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.930965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.931134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.931233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.931454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.931547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.931771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.931862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.932087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.932188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.932400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.932492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.932716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.932814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.933999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.934098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.934315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.934408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.934628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.934732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.934961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.935054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.935278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.935388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.935648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.935758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.935987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.936079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.936304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.936402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.936618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.936719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.936941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.937043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.937262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.937375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.938198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.938315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.938522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.938615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.938857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.938952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.939182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.939276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.939509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.939614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.939853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.939951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.940186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.940283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.940512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.940613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.940841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.940931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.941164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.941264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.941512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.941618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.941828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.941929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.942146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.942238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.942458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.942560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.942770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.942914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.943080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.943168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.943384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.943517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.943695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.943846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.944937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.945138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.945264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.945581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.945688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.945917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.946008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.946228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.946326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.946541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.946642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.946864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.947948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.948166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.948257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.948491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.948594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.948812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.948903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.949136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.949226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.949481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.949592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.949803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.949903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.950122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.950223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.950444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.950547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.950768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.950867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.951087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.951187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.951401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.951499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.951718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.951818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.952986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.953083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.953901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.954007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.954252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.954357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.954593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.954728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.954921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.955972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.956197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.956297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.956516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.956619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.956835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.956942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.957153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.957244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.957499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.957675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.957819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.957910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.958147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.958243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.958461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.958559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.958774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.958864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.959092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.959184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.959422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.959526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.959735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.959827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.960056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.960145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.960384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.960476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.960713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.960803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.961026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.961114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.961365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.961470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.961693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.961790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.962968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.963089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.963289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.963392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.963604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.963710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.963929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.964037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.964249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.964566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.964880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.965202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.965548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.965740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.965902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.966138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.966234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.966484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.966578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.966829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.966934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.967141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.967235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.967509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.967602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.967854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.967962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.968225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.968317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.968539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.968867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.968968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.969224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.969334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.969658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.969903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.970010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.970257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.970347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.970607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.970696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.970928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.971995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.972210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.972326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.972535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.972664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.972857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.972995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.973172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.973323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.973533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.973701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.973858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.974056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.974184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.974385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.974490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.974713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.974807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.975044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.975139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.975372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.975475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.975698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.975800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.976976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.977078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.977296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.977427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.977647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.977789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.977989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.978217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.978505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.978654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.978787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.978925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.979978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.980185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.980334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.980525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.980669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.980853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.980988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.981200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.981345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.981598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.981734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.981880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.982022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.982154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.982845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.982995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.983932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.984913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.985912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.986071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.986217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.986413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.986550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.986722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.986865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.987052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.987199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.987376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.987513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.987694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.987849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.988046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.988190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.988369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.988499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.988709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.988831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.989048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.989188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.989524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.989691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.989840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.989985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.990130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.990289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.990447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.990603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.990750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.990907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.991960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.992127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.992282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.992438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.992584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.992738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.992894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.993048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.993194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.993374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.993616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.993770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.993926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.994072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.994256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.994418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.994598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.994752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.994923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.995979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.996184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.996356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.996505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.996649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.996783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.996914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.997107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.997242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.997448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.997597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.997778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.998174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.998347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.998502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.998664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.998942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.999050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.999147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.999289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.999469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.999613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:08.999927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.000605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.000777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.000930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.001119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.001468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.001569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.001785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.001888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.002105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.002198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.002419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.002512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.002736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.002827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.003054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.003155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.003388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.003500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.003713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.003813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.004972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.005071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.005481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.005596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.005671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.005740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.005937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.006977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.007183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.007280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.007517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.007673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.007819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.007967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.008131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.008266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.008443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.008578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.008755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.008892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.009112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.009249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.009476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.009626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.009866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.010869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.011046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.011180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.011368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.011511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.011689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.011826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.012961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.013102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.013273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.013440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.013680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.013823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.013964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.014095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.014233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.014374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.014558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.014694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.014888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.015028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.015210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.015359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.015616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.016435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.016586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.016712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.016849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.016991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.017123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.017304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.017539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.017662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.017873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.018890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.019035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.019218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.019362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.019539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.019683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.019838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.020951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.021096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.021281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.021454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.021650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.021792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.021971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.022108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.022287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.022435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.022605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.022738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.022980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.023134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.023357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.023504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.023681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.023838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.024957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.025157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.025305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.025568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.025780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.025913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.026949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.027190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.027336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.027523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.027655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.027874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.028002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.028196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.028342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.028529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.028650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.028843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.029001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.029161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.029339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.029501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.029682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.029803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.030085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.030225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.030348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.030460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.030674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.030843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.031015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.031150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.031490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.031679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.032131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.032271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.032705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.032827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.035730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.035978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.036961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.037119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.037264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.037469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.037469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.037719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.037871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.038969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.039147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.039306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.039456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.039631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.039788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.039936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.040080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.040358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.040513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.040701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.040854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.041982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.042138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.042284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.042438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.042585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.042738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.042738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.043022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.043180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.043407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.043566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.043736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.043890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.044943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.045113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.045272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.045479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.045661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.045823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.045987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.046218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.046480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.046480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.046782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.047468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.047686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.047860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.048905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.049182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.049326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.049498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.049661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.049816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.049970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.050129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.050274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.050524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.050700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.050847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.050999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.051152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.051306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.051452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.051611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.051759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.051904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.052987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.053133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.053292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.053479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.053626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.053772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.053916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.054071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.054238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.054385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.054538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.054693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.054863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.055892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.056057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.056222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.056445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.056604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.056752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.056911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.057066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.057212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.057387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.057551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.057696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.057856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.058945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.059097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.059250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.059404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.059557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.059712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.059866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.060019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.060174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.060320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.060473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.060473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.060860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.061007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.061152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.061297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.061492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.061650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.062399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.062589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.063313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.063476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.063638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.063793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.063979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.064131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.064286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.064449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.064603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.064749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.064893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.065037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.065209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.065555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.065704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.065704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.065994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.066142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.066296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.066697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.067924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.068227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.068390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.068548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.068717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.068880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.069027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.069173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.069328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.069542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.069761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.069959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.070154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.070302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.070448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.070593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.070872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.071961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.072107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.072262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.072409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.072569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.072735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.072907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.073998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.074918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.075216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.075371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.075518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.075671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.075827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.075982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.076142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.076289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.076444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.076609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.076841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.077071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.077221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.077421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.077585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.077734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.078041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.078229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.078381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.078535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.078682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.078682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.079961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.080107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.080253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.080408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.080555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.080710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.080895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.081130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.081290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.081460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.081460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.081460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.081887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.082958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.083993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.084139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.084293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.084514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.084662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.084818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.084978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.085126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.085271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.085455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.085618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.085774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.085920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.086065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.086210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.086505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.087074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.087231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.087412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.087567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.087727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.087882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.088803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.089079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.089225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.089419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.089586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.089734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.089879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.090943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.091106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.091341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.091511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.091658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.091803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.091956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.092999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.093155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.093312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.093512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.093617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.093714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.093895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.094945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.095961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.096760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.097046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.097222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.097494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.097654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.097831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.097980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.098149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.098310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.098479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.098633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.098794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.098948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.099102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.099256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.099431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.099592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.099764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.099920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.100123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.100283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.100430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.100590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.100749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.100904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.101125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.101286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.101548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.101721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.101871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.102029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.102176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.102329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.102482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.102647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.102986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.103141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.103295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.103470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.103629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.103777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.103923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.104986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.105132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.105277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.105517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.105712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.106036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.106357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.106678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.106921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.107093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.107321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.107630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.107792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.107940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.108137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.108366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.108521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.108693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.108846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.109023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.109299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.109990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.110324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.110486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.110664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.110878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.111034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.111235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.111400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.111650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.111941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.112282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.112585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.112738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.112956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.113138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.113297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.113621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.113851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.114019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.114237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.114397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.114555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.114702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.114867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.115015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.115207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.115368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.115599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.115756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.115904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.116057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.116212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.116366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.116540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.116738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.116922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.117153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.117433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.117609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.117772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.117966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.118118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.118307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.118462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.118693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.118856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.119025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.119178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.119418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.119579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.119737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.119893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.120040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.120187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.120333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.120578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.120740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.120916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.121079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.121228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.121424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.121595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.121771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.121997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.122149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.122296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.122442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.122597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.122744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.123137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.123290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.123435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.123613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.123789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.123938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.124093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.124271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.124431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.124620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.124785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.124942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.126045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.126419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.126785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.127054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.127630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.127804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.128064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.128425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.128763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.129094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.136837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.136837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.136837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.137473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.138657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.139779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.139779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.139779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.139779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.139779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.140488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.140488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.141205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 21:01:09.141205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=141727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 21:01:09.153587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.165537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_db.sqlalchemy.engines [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.221306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.context [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=141726) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 21:01:09.225616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:09.227433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:09.228266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:09.230271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:09.232603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.context [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=141727) load_cells /opt/stack/nova/nova/context.py:464}} Feb 12 21:01:09.237979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:09.239612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:09.240479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:09.242514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:09.243717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.245844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.254796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_db.sqlalchemy.engines [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.256054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_db.sqlalchemy.engines [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.407739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.416701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_db.sqlalchemy.engines [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=141727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 21:01:09.734849 ncdv-master-1 devstack@n-api.service[141726]: WARNING keystonemiddleware.auth_token [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 21:01:09.741334 ncdv-master-1 devstack@n-api.service[141726]: WARNING keystonemiddleware.auth_token [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 21:01:09.742238 ncdv-master-1 devstack@n-api.service[141727]: WARNING keystonemiddleware.auth_token [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 21:01:09.751037 ncdv-master-1 devstack@n-api.service[141727]: WARNING keystonemiddleware.auth_token [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 21:01:10.084314 ncdv-master-1 devstack@n-api.service[141726]: WARNING keystonemiddleware.auth_token [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 21:01:10.089603 ncdv-master-1 devstack@n-api.service[141726]: WARNING keystonemiddleware.auth_token [None req-b4c87cbf-78e2-4072-a899-b91e0d7dc97f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 21:01:10.093856 ncdv-master-1 devstack@n-api.service[141727]: WARNING keystonemiddleware.auth_token [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 12 21:01:10.095422 ncdv-master-1 devstack@n-api.service[141726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556acc6469c0 pid: 141726 (default app) Feb 12 21:01:10.099514 ncdv-master-1 devstack@n-api.service[141727]: WARNING keystonemiddleware.auth_token [None req-49cd8df4-e7af-4cbf-9207-bc4fa01e58df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 12 21:01:10.104784 ncdv-master-1 devstack@n-api.service[141727]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556acc6469c0 pid: 141727 (default app) Feb 12 21:01:51.033978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Calling method '.version_select at 0x7fa9050f0d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:51.036214 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:51.036214 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:51.042474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=141726) load_cells /opt/stack/nova/nova/compute/api.py:304}} Feb 12 21:01:51.043309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:51.043755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:51.075306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:51.075928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:51.092192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:51.092673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:51.100638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e04dbfbd-0142-4653-b17a-99c1e0f1f1e3 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.346466 Feb 12 21:01:51.103742 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1207 bytes} [Sat Feb 12 21:01:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:01:51.344120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c662ea0-908e-4d2c-9e91-2ce724480a20 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1816112640"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:51.361676 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:51.361676 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:51.363430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-6c662ea0-908e-4d2c-9e91-2ce724480a20 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Generated uuid f2c9192f-3a66-4266-b0fc-61cf4e0520b5 for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:51.527438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c662ea0-908e-4d2c-9e91-2ce724480a20 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.413068 Feb 12 21:01:51.534524 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1/2] 10.222.0.31 () {62 vars in 1204 bytes} [Sat Feb 12 21:01:51 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:01:51.539728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f87e81e5-f8f4-43c5-a36a-ea061686b47e tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1438980679"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:51.635832 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:51.635832 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:51.809975 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f87e81e5-f8f4-43c5-a36a-ea061686b47e tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.274131 Feb 12 21:01:51.811335 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2/3] 10.222.0.31 () {62 vars in 1209 bytes} [Sat Feb 12 21:01:51 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:01:51.822229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc843236-61c8-45f9-83d3-99a2edc44183 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:51.823012 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:51.823012 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:51.843721 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc843236-61c8-45f9-83d3-99a2edc44183 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.025802 Feb 12 21:01:51.856926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0b83c48f-3d0c-4991-8435-faaacc562fbc tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:51.870194 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:51.870194 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:51.870349 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2/4] 10.222.0.31 () {60 vars in 1189 bytes} [Sat Feb 12 21:01:51 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:01:51.872541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b83c48f-3d0c-4991-8435-faaacc562fbc tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:51.872541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b83c48f-3d0c-4991-8435-faaacc562fbc tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:52.971831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '.version_select at 0x7fa90477a700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:52.972711 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:52.972711 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:52.973503 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0b83c48f-3d0c-4991-8435-faaacc562fbc tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.120709 Feb 12 21:01:52.974188 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3/5] 10.222.0.31 () {62 vars in 1231 bytes} [Sat Feb 12 21:01:51 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:01:52.981663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=141727) load_cells /opt/stack/nova/nova/compute/api.py:304}} Feb 12 21:01:52.982799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:52.983758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:53.023646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:53.024654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:53.044929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:53.047489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:53.055589 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-910639d3-58aa-42df-8d28-cbb12317027c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.998661 Feb 12 21:01:53.056748 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3/6] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 21:01:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:01:53.183389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1015170758", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:53.467850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa9047b2700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:53.470574 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:53.470574 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:53.472615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:53.473272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:53.515445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:53.516883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:53.552441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:53.554673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:53.570018 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.511808 Feb 12 21:01:53.571696 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:01:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:53.572979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:53.574367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b79112ff-8e36-401f-af06-42cabf32f6cf tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001546 Feb 12 21:01:53.574801 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 5/8] 10.222.0.31 () {56 vars in 885 bytes} [Sat Feb 12 21:01:53 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 12 21:01:53.720910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:01:54.006976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:01:54.008062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:01:54.008912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:01:54.009823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:01:54.010468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:01:54.035224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.036197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.037508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.038125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.053372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b62c0cb-8526-45d3-9986-51e02dca99e3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.055927 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.055927 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:54.059333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b62c0cb-8526-45d3-9986-51e02dca99e3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.061008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b62c0cb-8526-45d3-9986-51e02dca99e3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.064687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b62c0cb-8526-45d3-9986-51e02dca99e3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.066413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b62c0cb-8526-45d3-9986-51e02dca99e3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.098071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Getting quotas for project f24b9d29252e43d597ac37f401de9de5. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:01:54.110225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Getting quotas for user 025db9daf7864d258b3453ec4381626c and project f24b9d29252e43d597ac37f401de9de5. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:01:54.128152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b62c0cb-8526-45d3-9986-51e02dca99e3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.552008 Feb 12 21:01:54.135212 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 6/9] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:01:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:54.139408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:01:54.142336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-228c01bf-7d33-4782-a404-73ded6e5c346 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:54.145736 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.145736 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:54.155156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:01:54.155809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-228c01bf-7d33-4782-a404-73ded6e5c346 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.160174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-228c01bf-7d33-4782-a404-73ded6e5c346 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.314262 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e1ba73a-9deb-4fab-8ace-8333f45d99b6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327948 Feb 12 21:01:54.322345 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 4/10] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:01:54.333629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa90466e1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.334575 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.334575 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.336760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.337225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.372389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.372844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.416602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.418709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.429858 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab5025dc-f140-43cb-94c8-665dde0fa1b0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.112565 Feb 12 21:01:54.430491 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 5/11] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:01:54.438012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00464e58-9ad3-4a06-95ca-9c1e2ecb76d2 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.441155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-00464e58-9ad3-4a06-95ca-9c1e2ecb76d2 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:01:54.568903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-00464e58-9ad3-4a06-95ca-9c1e2ecb76d2 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:54.592034 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00464e58-9ad3-4a06-95ca-9c1e2ecb76d2 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1220 microversion: 2.1 time: 0.159293 Feb 12 21:01:54.593391 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 6/12] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:01:54.599271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa904630f70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.616333 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.616333 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.619088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.619549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.653167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.653654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.666301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.667017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.676037 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e4631d12-c73a-4015-8ccf-f0cfefbf8d9e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.080397 Feb 12 21:01:54.677017 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 7/13] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:54.700240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e8f7db45-3cc0-422c-ad6b-a67d14a230e0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa9045d0310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.702439 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.702439 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.705596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f7db45-3cc0-422c-ad6b-a67d14a230e0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.706664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f7db45-3cc0-422c-ad6b-a67d14a230e0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.732076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f7db45-3cc0-422c-ad6b-a67d14a230e0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.733598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f7db45-3cc0-422c-ad6b-a67d14a230e0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.741696 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e8f7db45-3cc0-422c-ad6b-a67d14a230e0 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.052180 Feb 12 21:01:54.742785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 8/14] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:54.758951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ad5a703-b2d7-4c24-83a3-0baa3c3ddae7 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa9045d0040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.760309 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.760309 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.766509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ad5a703-b2d7-4c24-83a3-0baa3c3ddae7 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.766509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ad5a703-b2d7-4c24-83a3-0baa3c3ddae7 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.786383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ad5a703-b2d7-4c24-83a3-0baa3c3ddae7 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.031309 Feb 12 21:01:54.787298 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 9/15] 10.222.0.31 () {58 vars in 1178 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:01:54.801055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa9045ec1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.801518 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.801518 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.803388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.803999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.839778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.841526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.863516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.869477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.879450 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-125cd078-a426-417c-b427-ce5ac86d043c tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.083205 Feb 12 21:01:54.880309 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 10/16] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:01:54.890619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-506bbecd-71a1-42f5-8300-cd9d909e466e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa9045ecf70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.891452 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.891452 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.898330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-506bbecd-71a1-42f5-8300-cd9d909e466e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.898775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-506bbecd-71a1-42f5-8300-cd9d909e466e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.913948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-506bbecd-71a1-42f5-8300-cd9d909e466e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.914406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-506bbecd-71a1-42f5-8300-cd9d909e466e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.922076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-506bbecd-71a1-42f5-8300-cd9d909e466e tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.035301 Feb 12 21:01:54.930033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 11/17] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:01:54.934495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25952828-c45b-449b-855b-54a3652bf6da tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa90466e1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.935450 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.935450 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.937989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25952828-c45b-449b-855b-54a3652bf6da tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.938496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25952828-c45b-449b-855b-54a3652bf6da tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.953445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25952828-c45b-449b-855b-54a3652bf6da tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.953907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25952828-c45b-449b-855b-54a3652bf6da tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.961205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25952828-c45b-449b-855b-54a3652bf6da tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.030028 Feb 12 21:01:54.970238 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 12/18] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:54.975199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Calling method '.version_select at 0x7fa9045ec160>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:54.976189 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:54.976189 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:54.978499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:54.978952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:54.988081 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-228c01bf-7d33-4782-a404-73ded6e5c346 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.850455 Feb 12 21:01:54.996292 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 7/19] 10.222.0.31 () {62 vars in 1231 bytes} [Sat Feb 12 21:01:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:01:55.004336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:55.004819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:55.006201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b17c42f-f91d-413b-86da-92ade09cfd71 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:55.007661 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:55.007661 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:55.018288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:55.019553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:55.028063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4303a886-ced8-4c05-94c0-5023bf9b4c43 tempest-HypervisorAdminTestJSON-775870502 tempest-HypervisorAdminTestJSON-775870502-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:01:55.029842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:55.030582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:55.032253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:55.032862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:55.042958 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.compute.rpcapi [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 12 21:01:55.044573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] Releasing lock "compute-rpcapi-router" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:01:55.099369 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c91b07c9-1eca-4d48-ba9f-7b9306cfd37e None None] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.127480 Feb 12 21:01:55.108372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 13/20] 10.222.0.31 () {58 vars in 1172 bytes} [Sat Feb 12 21:01:54 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:55.182250 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b17c42f-f91d-413b-86da-92ade09cfd71 tempest-AggregatesAdminTestV241-1820587547 tempest-AggregatesAdminTestV241-1820587547-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.183138 Feb 12 21:01:55.183038 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 8/21] 10.222.0.31 () {60 vars in 1192 bytes} [Sat Feb 12 21:01:54 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:55.200439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c47cd5e-5cba-46e6-8019-66ada94e09a5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1813886087"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:55.203676 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:55.203676 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:55.205674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-2c47cd5e-5cba-46e6-8019-66ada94e09a5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid abf9d5b3-b306-41cb-9568-ea46752ec1b8 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:55.394205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c47cd5e-5cba-46e6-8019-66ada94e09a5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.203119 Feb 12 21:01:55.400945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 14/22] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:55.406429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d29c2384-4f64-4020-b3a5-bedb37e9a2ca tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:55.407983 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:55.407983 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:55.428372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d29c2384-4f64-4020-b3a5-bedb37e9a2ca tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:55.429147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d29c2384-4f64-4020-b3a5-bedb37e9a2ca tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:55.616418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dfae55c1-1499-4a39-ad86-f20392d9f880 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:55.623284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfae55c1-1499-4a39-ad86-f20392d9f880 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:01:55.706164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dfae55c1-1499-4a39-ad86-f20392d9f880 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:55.715089 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dfae55c1-1499-4a39-ad86-f20392d9f880 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1220 microversion: 2.1 time: 0.109366 Feb 12 21:01:55.716969 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 15/23] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:01:55 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:01:55.877807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d29c2384-4f64-4020-b3a5-bedb37e9a2ca tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.473947 Feb 12 21:01:55.877807 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 9/24] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:01:55 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:55.887728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23abf7b4-7df5-4bc2-84b3-7ad5d937d4d6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:55.889492 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:55.889492 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:55.935227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23abf7b4-7df5-4bc2-84b3-7ad5d937d4d6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:55.935227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23abf7b4-7df5-4bc2-84b3-7ad5d937d4d6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:56.060712 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-23abf7b4-7df5-4bc2-84b3-7ad5d937d4d6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] HTTP exception thrown: Aggregate 2 already has host nch2-master-1. Feb 12 21:01:56.063105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23abf7b4-7df5-4bc2-84b3-7ad5d937d4d6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 409 to user: Aggregate 2 already has host nch2-master-1. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:56.064230 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23abf7b4-7df5-4bc2-84b3-7ad5d937d4d6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.180763 Feb 12 21:01:56.065509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 16/25] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:01:55 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 183 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Feb 12 21:01:56.073652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91ed91d6-22e6-4130-9de1-62e790351563 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:56.075202 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:56.075202 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:56.094516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91ed91d6-22e6-4130-9de1-62e790351563 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:56.097697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91ed91d6-22e6-4130-9de1-62e790351563 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:56.408053 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91ed91d6-22e6-4130-9de1-62e790351563 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.338157 Feb 12 21:01:56.409673 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 10/26] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:01:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:56.421162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ea4aeb8-6e8c-4113-a388-c95a589718b6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:56.423355 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:56.423355 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:56.615446 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ea4aeb8-6e8c-4113-a388-c95a589718b6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.199507 Feb 12 21:01:56.616032 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 17/27] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:56 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:01:56.626174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bdfa4066-f8ea-456d-83c3-5a09a9102076 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1863482480"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:56.634273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-614aa678-1700-4006-8f1b-8041c3a3458a tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1298267163", "name": "tempest-test_aggregate-2036182738"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:56.640830 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:56.640830 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:56.642688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-bdfa4066-f8ea-456d-83c3-5a09a9102076 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid 2bc68dcf-1669-4d98-995d-331165bf41eb for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:56.667203 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:56.667203 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:56.668611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-614aa678-1700-4006-8f1b-8041c3a3458a tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid 97b301db-aa27-41d0-ab6a-95fb567639e9 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:56.749132 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bdfa4066-f8ea-456d-83c3-5a09a9102076 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.126976 Feb 12 21:01:56.750972 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 11/28] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:01:56.763409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:56.764363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:01:56.782960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-614aa678-1700-4006-8f1b-8041c3a3458a tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.152892 Feb 12 21:01:56.785663 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 18/29] 10.222.0.31 () {60 vars in 1164 bytes} [Sat Feb 12 21:01:56 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:56.808986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:56.809738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:56.810753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:56.811374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:57.302147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04081da8-1c1d-410d-92c4-b87f5d1aa016 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:57.305030 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:57.305030 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:57.308069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-04081da8-1c1d-410d-92c4-b87f5d1aa016 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '4ef3498f3ace445fab7a613c2fd9639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9719b96b4dfa4568b468c3a3a247fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:57.309433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04081da8-1c1d-410d-92c4-b87f5d1aa016 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:57.310449 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04081da8-1c1d-410d-92c4-b87f5d1aa016 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] 10.222.0.31 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.523310 Feb 12 21:01:57.315496 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 19/30] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:01:56 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 529 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:01:57.340548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2037a1d-119d-43e3-81a3-aff14d65ca9c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:57.348648 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:57.348648 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:57.376915 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2037a1d-119d-43e3-81a3-aff14d65ca9c tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.054828 Feb 12 21:01:57.378133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 20/31] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:01:57 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:57.383316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f8e575c-912c-4103-8105-4910cb39177a tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:57.384477 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:57.384477 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:57.469831 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f8e575c-912c-4103-8105-4910cb39177a tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.089947 Feb 12 21:01:57.470753 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 21/32] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:01:57.482997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-11c402f6-76f1-4809-9800-f1927ea3c0e7 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:57.487411 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:57.487411 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:57.516966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11c402f6-76f1-4809-9800-f1927ea3c0e7 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:57.519788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11c402f6-76f1-4809-9800-f1927ea3c0e7 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:57.966966 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-11c402f6-76f1-4809-9800-f1927ea3c0e7 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 0.487611 Feb 12 21:01:57.977580 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 22/33] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:01:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:57.977580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1974133-c520-47a5-8ec2-4d0f69bf2c1b tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-959102327"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:57.979589 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:57.979589 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:57.980992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-d1974133-c520-47a5-8ec2-4d0f69bf2c1b tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid 1139bdd1-fd70-42d1-8c9c-16ab6ccc622f for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:58.007257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:58.021785 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77a1204b-36a2-49ac-abb3-cc6acb70ce73 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1224 microversion: 2.1 time: 1.269262 Feb 12 21:01:58.025424 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 12/34] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:01:56 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1224 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:01:58.102475 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1974133-c520-47a5-8ec2-4d0f69bf2c1b tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.133600 Feb 12 21:01:58.103934 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 23/35] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:58.115050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1995269451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.116287 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.116287 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:58.126962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:58.127302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:58.136396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:58.136855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:58.146793 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1995269451 could not be found. Feb 12 21:01:58.147779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1995269451 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:58.148733 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64d06a60-2b30-40ed-8339-ab3c1cd32e30 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.037420 Feb 12 21:01:58.149679 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 24/36] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:01:58.158784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9ce781c-d767-48e0-863f-de3cf53cdd1d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:58.159856 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.159856 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:58.258877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9ce781c-d767-48e0-863f-de3cf53cdd1d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.104197 Feb 12 21:01:58.259370 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 25/37] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:58 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:01:58.269204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7cdf31a9-2bc7-4200-b6eb-53a76ac97c39 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.271354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7cdf31a9-2bc7-4200-b6eb-53a76ac97c39 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:58.272164 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7cdf31a9-2bc7-4200-b6eb-53a76ac97c39 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.007432 Feb 12 21:01:58.272751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 26/38] 10.222.0.31 () {60 vars in 1164 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:01:58.282364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f2be4bf-c9a2-4c7d-b211-df089f553bc4 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.283598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f2be4bf-c9a2-4c7d-b211-df089f553bc4 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:58.284445 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f2be4bf-c9a2-4c7d-b211-df089f553bc4 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.005985 Feb 12 21:01:58.285050 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 27/39] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:01:58.293983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2344f373-ef62-4204-a039-87a9d828d570 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-61325335"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.295204 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.295204 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:58.296144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2344f373-ef62-4204-a039-87a9d828d570 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '4ef3498f3ace445fab7a613c2fd9639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9719b96b4dfa4568b468c3a3a247fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:58.297168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2344f373-ef62-4204-a039-87a9d828d570 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:58.297963 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2344f373-ef62-4204-a039-87a9d828d570 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.008092 Feb 12 21:01:58.298460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 28/40] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:01:58.307549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-24272223-3eb5-4807-853a-c40a842b1f50 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-412185519"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.311005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-24272223-3eb5-4807-853a-c40a842b1f50 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid c56e5ab4-7e59-4e5b-b4ed-4e1fc5e721f1 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:58.428848 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-24272223-3eb5-4807-853a-c40a842b1f50 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.125369 Feb 12 21:01:58.435010 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 29/41] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:58.440868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c63f934-c678-44e0-b8fe-c557d95455f6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-412185519"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.442461 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.442461 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:58.443935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-3c63f934-c678-44e0-b8fe-c557d95455f6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid 79bb49cb-fb2b-4618-b13e-3246f762d166 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:58.457985 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3c63f934-c678-44e0-b8fe-c557d95455f6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-412185519 already exists. Feb 12 21:01:58.458875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c63f934-c678-44e0-b8fe-c557d95455f6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-412185519 already exists. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:58.459938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c63f934-c678-44e0-b8fe-c557d95455f6 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.023642 Feb 12 21:01:58.464110 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 30/42] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:01:58.469172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f443862e-7124-44fd-b71a-cb95da805b2c tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:58.470263 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.470263 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:58.552483 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f443862e-7124-44fd-b71a-cb95da805b2c tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.086823 Feb 12 21:01:58.559167 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 31/43] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:58 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:01:58.566169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68679e1e-53ac-44c9-8ea1-3dc5fbbcb6d3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1658778216"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:58.568059 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.568059 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:01:58.570087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-68679e1e-53ac-44c9-8ea1-3dc5fbbcb6d3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid ecaca39f-be4c-4666-b501-5bd03b77c051 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:58.723341 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68679e1e-53ac-44c9-8ea1-3dc5fbbcb6d3 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.162204 Feb 12 21:01:58.724520 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 32/44] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:58.895304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80071645-d05e-49b9-86e3-ef676b1bbf5f tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:58.897218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80071645-d05e-49b9-86e3-ef676b1bbf5f tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:58.897850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80071645-d05e-49b9-86e3-ef676b1bbf5f tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:58.898670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80071645-d05e-49b9-86e3-ef676b1bbf5f tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:58.899124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80071645-d05e-49b9-86e3-ef676b1bbf5f tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:58.924512 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80071645-d05e-49b9-86e3-ef676b1bbf5f tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] 10.222.0.31 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.848102 Feb 12 21:01:58.925097 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 13/45] 10.222.0.31 () {58 vars in 1163 bytes} [Sat Feb 12 21:01:58 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:58.930578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-78074b9a-ca39-425c-b10f-80f51f9637e8 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:58.931764 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.931764 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:58.932987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-78074b9a-ca39-425c-b10f-80f51f9637e8 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '4ef3498f3ace445fab7a613c2fd9639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9719b96b4dfa4568b468c3a3a247fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:58.933742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-78074b9a-ca39-425c-b10f-80f51f9637e8 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:58.934611 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-78074b9a-ca39-425c-b10f-80f51f9637e8 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.008139 Feb 12 21:01:58.935304 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 14/46] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:58 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:01:58.940434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13f37ba7-c495-4bd4-b1ad-c3ae31280370 tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:58.941197 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.941197 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:58.942680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13f37ba7-c495-4bd4-b1ad-c3ae31280370 tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:58.943192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13f37ba7-c495-4bd4-b1ad-c3ae31280370 tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:58.944196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13f37ba7-c495-4bd4-b1ad-c3ae31280370 tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:58.944618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13f37ba7-c495-4bd4-b1ad-c3ae31280370 tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:58.969784 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13f37ba7-c495-4bd4-b1ad-c3ae31280370 tempest-AZAdminV2TestJSON-782164131 tempest-AZAdminV2TestJSON-782164131-project-admin] 10.222.0.31 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 702 microversion: 2.1 time: 0.033296 Feb 12 21:01:58.970388 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 15/47] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:01:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 702 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:58.975229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a843157-0f68-4794-86f8-faef92e67c3b tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:58.976278 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:58.976278 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.101739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a843157-0f68-4794-86f8-faef92e67c3b tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.129987 Feb 12 21:01:59.118338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 16/48] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:58 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:01:59.147050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:59.148467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:01:59.170707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:59.171226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:59.172722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:59.173168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:59.276156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:59.284549 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c8dc0c3e-81f4-4542-9dca-8161653b3b6b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1278 microversion: 2.1 time: 0.165106 Feb 12 21:01:59.285503 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 17/49] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:01:59 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:01:59.290097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf2bd15a-a263-43fa-b16e-342d3c3a182d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:59.291251 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:59.291251 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.316609 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-cf2bd15a-a263-43fa-b16e-342d3c3a182d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Feb 12 21:01:59.318346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf2bd15a-a263-43fa-b16e-342d3c3a182d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:59.320203 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf2bd15a-a263-43fa-b16e-342d3c3a182d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.033614 Feb 12 21:01:59.321058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 18/50] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:01:59 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:01:59.331035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b209117-ebd8-41f2-9e14-d7348fea0411 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-747218766"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:59.334844 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:59.334844 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.336713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-5b209117-ebd8-41f2-9e14-d7348fea0411 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid fa64cba9-6229-42fb-99cb-f223a2c0ed6d for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:01:59.513910 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b209117-ebd8-41f2-9e14-d7348fea0411 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.186872 Feb 12 21:01:59.515421 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 19/51] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:01:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:01:59.526583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50ab0ebb-8b0b-407d-8e8f-385a2bf43953 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:59.528907 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:59.528907 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.531207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50ab0ebb-8b0b-407d-8e8f-385a2bf43953 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '4ef3498f3ace445fab7a613c2fd9639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9719b96b4dfa4568b468c3a3a247fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:59.532524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50ab0ebb-8b0b-407d-8e8f-385a2bf43953 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:59.536676 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50ab0ebb-8b0b-407d-8e8f-385a2bf43953 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] 10.222.0.31 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.013337 Feb 12 21:01:59.540402 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 20/52] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:01:59 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:01:59.550215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2b7b7be-951a-4b0f-bcec-62242ebd5114 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:59.552653 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:59.552653 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.685797 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a2b7b7be-951a-4b0f-bcec-62242ebd5114 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.144018 Feb 12 21:01:59.690820 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 21/53] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:01:59.696352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7131e9de-b41b-421e-afb5-db385fd7aaa5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:59.697266 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:59.697266 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.698775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1293098918", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "availability_zone": "tempest-test_az-1298267163"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:01:59.714310 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7131e9de-b41b-421e-afb5-db385fd7aaa5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Feb 12 21:01:59.717872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7131e9de-b41b-421e-afb5-db385fd7aaa5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:59.719274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7131e9de-b41b-421e-afb5-db385fd7aaa5 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026677 Feb 12 21:01:59.720686 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 22/54] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:01:59 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:01:59.731245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33c69999-8e59-4918-b0cc-13017116b852 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:01:59.733343 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:01:59.733343 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:01:59.736782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33c69999-8e59-4918-b0cc-13017116b852 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '4ef3498f3ace445fab7a613c2fd9639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9719b96b4dfa4568b468c3a3a247fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:01:59.742147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33c69999-8e59-4918-b0cc-13017116b852 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:01:59.743922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-33c69999-8e59-4918-b0cc-13017116b852 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] 10.222.0.31 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017245 Feb 12 21:01:59.746394 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 23/55] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:01:59 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:01:59.753007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:59.757067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:59.758021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:01:59.763155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:01:59.911311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:02:00.176506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:02:00.177235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:02:00.178096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:02:00.180347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:02:00.180886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:02:00.194493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:00.196409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:00.198313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:00.199283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:00.240268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Getting quotas for project 2fa7b205f74a444eb5937c8c88c3033c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:00.247755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Getting quotas for user e12d2584c9304eef96f0b29105520391 and project 2fa7b205f74a444eb5937c8c88c3033c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:00.263282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:02:00.265959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:02:00.302860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:00.303664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:00.309853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:00.310561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:00.311432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:00.312628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:00.391041 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e37e83a3-9921-421b-b6be-5f1ccd4a7c9a tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665245 Feb 12 21:02:00.393901 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 33/56] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:02:00.403733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab6bcbf8-efc8-405d-bc7f-0b3a55a171bc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:00.404607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab6bcbf8-efc8-405d-bc7f-0b3a55a171bc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:00.506957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab6bcbf8-efc8-405d-bc7f-0b3a55a171bc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:00.517480 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab6bcbf8-efc8-405d-bc7f-0b3a55a171bc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1243 microversion: 2.1 time: 0.117258 Feb 12 21:02:00.527769 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 34/57] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:00 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1243 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:00.565644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:00.582406 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a76cdfa-0106-490c-ae35-b0cbfebf549f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1278 microversion: 2.1 time: 0.283699 Feb 12 21:02:00.583142 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 24/58] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:00 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:01.536165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82a03824-fb67-46d7-9aff-a97bff66d809 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:01.536855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82a03824-fb67-46d7-9aff-a97bff66d809 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:01.600615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:01.601317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:01.610178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:01.621930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:01.627356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:01.627823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:01.838706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82a03824-fb67-46d7-9aff-a97bff66d809 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:01.849255 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82a03824-fb67-46d7-9aff-a97bff66d809 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1243 microversion: 2.1 time: 0.315646 Feb 12 21:02:01.856363 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 35/59] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:01 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1243 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:02.822566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:02.836123 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a7ed47f-7b4f-4ac9-9def-52c32f2376bf tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 1.240086 Feb 12 21:02:02.848096 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 25/60] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:01 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:02.876512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:02.877205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:02.887796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:02.943375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:02.943375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:02.943375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:03.145547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:03.159832 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-74be5ad3-4ea8-4f5e-8f3a-693ae07ee6a5 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1243 microversion: 2.1 time: 0.291006 Feb 12 21:02:03.161208 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 36/61] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:02 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1243 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:03.855213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:03.864633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:03.878210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:03.882001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:03.883202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:03.885712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:04.191518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:04.197322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:04.202129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:04.203561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:04.204782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:04.205548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:04.343198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:04.354428 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b5759f44-59fc-4946-985e-7d8f888bbdc4 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1235 microversion: 2.1 time: 0.167227 Feb 12 21:02:04.368585 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 37/62] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:04 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1235 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:04.395438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:04.407497 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3dc67e9-caf6-4781-9e65-900856348843 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.556450 Feb 12 21:02:04.409762 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 26/63] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:03 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:05.382106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:05.385793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:05.394639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:05.408934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:05.413693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:05.414374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:05.436337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:05.446435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:05.459592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:05.460298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:05.462687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:05.464623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:05.791739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:05.809928 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4536ff9a-3e83-4d79-abcf-0426a3ff06af tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1309 microversion: 2.1 time: 0.432636 Feb 12 21:02:05.837455 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 38/64] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:05 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:06.264065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:06.282016 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c3d1af4-b980-4745-91ed-083a65f69c31 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.846435 Feb 12 21:02:06.284691 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 27/65] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:05 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:06.469113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2449b7da-e5f3-467f-a17d-fff1187e3633 req-137be03b-68de-4329-98c2-274401797fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e264a5e-a4b7-4947-b94b-331176328e63", "tag": "b943e58a-9420-46c8-b2e9-b3928cd30b30"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:06.470783 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:06.470783 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:06.819738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2449b7da-e5f3-467f-a17d-fff1187e3633 req-137be03b-68de-4329-98c2-274401797fed service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:06.820216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2449b7da-e5f3-467f-a17d-fff1187e3633 req-137be03b-68de-4329-98c2-274401797fed service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:06.852573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2449b7da-e5f3-467f-a17d-fff1187e3633 req-137be03b-68de-4329-98c2-274401797fed service nova] Creating event network-changed:b943e58a-9420-46c8-b2e9-b3928cd30b30 for instance 6e264a5e-a4b7-4947-b94b-331176328e63 on nch1-master-1 Feb 12 21:02:06.859005 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2449b7da-e5f3-467f-a17d-fff1187e3633 req-137be03b-68de-4329-98c2-274401797fed service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.019841 Feb 12 21:02:06.863709 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 39/66] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:06.869178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:06.870212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:06.887681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:06.890940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:06.890940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:06.890940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:07.154284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:07.169955 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbc682cb-526c-407a-a970-13a903eb3477 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1297 microversion: 2.1 time: 0.304313 Feb 12 21:02:07.188372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 40/67] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:06 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1297 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:07.301419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:07.302151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:07.315609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:07.317320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:07.320691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:07.322188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:08.115401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Calling method '.version_select at 0x7fa9045b9430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:08.119270 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:08.119270 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:08.121110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:08.123495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:08.225623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:08.230968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:08.308925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:08.313037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:08.350105 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1e35674f-0c1c-471d-89b7-1b270ca571ae tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.594280 Feb 12 21:02:08.354740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 28/68] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:02:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:08.379436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:08.382454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:08.404667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:08.410604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:08.410604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:08.417941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:09.491395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:09.506635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc32adbf-53c7-409f-bf2f-14d0ab67c493 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 1.150146 Feb 12 21:02:09.507402 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 29/69] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:08 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:09.519400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-30d06419-e5f1-4959-8ec3-87f193a73415 tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Calling method '.version_select at 0x7fa9045dfa60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:09.520443 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:09.520443 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:09.524437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30d06419-e5f1-4959-8ec3-87f193a73415 tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:09.525850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30d06419-e5f1-4959-8ec3-87f193a73415 tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:09.570367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30d06419-e5f1-4959-8ec3-87f193a73415 tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:09.571145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30d06419-e5f1-4959-8ec3-87f193a73415 tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:09.589770 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-30d06419-e5f1-4959-8ec3-87f193a73415 tempest-HypervisorAdminV228Test-2066011929 tempest-HypervisorAdminV228Test-2066011929-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.079650 Feb 12 21:02:09.592879 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 30/70] 10.222.0.31 () {60 vars in 1192 bytes} [Sat Feb 12 21:02:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:09.609845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:09.625265 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30899889-a77a-4568-bd68-fb9f3ced2de7 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 2.328503 Feb 12 21:02:09.634945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 41/71] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:07 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:10.095472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93d94868-bdf7-47eb-aef9-ead66ec27db7 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:10.096420 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:10.096420 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:10.099626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-93d94868-bdf7-47eb-aef9-ead66ec27db7 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Feb 12 21:02:10.104623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93d94868-bdf7-47eb-aef9-ead66ec27db7 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:10.106084 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93d94868-bdf7-47eb-aef9-ead66ec27db7 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633 tempest-InstanceUsageAuditLogNegativeTestJSON-273188633-project-admin] 10.222.0.31 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.510967 Feb 12 21:02:10.108173 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 31/72] 10.222.0.31 () {58 vars in 1223 bytes} [Sat Feb 12 21:02:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 514 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:02:10.532484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:10.533973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:10.555603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:10.557428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:10.560278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:10.560902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:10.914273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cc6a136-d4c2-439c-a017-20a60fb3bb9f tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:10.915922 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:10.915922 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:10.918976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3cc6a136-d4c2-439c-a017-20a60fb3bb9f tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'e039b8d1bbe24c0d9287359bffacc9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5c6c3a536e4eac8e2414d9953d780d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:10.920661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cc6a136-d4c2-439c-a017-20a60fb3bb9f tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:10.925014 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3cc6a136-d4c2-439c-a017-20a60fb3bb9f tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] 10.222.0.31 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.810519 Feb 12 21:02:10.926962 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 42/73] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:02:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 813 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:10.935859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:10.942188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:10.956806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:10.963109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:10.964289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:10.965963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:11.131553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:11.142386 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16bc7c28-bc81-4c40-b7ae-17448fe75f70 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.613707 Feb 12 21:02:11.152537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 32/74] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:10 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:11.160228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da064f5a-4c8c-4c50-b8c9-a6ce71af461b tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:11.161326 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:11.161326 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:11.165596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-da064f5a-4c8c-4c50-b8c9-a6ce71af461b tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'e039b8d1bbe24c0d9287359bffacc9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5c6c3a536e4eac8e2414d9953d780d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:11.166517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da064f5a-4c8c-4c50-b8c9-a6ce71af461b tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:11.168792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da064f5a-4c8c-4c50-b8c9-a6ce71af461b tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484 tempest-InstanceUsageAuditLogNegativeTestJSON-1282422484-project] 10.222.0.31 "GET /compute/v2.1/os-instance_usage_audit_log/2022-02-12 21:02:10" status: 403 len: 128 microversion: 2.1 time: 0.015027 Feb 12 21:02:11.169983 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 33/75] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:02:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-02-12%2021%3A02%3A10 => generated 128 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:12.072772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:12.082955 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-17a59826-7984-406b-af7d-65b12504a27d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 1.153813 Feb 12 21:02:12.083555 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 43/76] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:10 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:12.165837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:12.166833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:12.188987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:12.193544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:12.195630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:12.199029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:12.707011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:12.726924 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5cbc7315-6f77-457e-9d95-fd1c80d61dc3 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.566818 Feb 12 21:02:12.733136 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 34/77] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:12 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:13.106836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:13.115347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:13.137387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:13.137847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:13.142199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:13.142882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:13.732898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:13.732898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82ba9ef4-5781-41c3-9e95-ce66af5e1697 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.390702 Feb 12 21:02:13.732898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 35/78] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:13 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:13.734119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9a2bbb8-31c3-4c43-9ec3-5991ebe2413a tempest-AZAdminNegativeTestJSON-961361648 tempest-AZAdminNegativeTestJSON-961361648-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:13.734119 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:13.734119 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:13.734119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9a2bbb8-31c3-4c43-9ec3-5991ebe2413a tempest-AZAdminNegativeTestJSON-961361648 tempest-AZAdminNegativeTestJSON-961361648-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'd4a9a8cd68924022b7f383dc4c02e2dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc775aae31754f8ca637172e37da68a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:13.734891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9a2bbb8-31c3-4c43-9ec3-5991ebe2413a tempest-AZAdminNegativeTestJSON-961361648 tempest-AZAdminNegativeTestJSON-961361648-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:13.734891 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9a2bbb8-31c3-4c43-9ec3-5991ebe2413a tempest-AZAdminNegativeTestJSON-961361648 tempest-AZAdminNegativeTestJSON-961361648-project] 10.222.0.31 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.937832 Feb 12 21:02:13.734891 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 44/79] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:02:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 939 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:02:13.754143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:13.760526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:13.763518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:13.764132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:13.765497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:13.766393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:14.100548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:14.109753 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f110be9b-0437-43cc-b59e-cb20b8b67ec2 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.364588 Feb 12 21:02:14.119427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 36/80] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:13 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:14.738808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:14.740200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:14.769726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:14.772991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:14.774811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:14.775604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:15.128589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:15.140472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:15.152082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:15.153926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:15.155026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:15.156912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:15.577144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:15.588391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e9419bc0-55ca-4a82-bb6e-fc86aeed18b9 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.463422 Feb 12 21:02:15.591256 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 37/81] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:15 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:16.014521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:16.038011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-507556bb-8f9a-4652-9e71-69a55b9ed72e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 1.295500 Feb 12 21:02:16.048916 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 45/82] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:14 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:16.627955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:16.628785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:16.658280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:16.659119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:16.660185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:16.667902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:17.131282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:17.165835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3fee32a4-c3f9-4e86-ad13-aa3ab4006449 req-561961f3-d8cb-46b4-b620-ce1c5612245b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be69994b-e4e2-4bc4-97c3-8d94d29fe78a", "tag": "9321cd89-3791-44fa-bb97-c4567ffefdc5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:17.168387 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:17.168387 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:17.180969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6b087f6e-f2af-4bca-b144-ae13e335ddc6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.576974 Feb 12 21:02:17.205126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3fee32a4-c3f9-4e86-ad13-aa3ab4006449 req-561961f3-d8cb-46b4-b620-ce1c5612245b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:17.205619 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 38/83] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:16 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:17.219872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3fee32a4-c3f9-4e86-ad13-aa3ab4006449 req-561961f3-d8cb-46b4-b620-ce1c5612245b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:17.225265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:17.226084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:17.232844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:17.233597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:17.234649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:17.235170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:17.276441 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3fee32a4-c3f9-4e86-ad13-aa3ab4006449 req-561961f3-d8cb-46b4-b620-ce1c5612245b service nova] Creating event network-changed:9321cd89-3791-44fa-bb97-c4567ffefdc5 for instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a on nch2-master-1 Feb 12 21:02:17.292204 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3fee32a4-c3f9-4e86-ad13-aa3ab4006449 req-561961f3-d8cb-46b4-b620-ce1c5612245b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286970 Feb 12 21:02:17.297992 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 46/84] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:17.796579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:17.810303 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fcd3cc5c-e694-4528-8259-1148d70e27ff tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.603430 Feb 12 21:02:17.819437 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 39/85] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:17 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:18.199352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:18.199978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:18.214880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:18.215344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:18.216159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:18.216784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:18.837024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:18.837817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:18.896608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:18.896608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:18.896608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:18.896608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:18.984539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:18.992094 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4e98512-b1fd-498f-86b5-125bbdac2955 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.796774 Feb 12 21:02:19.002452 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 47/86] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:18 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:19.505238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:19.520759 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-554e1246-61c7-4107-a2e1-5dab67fe9f7e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.687753 Feb 12 21:02:19.521813 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 40/87] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:18 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:19.781932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-602e7361-1422-4125-b86b-9f3952dbd7f0 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:19.783322 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:19.783322 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:19.784906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-602e7361-1422-4125-b86b-9f3952dbd7f0 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.785437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-602e7361-1422-4125-b86b-9f3952dbd7f0 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.786234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-602e7361-1422-4125-b86b-9f3952dbd7f0 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.786677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-602e7361-1422-4125-b86b-9f3952dbd7f0 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.811477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-602e7361-1422-4125-b86b-9f3952dbd7f0 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.152768 Feb 12 21:02:19.812091 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 48/88] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:02:19 2022] GET /compute/v2.1/os-services => generated 969 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:19.823179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-608c5bab-3b76-4095-ba60-4b7e73a5748a tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:19.824485 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:19.824485 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:19.826347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608c5bab-3b76-4095-ba60-4b7e73a5748a tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.826802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608c5bab-3b76-4095-ba60-4b7e73a5748a tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.828392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608c5bab-3b76-4095-ba60-4b7e73a5748a tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.828840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608c5bab-3b76-4095-ba60-4b7e73a5748a tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.852529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-608c5bab-3b76-4095-ba60-4b7e73a5748a tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.032933 Feb 12 21:02:19.853144 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 41/89] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:02:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 969 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:19.864726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b87a18e3-b04e-4f26-b8b4-54b2c0ea9b2f tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:19.866110 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:19.866110 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:19.867675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b87a18e3-b04e-4f26-b8b4-54b2c0ea9b2f tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.868120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b87a18e3-b04e-4f26-b8b4-54b2c0ea9b2f tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.869060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b87a18e3-b04e-4f26-b8b4-54b2c0ea9b2f tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.869524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b87a18e3-b04e-4f26-b8b4-54b2c0ea9b2f tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.894055 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b87a18e3-b04e-4f26-b8b4-54b2c0ea9b2f tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.032850 Feb 12 21:02:19.894693 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 49/90] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:02:19 2022] GET /compute/v2.1/os-services => generated 969 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:19.904981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad0c5265-d2aa-4799-938f-573efd52a2d7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:19.907169 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:19.907169 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:19.908727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad0c5265-d2aa-4799-938f-573efd52a2d7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.909165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad0c5265-d2aa-4799-938f-573efd52a2d7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.910006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad0c5265-d2aa-4799-938f-573efd52a2d7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.910434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad0c5265-d2aa-4799-938f-573efd52a2d7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.934095 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad0c5265-d2aa-4799-938f-573efd52a2d7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.032668 Feb 12 21:02:19.934690 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 42/91] 10.222.0.31 () {58 vars in 1195 bytes} [Sat Feb 12 21:02:19 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:19.946197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ada6908-fb2d-4951-9f6e-a1079c83b36e tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:19.947812 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:19.947812 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:19.949429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ada6908-fb2d-4951-9f6e-a1079c83b36e tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.949834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ada6908-fb2d-4951-9f6e-a1079c83b36e tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.950839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ada6908-fb2d-4951-9f6e-a1079c83b36e tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:19.951332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ada6908-fb2d-4951-9f6e-a1079c83b36e tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:19.981189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ada6908-fb2d-4951-9f6e-a1079c83b36e tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.038980 Feb 12 21:02:19.991947 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 50/92] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:02:19 2022] GET /compute/v2.1/os-services => generated 969 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:19.999939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e24587a-9de6-4dc5-b21e-42012de2fda7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:20.000347 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:20.000347 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:20.002144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e24587a-9de6-4dc5-b21e-42012de2fda7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:20.002671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e24587a-9de6-4dc5-b21e-42012de2fda7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:20.003866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e24587a-9de6-4dc5-b21e-42012de2fda7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:20.004366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e24587a-9de6-4dc5-b21e-42012de2fda7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:20.013004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:20.013864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:20.027096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:20.027597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:20.028744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:20.029625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:20.036790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e24587a-9de6-4dc5-b21e-42012de2fda7 tempest-ServicesAdminNegativeTestJSON-1177493753 tempest-ServicesAdminNegativeTestJSON-1177493753-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.041488 Feb 12 21:02:20.038058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 43/93] 10.222.0.31 () {58 vars in 1197 bytes} [Sat Feb 12 21:02:19 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:20.219083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-131c89d3-c0d2-472a-87a0-551309bb61fb tempest-ServicesAdminNegativeTestJSON-730109280 tempest-ServicesAdminNegativeTestJSON-730109280-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:20.221712 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:20.221712 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:20.223394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-131c89d3-c0d2-472a-87a0-551309bb61fb tempest-ServicesAdminNegativeTestJSON-730109280 tempest-ServicesAdminNegativeTestJSON-730109280-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a7c94dbbfb0e4979b43fbdf1d6207142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a3ee64d22440b983a7946f1ec46ef5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:20.224374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-131c89d3-c0d2-472a-87a0-551309bb61fb tempest-ServicesAdminNegativeTestJSON-730109280 tempest-ServicesAdminNegativeTestJSON-730109280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:20.225857 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-131c89d3-c0d2-472a-87a0-551309bb61fb tempest-ServicesAdminNegativeTestJSON-730109280 tempest-ServicesAdminNegativeTestJSON-730109280-project] 10.222.0.31 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.180924 Feb 12 21:02:20.226872 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 44/94] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:02:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 182 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:20.501201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:20.518365 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbbeb35a-0b4c-424b-8cc3-9dbb972ab607 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.512271 Feb 12 21:02:20.530301 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 51/95] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:20 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:20.540378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:20.541011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:20.557762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:20.558662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:20.561288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:20.565563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:20.802108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:20.815451 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e8c667b3-a54c-4473-9b6c-48f6d1af674f tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.279053 Feb 12 21:02:20.816391 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 45/96] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:20 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:21.369464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-deb3a091-8ecd-4105-9fff-07f375f20550 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:21.380538 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-deb3a091-8ecd-4105-9fff-07f375f20550 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.398030 Feb 12 21:02:21.388194 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 52/97] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:02:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:21.535811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:21.536675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:21.546332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:21.549330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:21.550358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:21.553603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:21.636715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-68b15067-256a-45c9-a173-1f832917fe28 tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2066579141", "id": 772016053, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:21.639009 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:21.639009 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:21.721238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:21.724493 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4dad78f4-40e7-4ce9-848a-46125150b543 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.193249 Feb 12 21:02:21.725076 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 53/98] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:21 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:21.813530 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-68b15067-256a-45c9-a173-1f832917fe28 tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.425111 Feb 12 21:02:21.821022 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 46/99] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:21 2022] POST /compute/v2.1/flavors => generated 422 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:21.827254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04f17a00-7c03-4121-9f7c-8bb96c279b6b tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:21.856550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:21.856550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:21.856692 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04f17a00-7c03-4121-9f7c-8bb96c279b6b tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026325 Feb 12 21:02:21.856692 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 54/100] 10.222.0.31 () {58 vars in 1181 bytes} [Sat Feb 12 21:02:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:02:21.862465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:21.863640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:21.864747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:21.864888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6e52cbe-b8e4-4358-a6a5-24570b5d04ca tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1633075212", "id": 1966012558, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:21.865619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:21.866534 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:21.866534 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:22.028556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:22.036295 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ffdfd6d-6bc0-4fff-b70b-c8e5009cb5a0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.198358 Feb 12 21:02:22.036897 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 47/101] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:21 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:22.068333 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6e52cbe-b8e4-4358-a6a5-24570b5d04ca tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.211274 Feb 12 21:02:22.072562 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 55/102] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:21 2022] POST /compute/v2.1/flavors => generated 425 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:22.085840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7151e9d4-3bb6-4eda-be1a-cbff28e26e2c tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:22.115685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7151e9d4-3bb6-4eda-be1a-cbff28e26e2c tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036205 Feb 12 21:02:22.117164 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 48/103] 10.222.0.31 () {58 vars in 1181 bytes} [Sat Feb 12 21:02:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:22.129325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad2f66a3-978d-4cb1-88cc-b018005fde58 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Action: 'create', calling method: .version_select at 0x7fa9044ba3a0>, body: {"keypair": {"name": "tempest-keypair-1862670838"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:22.160265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ad2f66a3-978d-4cb1-88cc-b018005fde58 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:22.173717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ad2f66a3-978d-4cb1-88cc-b018005fde58 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for user daeed6cf1bbe4a8995815673f0866266 and project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:22.742459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:22.743075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:22.756052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:22.761379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:22.762517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:22.763461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:22.821484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ad2f66a3-978d-4cb1-88cc-b018005fde58 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:22.826089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ad2f66a3-978d-4cb1-88cc-b018005fde58 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for user daeed6cf1bbe4a8995815673f0866266 and project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:22.849063 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad2f66a3-978d-4cb1-88cc-b018005fde58 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.725753 Feb 12 21:02:22.850295 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 56/104] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:02:22 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:22.941014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:22.961218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-957dfff7-3c2e-40f0-b7ba-88af7690aabf tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.223343 Feb 12 21:02:22.965703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 49/105] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:22 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:23.058819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:23.059658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:23.067448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:23.068358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:23.069319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:23.069921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:23.369136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1dba799c-e2f6-40db-8e5b-d7148ffdeb69 req-0063080d-50fe-4a4c-911e-3d8bcd700956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e264a5e-a4b7-4947-b94b-331176328e63", "name": "network-vif-plugged", "status": "completed", "tag": "b943e58a-9420-46c8-b2e9-b3928cd30b30"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:23.371052 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:23.371052 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:23.384728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1dba799c-e2f6-40db-8e5b-d7148ffdeb69 req-0063080d-50fe-4a4c-911e-3d8bcd700956 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:23.390829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1dba799c-e2f6-40db-8e5b-d7148ffdeb69 req-0063080d-50fe-4a4c-911e-3d8bcd700956 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:23.419446 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1dba799c-e2f6-40db-8e5b-d7148ffdeb69 req-0063080d-50fe-4a4c-911e-3d8bcd700956 service nova] Creating event network-vif-plugged:b943e58a-9420-46c8-b2e9-b3928cd30b30 for instance 6e264a5e-a4b7-4947-b94b-331176328e63 on nch1-master-1 Feb 12 21:02:23.424308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:23.433338 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f742bb84-6a6f-44ab-8518-e534ced8f1d0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.381471 Feb 12 21:02:23.438541 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1dba799c-e2f6-40db-8e5b-d7148ffdeb69 req-0063080d-50fe-4a4c-911e-3d8bcd700956 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.585526 Feb 12 21:02:23.442426 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 57/106] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:23.444894 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 50/107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:23 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:23.985828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:23.986539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:23.998209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:24.001215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:24.002366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:24.003974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:24.266014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:24.281840 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15901b34-1dd7-4fc5-92eb-23890e088580 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.300560 Feb 12 21:02:24.283658 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 58/108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:23 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:24.450956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:24.452349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:24.461018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:24.461759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:24.462811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:24.464850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:24.668969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:24.676525 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c18a30f1-d0f2-4e91-aab9-08a4bab87ff5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.229580 Feb 12 21:02:24.677094 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 51/109] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:24 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:25.300442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:25.301203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:25.309041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.310242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:25.311830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.312570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:25.514373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:25.515945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-41e16d74-730b-4e49-8ea3-b419aa787cf6 req-12ba0fc6-fd28-4467-9dfe-4c7aeeaea695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be69994b-e4e2-4bc4-97c3-8d94d29fe78a", "name": "network-vif-plugged", "status": "completed", "tag": "9321cd89-3791-44fa-bb97-c4567ffefdc5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:25.520006 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:25.520006 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:25.531521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-41e16d74-730b-4e49-8ea3-b419aa787cf6 req-12ba0fc6-fd28-4467-9dfe-4c7aeeaea695 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.532375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-41e16d74-730b-4e49-8ea3-b419aa787cf6 req-12ba0fc6-fd28-4467-9dfe-4c7aeeaea695 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:25.534489 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-047ec5f7-e2d1-41ae-b9fb-fa967c51b8fc tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.237804 Feb 12 21:02:25.537171 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 59/110] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:25 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:25.565153 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-41e16d74-730b-4e49-8ea3-b419aa787cf6 req-12ba0fc6-fd28-4467-9dfe-4c7aeeaea695 service nova] Creating event network-vif-plugged:9321cd89-3791-44fa-bb97-c4567ffefdc5 for instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a on nch2-master-1 Feb 12 21:02:25.565704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-41e16d74-730b-4e49-8ea3-b419aa787cf6 req-12ba0fc6-fd28-4467-9dfe-4c7aeeaea695 service nova] Acquired lock "compute-rpcapi-router" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:02:25.566926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.567566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:25.568388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.568818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:25.599641 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.rpcapi [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 12 21:02:25.600546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] Releasing lock "compute-rpcapi-router" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:02:25.631885 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f5debee-83f4-49fa-b7b2-7face3a3dd5d None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146528 Feb 12 21:02:25.632836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 52/111] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:25.695577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:25.696441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:25.709873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.710576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:25.712754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:25.714933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:26.017145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:26.025320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d8216ada-c5f7-4e3d-98d9-86bf506bb281 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1320 microversion: 2.1 time: 0.334696 Feb 12 21:02:26.026584 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 60/112] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:25 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:26.395888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-14595622", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:26.444487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ab07409-6faf-45ae-8078-b07ea3b0af20 tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1042459738", "id": 722336249, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:26.446701 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:26.446701 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:26.532246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:02:26.569391 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ab07409-6faf-45ae-8078-b07ea3b0af20 tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.434479 Feb 12 21:02:26.570250 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 61/113] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:02:26 2022] POST /compute/v2.1/flavors => generated 446 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:26.574969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:26.579918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:26.584256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:26.584256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:26.585045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:26.585511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:26.756087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:26.763647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1fd4263e-75b0-44ef-81b1-ac478594b266 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.192066 Feb 12 21:02:26.764217 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 62/114] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:26 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:26.806977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:02:26.807388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:02:26.808016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:02:26.808716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:02:26.809311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:02:26.827609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:26.828066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:26.828882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:26.834191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:26.864546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:26.872332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for user 424f5011a4ef40c48465523369eab808 and project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:26.887664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:02:26.891437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:02:26.917092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-771064b0-2b93-4ced-af13-9009cf188244 tempest-FlavorsV255TestJSON-1150008693 tempest-FlavorsV255TestJSON-1150008693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:26.930210 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-771064b0-2b93-4ced-af13-9009cf188244 tempest-FlavorsV255TestJSON-1150008693 tempest-FlavorsV255TestJSON-1150008693-project] 10.222.0.31 "GET /compute/v2.1/flavors/722336249" status: 200 len: 446 microversion: 2.55 time: 0.164904 Feb 12 21:02:26.930844 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 63/115] 10.222.0.31 () {60 vars in 1195 bytes} [Sat Feb 12 21:02:26 2022] GET /compute/v2.1/flavors/722336249 => generated 446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:26.935953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-265833999", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "1966012558", "adminPass": "***", "networks": [{"uuid": "b9b58e18-4724-4374-98c5-14f3d3ee43a0"}], "security_groups": [{"name": "tempest-securitygroup--1079256265"}], "key_name": "tempest-keypair-1862670838", "user_data": "}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:27.032433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-580218ca-9816-4f5a-945d-10a8f219e7fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024052 Feb 12 21:02:27.033371 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 53/116] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:02:27.041193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27e6c520-c221-4d35-ac7e-bfba22a02c5d tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] Action: 'update', calling method: .version_select at 0x7fa9054b98b0>, body: {"flavor": {"description": "new"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:27.054314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] validate_networks() for [('b9b58e18-4724-4374-98c5-14f3d3ee43a0', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:02:27.067078 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:27.067078 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:27.208852 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27e6c520-c221-4d35-ac7e-bfba22a02c5d tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] 10.222.0.31 "PUT /compute/v2.1/flavors/722336249" status: 200 len: 447 microversion: 2.55 time: 0.174075 Feb 12 21:02:27.215874 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 54/117] 10.222.0.31 () {62 vars in 1215 bytes} [Sat Feb 12 21:02:27 2022] PUT /compute/v2.1/flavors/722336249 => generated 447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:27.221467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:27.222400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:27.232156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:27.232669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:27.233639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:27.234719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:27.431299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:27.438872 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-86629d08-66c3-4d88-b215-c8583b11bf23 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1470 microversion: 2.1 time: 0.221687 Feb 12 21:02:27.439576 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 55/118] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:27 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:27.443950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47bffebd-1c3b-4923-ba75-e9e1c6f1eb36 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:27.444548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47bffebd-1c3b-4923-ba75-e9e1c6f1eb36 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:27.526265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47bffebd-1c3b-4923-ba75-e9e1c6f1eb36 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:27.538996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47bffebd-1c3b-4923-ba75-e9e1c6f1eb36 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1211 microversion: 2.1 time: 0.098039 Feb 12 21:02:27.539599 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 56/119] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:27 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:27.545585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b545239-08b3-4b27-b22f-2afee32fe1ee tempest-FlavorsV255TestJSON-1150008693 tempest-FlavorsV255TestJSON-1150008693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:27.588070 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b545239-08b3-4b27-b22f-2afee32fe1ee tempest-FlavorsV255TestJSON-1150008693 tempest-FlavorsV255TestJSON-1150008693-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.047361 Feb 12 21:02:27.589397 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 57/120] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:02:27 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:27.751930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:02:27.752376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:02:27.752902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:02:27.753222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:02:27.753734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:02:27.763026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:27.763475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:27.765258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:27.765929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:27.786133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:27.787204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:27.787928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:27.790342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for user daeed6cf1bbe4a8995815673f0866266 and project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:27.798133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:27.807426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:27.807426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:27.807426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:27.807746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:02:27.809161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:02:27.991346 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc475bff-cf6c-4657-981d-d257931c5167 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.059466 Feb 12 21:02:27.992003 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 64/121] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:02:27.997947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-128893dd-82c3-4950-886d-1cdd96f4183a tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa904385820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.018020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:02:28.046894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-128893dd-82c3-4950-886d-1cdd96f4183a tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657" status: 200 len: 637 microversion: 2.1 time: 0.052895 Feb 12 21:02:28.047837 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 65/122] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:02:27 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657 => generated 637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:28.065718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ce455e4-790e-4c84-b50a-de74174a1bae tempest-FlavorsV255TestJSON-1150008693 tempest-FlavorsV255TestJSON-1150008693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.106494 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ce455e4-790e-4c84-b50a-de74174a1bae tempest-FlavorsV255TestJSON-1150008693 tempest-FlavorsV255TestJSON-1150008693-project] 10.222.0.31 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.057356 Feb 12 21:02:28.117075 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 66/123] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 21:02:28 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:28.123037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.123849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:28.131543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:28.131996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:28.132822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:28.133254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:28.350308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:28.359110 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48eb5c95-7cdd-4611-9908-0cf0af97e3d6 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1339 microversion: 2.1 time: 0.240488 Feb 12 21:02:28.359793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 67/124] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:28 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:28.364110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7984a3de-a40b-474a-a668-e3f9e90aa9eb tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.364711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7984a3de-a40b-474a-a668-e3f9e90aa9eb tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:28.423704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7984a3de-a40b-474a-a668-e3f9e90aa9eb tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:28.431003 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7984a3de-a40b-474a-a668-e3f9e90aa9eb tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1264 microversion: 2.1 time: 0.070200 Feb 12 21:02:28.431594 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 68/125] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:28 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1264 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:28.435950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-87318235-d62e-4faa-9bc9-00df84c72a1d tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa9044ba1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:28.471850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36d2fd4e-589c-4daf-b523-3f4e69cc2012 tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] 10.222.0.31 "DELETE /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 204 len: 0 microversion: 2.1 time: 0.880888 Feb 12 21:02:28.477595 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 58/126] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:02:27 2022] DELETE /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:02:28.486815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-220ededa-4a75-41b3-97fd-74fef1c0e498 tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.487637 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:28.487637 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:28.507929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-87318235-d62e-4faa-9bc9-00df84c72a1d tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:28.511966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-87318235-d62e-4faa-9bc9-00df84c72a1d tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:28.565027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-220ededa-4a75-41b3-97fd-74fef1c0e498 tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/722336249" status: 202 len: 0 microversion: 2.55 time: 0.085756 Feb 12 21:02:28.566471 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 59/127] 10.222.0.31 () {60 vars in 1198 bytes} [Sat Feb 12 21:02:28 2022] DELETE /compute/v2.1/flavors/722336249 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:02:28.571431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.575127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:28.579766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:28.580438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:28.581488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:28.582021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:28.744637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:28.760236 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fe4f212-fb7b-4207-90a8-8b4194d13cf9 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1476 microversion: 2.1 time: 0.192114 Feb 12 21:02:28.761269 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 60/128] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:28 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:28.767827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.768881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:28.778763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:28.779203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:28.780096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:28.781113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:28.856405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:28.864195 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-708db952-f02d-4c3e-be5b-6d17faafdb2e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1215 microversion: 2.1 time: 0.101649 Feb 12 21:02:28.864856 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 61/129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:28 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:28.871694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36e033d5-fa8f-47c0-b152-4ed56e70bf37 tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:28.918391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36e033d5-fa8f-47c0-b152-4ed56e70bf37 tempest-FlavorsV255TestJSON-1699182174 tempest-FlavorsV255TestJSON-1699182174-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.050952 Feb 12 21:02:28.919052 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 62/130] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:02:28 2022] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:29.012864 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-87318235-d62e-4faa-9bc9-00df84c72a1d tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.580194 Feb 12 21:02:29.013623 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 69/131] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:28 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:29.022165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3953cfa-3379-4d0c-beae-485119f4b46e tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa90444ba60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:29.377037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:29.377832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:29.384164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:29.384709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:29.385617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:29.386055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:29.498012 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3953cfa-3379-4d0c-beae-485119f4b46e tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "DELETE /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.479378 Feb 12 21:02:29.501428 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 63/132] 10.222.0.31 () {58 vars in 1295 bytes} [Sat Feb 12 21:02:29 2022] DELETE /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata/os_version => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:02:29.503482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:29.504095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:29.510401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:29.510851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:29.511638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:29.512074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:29.545468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:29.553409 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31b92028-bba2-45fa-835e-c930b8646ca1 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1489 microversion: 2.1 time: 0.181046 Feb 12 21:02:29.553954 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 70/133] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:29 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1489 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:29.558224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-444d206d-3012-493a-8e6d-939535db67e3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa9044ba280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:29.587611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:29.605635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a1825fc-fc08-4e78-b327-c4fb851e9a1e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1268 microversion: 2.1 time: 0.105360 Feb 12 21:02:29.609683 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 64/134] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:29 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1268 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:29.621579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:29.622144 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-444d206d-3012-493a-8e6d-939535db67e3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 37 microversion: 2.1 time: 0.067061 Feb 12 21:02:29.622663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:29.623059 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 71/135] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:02:29 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 37 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:29.631186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:29.631761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:29.632664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:29.633250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:29.656879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90f33936-9af6-4e2f-bf99-0e7f15fa56f2 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa904385820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:29.722209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-90f33936-9af6-4e2f-bf99-0e7f15fa56f2 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:29.728217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-90f33936-9af6-4e2f-bf99-0e7f15fa56f2 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:30.099933 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52f8c397-ad45-4f52-9279-2057e09de335 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1640 microversion: 2.1 time: 0.488199 Feb 12 21:02:30.100841 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 65/136] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:29 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1640 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:30.110405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:30.111025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:30.127265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.130717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.132960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.133591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.224042 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90f33936-9af6-4e2f-bf99-0e7f15fa56f2 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.577738 Feb 12 21:02:30.225223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 72/137] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:29 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:30.229927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:30.230621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:30.238932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.240106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.241132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.241813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.340695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:30.349306 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b716ca30-bb32-4c3f-889b-3d039fbe5f19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1281 microversion: 2.1 time: 0.122806 Feb 12 21:02:30.359777 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 73/138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:30 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:30.367301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:30.368140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:30.377119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.377978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.379105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.379766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.408423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:02:30.567782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:30.585651 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-14989e58-d01c-4306-8c75-4540471c0565 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1476 microversion: 2.1 time: 0.483710 Feb 12 21:02:30.587047 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 66/139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:30 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1476 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:30.592023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-85259f3a-f6ac-4f4f-a493-9fef060d680c tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa9042ff3a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:30.636654 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-85259f3a-f6ac-4f4f-a493-9fef060d680c tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.048341 Feb 12 21:02:30.637830 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 67/140] 10.222.0.31 () {58 vars in 1289 bytes} [Sat Feb 12 21:02:30 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata/os_distro => generated 33 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:30.646313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:30.646966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:30.653849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.654726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.656857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:30.657490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:30.745050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:30.767468 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73de37ee-0fb4-4c8c-8524-d4db39942a48 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1316 microversion: 2.1 time: 0.128463 Feb 12 21:02:30.768068 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 68/141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:30 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1316 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:30.813286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-417c9230-df97-4a0c-bb72-f1cc16159fa3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa90444ba60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:30.889014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-417c9230-df97-4a0c-bb72-f1cc16159fa3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:30.894513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-417c9230-df97-4a0c-bb72-f1cc16159fa3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:31.017191 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72c6568c-8bf1-4974-89a3-58301c282112 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "DELETE /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 204 len: 0 microversion: 2.1 time: 0.665500 Feb 12 21:02:31.020056 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 74/142] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:02:30 2022] DELETE /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:02:31.029880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-41fe210c-ef28-4575-b55f-d5bebbb4985c req-753bf3d4-8d77-4eca-a746-f181ca2deffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e264a5e-a4b7-4947-b94b-331176328e63", "name": "network-vif-deleted", "tag": "b943e58a-9420-46c8-b2e9-b3928cd30b30"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:31.034730 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:31.034730 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:31.053465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-41fe210c-ef28-4575-b55f-d5bebbb4985c req-753bf3d4-8d77-4eca-a746-f181ca2deffa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.056655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-41fe210c-ef28-4575-b55f-d5bebbb4985c req-753bf3d4-8d77-4eca-a746-f181ca2deffa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.076898 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-41fe210c-ef28-4575-b55f-d5bebbb4985c req-753bf3d4-8d77-4eca-a746-f181ca2deffa service nova] Creating event network-vif-deleted:b943e58a-9420-46c8-b2e9-b3928cd30b30 for instance 6e264a5e-a4b7-4947-b94b-331176328e63 on nch1-master-1 Feb 12 21:02:31.083238 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-41fe210c-ef28-4575-b55f-d5bebbb4985c req-753bf3d4-8d77-4eca-a746-f181ca2deffa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058253 Feb 12 21:02:31.084460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 75/143] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:31.089803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:31.090785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:31.098969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.102112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.102112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.102112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.317335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-417c9230-df97-4a0c-bb72-f1cc16159fa3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.547747 Feb 12 21:02:31.318016 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 69/144] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:30 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:31.330416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0297d6e2-cdff-43b1-b284-599587483161 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa904367310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:31.385282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0297d6e2-cdff-43b1-b284-599587483161 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.060076 Feb 12 21:02:31.392217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 70/145] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:02:31 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:31.403261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:31.404187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:31.410839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.411361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.412294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.412798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.442025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:31.451624 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c0f5ef6-7064-4866-adee-c839db6dbe3e tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1495 microversion: 2.1 time: 0.365668 Feb 12 21:02:31.452410 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 76/146] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:31 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1495 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:31.456986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15b7fb1f-a18d-444c-a041-f9b30753a93b tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa9043f0700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:31.523351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-15b7fb1f-a18d-444c-a041-f9b30753a93b tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:31.533279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-15b7fb1f-a18d-444c-a041-f9b30753a93b tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:31.545464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:31.557100 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-90b2e4fb-56c6-446d-8b24-02b3a57af0ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1269 microversion: 2.1 time: 0.163781 Feb 12 21:02:31.557850 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 71/147] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:31 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:31.604834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:31.605918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:31.621621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.621621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.621621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.621621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.690190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.690753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.691211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lazy-loading 'fault' on Instance uuid 6e264a5e-a4b7-4947-b94b-331176328e63 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:31.776915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:31.791764 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d0a378f-050d-4b00-b446-1eb29d00d70e tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 200 len: 1310 microversion: 2.1 time: 0.191730 Feb 12 21:02:31.807427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 72/148] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:31 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 1310 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:31.814159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:31.814856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:31.822108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.822877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.824133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:31.824854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:31.865831 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15b7fb1f-a18d-444c-a041-f9b30753a93b tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.412036 Feb 12 21:02:31.875229 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 77/149] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:31 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:31.884282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3925dd1f-085c-4bac-98ec-879d3feb2f66 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa9044ba550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:31.936988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:31.946620 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-335d43aa-7c3e-43d7-9eeb-5e7359972542 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1334 microversion: 2.1 time: 0.137466 Feb 12 21:02:31.947535 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 73/150] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:31 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:31.963762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3925dd1f-085c-4bac-98ec-879d3feb2f66 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:31.968942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3925dd1f-085c-4bac-98ec-879d3feb2f66 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:32.475961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:32.479548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:32.495309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:32.498452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:32.509974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:32.510707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:32.527945 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3925dd1f-085c-4bac-98ec-879d3feb2f66 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 64 microversion: 2.1 time: 0.643600 Feb 12 21:02:32.528942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 78/151] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:31 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 64 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:32.539025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-766fc3e7-5fcf-4d19-a3fc-d01c4c70647f tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa904566d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:32.607446 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-766fc3e7-5fcf-4d19-a3fc-d01c4c70647f tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 64 microversion: 2.1 time: 0.072965 Feb 12 21:02:32.609112 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 79/152] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:02:32 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 64 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:02:32.617159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:32.618105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:32.629862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:32.631542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:32.633272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:32.633707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:32.840953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:32.852770 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-26f30155-3fbd-4dd3-9c8f-359c02d00d99 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1495 microversion: 2.1 time: 0.387835 Feb 12 21:02:32.856144 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 74/153] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:32 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1495 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:32.862916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82d202b5-3bbd-4998-b201-0d3e31a8d36e tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa90444b940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:32.925033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-82d202b5-3bbd-4998-b201-0d3e31a8d36e tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:32.930020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-82d202b5-3bbd-4998-b201-0d3e31a8d36e tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:33.355847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:33.367530 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-37fdb7d8-8a3a-4775-ad88-d2c96d6b22d3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1311 microversion: 2.1 time: 0.757158 Feb 12 21:02:33.368139 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 80/154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:32 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1311 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:33.382487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:33.383132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:33.404245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:33.407463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:33.409298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:33.410249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:33.435334 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] HTTP exception thrown: Instance 6e264a5e-a4b7-4947-b94b-331176328e63 could not be found. Feb 12 21:02:33.436214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Returning 404 to user: Instance 6e264a5e-a4b7-4947-b94b-331176328e63 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:33.438246 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2981e977-c659-47c8-add6-daa7db699db6 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 404 len: 111 microversion: 2.1 time: 0.059293 Feb 12 21:02:33.439272 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 81/155] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:33 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:33.705622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-931468322", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "04e4405d-ac34-418d-b812-924c095df566"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:33.760786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] validate_networks() for [('04e4405d-ac34-418d-b812-924c095df566', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:02:33.881171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82d202b5-3bbd-4998-b201-0d3e31a8d36e tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 1.023259 Feb 12 21:02:33.882601 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 75/156] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:32 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:33.893172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:33.895278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:33.903904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:33.904622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:33.906190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:33.906807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:34.395343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:34.415209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e7994d9d-8fd9-4b9e-90d1-bc612ca843dc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.519700 Feb 12 21:02:34.415864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 76/157] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:33 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:34.422045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1922863736", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:34.501392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:02:34.596181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:02:34.601852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:02:34.602590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:02:34.603116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:02:34.609292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:02:34.628689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:34.629561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:34.630652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:34.632426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:34.654250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:34.659315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for user f126f64ca5e64defb9bbcf4c6bab2fd8 and project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:34.697672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:02:34.702911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:02:34.903122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:02:34.908662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:02:34.908662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:02:34.908662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:02:34.908662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:02:34.915008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:34.915537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:34.916415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:34.916917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:34.936118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Getting quotas for project f24b9d29252e43d597ac37f401de9de5. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:34.942274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Getting quotas for user 025db9daf7864d258b3453ec4381626c and project f24b9d29252e43d597ac37f401de9de5. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:34.960731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:02:34.967542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:02:34.995891 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e299246-aad9-49d8-a4d6-ad1fe31060c3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555412 Feb 12 21:02:35.000713 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 82/158] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:02:35.012560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-03c22d0b-f967-4c3c-be44-3a158b45fc4f req-27b1627f-6dd9-4ddd-886f-fbddb2085b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb70780-dfdd-41df-8b16-34776dae9ee5", "tag": "7fe731ff-5471-4420-a35a-07898901b4d0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:35.019980 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:35.019980 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:35.047071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-03c22d0b-f967-4c3c-be44-3a158b45fc4f req-27b1627f-6dd9-4ddd-886f-fbddb2085b5a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.057929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-03c22d0b-f967-4c3c-be44-3a158b45fc4f req-27b1627f-6dd9-4ddd-886f-fbddb2085b5a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.073742 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-03c22d0b-f967-4c3c-be44-3a158b45fc4f req-27b1627f-6dd9-4ddd-886f-fbddb2085b5a service nova] Creating event network-changed:7fe731ff-5471-4420-a35a-07898901b4d0 for instance cdb70780-dfdd-41df-8b16-34776dae9ee5 on nch1-master-1 Feb 12 21:02:35.082628 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-03c22d0b-f967-4c3c-be44-3a158b45fc4f req-27b1627f-6dd9-4ddd-886f-fbddb2085b5a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076848 Feb 12 21:02:35.085595 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 83/159] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:35.088414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:35.089537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:35.097209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.097992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.098968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.099769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.138607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.139334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.140577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lazy-loading 'fault' on Instance uuid be69994b-e4e2-4bc4-97c3-8d94d29fe78a {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:35.169285 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb389dad-f577-443e-8ab6-03e494201c13 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751730 Feb 12 21:02:35.172887 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 77/160] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:02:35.186744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cfee0acb-b2a2-4375-ae71-15f4aed5d84c tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update', calling method: .version_select at 0x7fa90444bd30>, body: {"meta": {"os_version": "alt"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:35.251930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-cfee0acb-b2a2-4375-ae71-15f4aed5d84c tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:35.253698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d2584c9304eef96f0b29105520391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa7b205f74a444eb5937c8c88c3033c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:35.258628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-cfee0acb-b2a2-4375-ae71-15f4aed5d84c tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:35.271588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-24dc6858-f4b4-47aa-ba38-2cb3e0f029eb tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 200 len: 1329 microversion: 2.1 time: 0.187058 Feb 12 21:02:35.290328 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 84/161] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:35 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 1329 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:35.307030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:35.307030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:35.326857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.326857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.327727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.336344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.926303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:35.937632 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d29a47b9-b0f3-4438-8612-d4778908ce7f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1311 microversion: 2.1 time: 0.646063 Feb 12 21:02:35.939993 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 85/162] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:35 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1311 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:35.948538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-12d65719-a6e7-4ff2-bc16-a65ad9c12660 req-4436d5cf-b9dc-4c9f-8b05-0a30b94ee845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be69994b-e4e2-4bc4-97c3-8d94d29fe78a", "name": "network-vif-deleted", "tag": "9321cd89-3791-44fa-bb97-c4567ffefdc5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:35.954877 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:35.954877 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:35.964141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-12d65719-a6e7-4ff2-bc16-a65ad9c12660 req-4436d5cf-b9dc-4c9f-8b05-0a30b94ee845 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:35.965134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-12d65719-a6e7-4ff2-bc16-a65ad9c12660 req-4436d5cf-b9dc-4c9f-8b05-0a30b94ee845 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:35.978381 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-12d65719-a6e7-4ff2-bc16-a65ad9c12660 req-4436d5cf-b9dc-4c9f-8b05-0a30b94ee845 service nova] Creating event network-vif-deleted:9321cd89-3791-44fa-bb97-c4567ffefdc5 for instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a on nch2-master-1 Feb 12 21:02:35.984195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-12d65719-a6e7-4ff2-bc16-a65ad9c12660 req-4436d5cf-b9dc-4c9f-8b05-0a30b94ee845 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041139 Feb 12 21:02:35.985329 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 86/163] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:35.991736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e68800b9-61b2-485b-b665-afce24805e21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:35.992533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e68800b9-61b2-485b-b665-afce24805e21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:36.050029 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cfee0acb-b2a2-4375-ae71-15f4aed5d84c tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.874836 Feb 12 21:02:36.050609 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 78/164] 10.222.0.31 () {60 vars in 1312 bytes} [Sat Feb 12 21:02:35 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata/os_version => generated 31 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:36.064447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ff41591-31a7-4d39-a1be-59fa8a611024 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:36.064447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7ff41591-31a7-4d39-a1be-59fa8a611024 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:36.122060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ff41591-31a7-4d39-a1be-59fa8a611024 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:36.129913 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ff41591-31a7-4d39-a1be-59fa8a611024 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1220 microversion: 2.1 time: 0.077897 Feb 12 21:02:36.130514 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 79/165] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:36 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:36.135156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:36.135780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:36.142818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:36.143293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:36.144101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:36.144566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:36.294745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e68800b9-61b2-485b-b665-afce24805e21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:36.303081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e68800b9-61b2-485b-b665-afce24805e21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1210 microversion: 2.1 time: 0.316288 Feb 12 21:02:36.303674 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 87/166] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:35 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1210 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:36.312951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:36.316021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b4714d94-ece3-48e3-92d4-380358555076 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.184407 Feb 12 21:02:36.325306 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 80/167] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:36 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:36.325611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8af5b452-587d-4178-839a-32be59cedcd9 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa904385ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:36.362586 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8af5b452-587d-4178-839a-32be59cedcd9 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 58 microversion: 2.1 time: 0.047691 Feb 12 21:02:36.363140 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 88/168] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:02:36 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 58 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:36.367645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:36.368445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:36.375642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:36.379215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:36.379215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:36.379215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:36.396590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] HTTP exception thrown: Instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a could not be found. Feb 12 21:02:36.397189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Returning 404 to user: Instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:36.398051 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aced965c-3004-44a3-a9e4-1d1cc85c3aa8 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 404 len: 111 microversion: 2.1 time: 0.033852 Feb 12 21:02:36.398609 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 89/169] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:36 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:36.411701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92ea3bd6-2e9c-4623-aeab-acba2a3e06bd tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'update_all', calling method: .version_select at 0x7fa90454e040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:36.462181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-92ea3bd6-2e9c-4623-aeab-acba2a3e06bd tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:36.466627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-92ea3bd6-2e9c-4623-aeab-acba2a3e06bd tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:36.473535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-43bcf1cf-e9aa-44a1-ac68-809b23abc9d1 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Action: 'create', calling method: .version_select at 0x7fa904334670>, body: {"keypair": {"name": "tempest-keypair-519915172", "type": "ssh", "user_id": "acec753771364ee7ae8b5034502fb27c"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:36.496951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-43bcf1cf-e9aa-44a1-ac68-809b23abc9d1 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:36.510375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-43bcf1cf-e9aa-44a1-ac68-809b23abc9d1 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for user 8c09c876ed15433982a5e63532316798 and project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:36.886487 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92ea3bd6-2e9c-4623-aeab-acba2a3e06bd tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 61 microversion: 2.1 time: 0.479264 Feb 12 21:02:36.887131 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 90/170] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:02:36 2022] PUT /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:36.892086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-16bf16b5-e33b-4512-b4a5-77754c0db6bc tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:36.893409 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:36.893409 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:36.904479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16bf16b5-e33b-4512-b4a5-77754c0db6bc tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:36.908482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16bf16b5-e33b-4512-b4a5-77754c0db6bc tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.075702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-43bcf1cf-e9aa-44a1-ac68-809b23abc9d1 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:37.080019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-43bcf1cf-e9aa-44a1-ac68-809b23abc9d1 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for user 8c09c876ed15433982a5e63532316798 and project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:37.093896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-43bcf1cf-e9aa-44a1-ac68-809b23abc9d1 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.10 time: 0.776113 Feb 12 21:02:37.094512 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 81/171] 10.222.0.31 () {62 vars in 1199 bytes} [Sat Feb 12 21:02:36 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 777 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:02:37.099200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da5e7339-235f-4c56-a2ec-decd3a61eae3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Action: 'create', calling method: .version_select at 0x7fa904334a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:37.152493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-da5e7339-235f-4c56-a2ec-decd3a61eae3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:37.157575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-da5e7339-235f-4c56-a2ec-decd3a61eae3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Getting quotas for user 17fd9a78840f40ae940213014a810288 and project d0a1ae4626a8498ca4223a253fe87785. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:37.234899 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-16bf16b5-e33b-4512-b4a5-77754c0db6bc tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.346698 Feb 12 21:02:37.235464 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 91/172] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:02:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:37.240426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.241651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:37.249856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.250316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.251222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.251815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.400325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:37.409067 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc1dc3d9-efb0-49a9-bdc4-bb4566102f5a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1311 microversion: 2.1 time: 0.172431 Feb 12 21:02:37.409665 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 92/173] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:37 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:37.423158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14d9b39d-d1f0-401b-91a0-2f9ed266bd7a tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Action: 'create', calling method: .version_select at 0x7fa9044ba0d0>, body: {"keypair": {"name": "tempest-keypair-1564218952", "type": "ssh", "user_id": "acec753771364ee7ae8b5034502fb27c"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:37.437450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-14d9b39d-d1f0-401b-91a0-2f9ed266bd7a tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:37.446108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-14d9b39d-d1f0-401b-91a0-2f9ed266bd7a tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for user 8c09c876ed15433982a5e63532316798 and project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:37.573044 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da5e7339-235f-4c56-a2ec-decd3a61eae3 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "POST /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 85 microversion: 2.1 time: 0.477388 Feb 12 21:02:37.573663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 82/174] 10.222.0.31 () {60 vars in 1280 bytes} [Sat Feb 12 21:02:37 2022] POST /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 85 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:37.578316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.578918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:37.585313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.590311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.590311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.590311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.619593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-14d9b39d-d1f0-401b-91a0-2f9ed266bd7a tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:37.623510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-14d9b39d-d1f0-401b-91a0-2f9ed266bd7a tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for user 8c09c876ed15433982a5e63532316798 and project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:37.638195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14d9b39d-d1f0-401b-91a0-2f9ed266bd7a tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.218699 Feb 12 21:02:37.638795 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 93/175] 10.222.0.31 () {62 vars in 1199 bytes} [Sat Feb 12 21:02:37 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 220 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:02:37.643132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78a46cbf-888e-4ee7-81ad-5315e7371aab tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.643912 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:37.643912 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:37.660338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:37.667881 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a4e78069-e4cf-4844-9fe9-23f1ad191801 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1272 microversion: 2.1 time: 0.093223 Feb 12 21:02:37.668469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 83/176] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:37 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:37.673898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.674503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:37.681217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.682046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.682944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.683385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.758986 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78a46cbf-888e-4ee7-81ad-5315e7371aab tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.119089 Feb 12 21:02:37.760512 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 94/177] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:02:37 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:37.765378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:37.774190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.774814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:37.775131 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3707579-8cdf-4c83-adb6-43b2ea820d97 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1262 microversion: 2.1 time: 0.105305 Feb 12 21:02:37.775833 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 84/178] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:37 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:37.782746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-210d56b4-76f0-4296-bb3a-e11fca235ef4 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] Calling method '.version_select at 0x7fa904351dc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.799699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.800351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.801502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:37.802049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:37.831889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-210d56b4-76f0-4296-bb3a-e11fca235ef4 tempest-ImagesMetadataTestJSON-2109127856 tempest-ImagesMetadataTestJSON-2109127856-project] 10.222.0.31 "GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata" status: 200 len: 85 microversion: 2.1 time: 0.054862 Feb 12 21:02:37.837413 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 85/179] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:02:37 2022] GET /compute/v2.1/images/b957d0e8-fa82-48fc-bfd1-730a9c10e657/metadata => generated 85 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:37.841963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b2d236f-a66c-4704-8221-1d9efcb886bf tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Calling method '.version_select at 0x7fa904334040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:37.852424 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b2d236f-a66c-4704-8221-1d9efcb886bf tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "GET /compute/v2.1/os-keypairs/tempest-keypair-519915172?user_id=acec753771364ee7ae8b5034502fb27c" status: 200 len: 705 microversion: 2.10 time: 0.018542 Feb 12 21:02:37.859922 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 86/180] 10.222.0.31 () {60 vars in 1336 bytes} [Sat Feb 12 21:02:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-519915172?user_id=acec753771364ee7ae8b5034502fb27c => generated 705 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:37.865042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e54c6b15-ef8a-4276-a242-0606233b1e74 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1056565092"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:37.866793 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:37.866793 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:37.868574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-e54c6b15-ef8a-4276-a242-0606233b1e74 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid ffd416ed-6dd4-4fa9-a5e8-04353ce16d23 for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:38.007104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e54c6b15-ef8a-4276-a242-0606233b1e74 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.144011 Feb 12 21:02:38.011519 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 87/181] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:38.019834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5972ec3-0923-4709-b2a2-5c95232b1d0f tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Action: 'create', calling method: .version_select at 0x7fa9042e3040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-177140895", "type": "ssh"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:38.041492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b5972ec3-0923-4709-b2a2-5c95232b1d0f tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:38.049174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b5972ec3-0923-4709-b2a2-5c95232b1d0f tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for user 8c09c876ed15433982a5e63532316798 and project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:38.063050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:38.072554 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a73c3bbc-2ce5-4ba3-bcc0-e2a2b56910a4 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.310799 Feb 12 21:02:38.085232 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 95/182] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:37 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:38.100094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6bf959b1-3934-484a-aa6e-5e60c45f8c3f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:38.101788 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:38.101788 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:38.122130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf959b1-3934-484a-aa6e-5e60c45f8c3f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.122691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf959b1-3934-484a-aa6e-5e60c45f8c3f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:38.312155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b5972ec3-0923-4709-b2a2-5c95232b1d0f tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:38.316916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b5972ec3-0923-4709-b2a2-5c95232b1d0f tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Getting quotas for user 8c09c876ed15433982a5e63532316798 and project a27db69113b848a9889e76eeac2a6ad0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:38.333186 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5972ec3-0923-4709-b2a2-5c95232b1d0f tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.10 time: 0.320306 Feb 12 21:02:38.335233 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 88/183] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:02:38 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 323 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:02:38.348058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-807540c0-0369-4989-bc09-1ec8349b6264 req-0cf4aa87-4102-4f8c-897b-fecfc76bbe89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69d5d6c-82ee-44e8-930e-270484371efe", "tag": "066233ec-c2e8-467f-a414-c7bb91607730"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:38.348058 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:38.348058 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:38.354070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-807540c0-0369-4989-bc09-1ec8349b6264 req-0cf4aa87-4102-4f8c-897b-fecfc76bbe89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.354509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-807540c0-0369-4989-bc09-1ec8349b6264 req-0cf4aa87-4102-4f8c-897b-fecfc76bbe89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:38.367263 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-807540c0-0369-4989-bc09-1ec8349b6264 req-0cf4aa87-4102-4f8c-897b-fecfc76bbe89 service nova] Creating event network-changed:066233ec-c2e8-467f-a414-c7bb91607730 for instance a69d5d6c-82ee-44e8-930e-270484371efe on nch1-master-1 Feb 12 21:02:38.372526 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-807540c0-0369-4989-bc09-1ec8349b6264 req-0cf4aa87-4102-4f8c-897b-fecfc76bbe89 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034587 Feb 12 21:02:38.373378 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 89/184] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:38.379474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-032cc615-a871-406f-9bcd-f2ffeb14db70 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Calling method '.version_select at 0x7fa9043cc550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:38.383147 ncdv-master-1 devstack@n-api.service[141727]: WARNING oslo_db.sqlalchemy.utils [None req-032cc615-a871-406f-9bcd-f2ffeb14db70 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Feb 12 21:02:38.389668 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-032cc615-a871-406f-9bcd-f2ffeb14db70 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "GET /compute/v2.1/os-keypairs?user_id=acec753771364ee7ae8b5034502fb27c" status: 200 len: 1113 microversion: 2.10 time: 0.014383 Feb 12 21:02:38.390781 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 90/185] 10.222.0.31 () {60 vars in 1258 bytes} [Sat Feb 12 21:02:38 2022] GET /compute/v2.1/os-keypairs?user_id=acec753771364ee7ae8b5034502fb27c => generated 1113 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:38.402102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1b361b4-0b17-404c-bb54-c9c23ce1c5c7 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Calling method '.version_select at 0x7fa9042e30d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:38.481829 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6bf959b1-3934-484a-aa6e-5e60c45f8c3f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.395187 Feb 12 21:02:38.482422 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 96/186] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:02:38 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:38.494524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:38.495351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:38.503736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.504538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:38.505544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.506270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:38.552895 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1b361b4-0b17-404c-bb54-c9c23ce1c5c7 tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-177140895" status: 204 len: 0 microversion: 2.10 time: 0.155945 Feb 12 21:02:38.553600 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 91/187] 10.222.0.31 () {60 vars in 1321 bytes} [Sat Feb 12 21:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-177140895 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 12 21:02:38.558402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a2157e9-2a8a-481b-bc5a-f318e25e154d tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:38.559315 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:38.559315 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:38.576683 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a2157e9-2a8a-481b-bc5a-f318e25e154d tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.019840 Feb 12 21:02:38.583784 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 92/188] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:02:38 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:38.590342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcc71f1b-e254-4595-8aca-1c76559e9afd tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Calling method '.version_select at 0x7fa904356820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:38.792605 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcc71f1b-e254-4595-8aca-1c76559e9afd tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564218952?user_id=acec753771364ee7ae8b5034502fb27c" status: 204 len: 0 microversion: 2.10 time: 0.210561 Feb 12 21:02:38.796750 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 93/189] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564218952?user_id=acec753771364ee7ae8b5034502fb27c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:02:38.800139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d43db724-070b-41ea-8ad8-e219db2bc985 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:38.802111 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:38.802111 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:38.813685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d43db724-070b-41ea-8ad8-e219db2bc985 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.814276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d43db724-070b-41ea-8ad8-e219db2bc985 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:38.900803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:38.928721 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5cccb826-6d85-4af9-b46c-97bf7d6e1db3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1311 microversion: 2.1 time: 0.438379 Feb 12 21:02:38.929368 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 97/190] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:38 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:38.941512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:38.942397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:38.949197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.949960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:38.950913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:38.951493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.044327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:39.053721 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6825b7ad-6e10-4c64-b150-b4ddd00ab3e1 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1278 microversion: 2.1 time: 0.122106 Feb 12 21:02:39.055174 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 98/191] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:38 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:39.061026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:39.062665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:39.070510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.071193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.072149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.072694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.133635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d43db724-070b-41ea-8ad8-e219db2bc985 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.335084 Feb 12 21:02:39.133635 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 94/192] 10.222.0.31 () {60 vars in 1190 bytes} [Sat Feb 12 21:02:38 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:39.141737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3abc4ac0-5562-48c2-ace9-1b59422248ee tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] Calling method '.version_select at 0x7fa904351040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:39.176469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:39.188950 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d52297dc-2c4f-494c-abcc-6c6440773d21 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1268 microversion: 2.1 time: 0.132164 Feb 12 21:02:39.190066 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 99/193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:39 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:39.195931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:39.196539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:39.204189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.204721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.205717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.206150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.283175 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3abc4ac0-5562-48c2-ace9-1b59422248ee tempest-KeyPairsV210TestJSON-656268795 tempest-KeyPairsV210TestJSON-656268795-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519915172?user_id=acec753771364ee7ae8b5034502fb27c" status: 204 len: 0 microversion: 2.10 time: 0.145645 Feb 12 21:02:39.284205 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 95/194] 10.222.0.31 () {60 vars in 1339 bytes} [Sat Feb 12 21:02:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519915172?user_id=acec753771364ee7ae8b5034502fb27c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:02:39.288123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dff09c05-3516-4eea-a264-daa95ddeaeea tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:39.297240 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:39.297240 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:39.419274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dff09c05-3516-4eea-a264-daa95ddeaeea tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.134409 Feb 12 21:02:39.419935 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 96/195] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:02:39 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:39.431636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9cffeeab-cd58-4d7c-b596-2cdb2384e49b tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-18427744"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:39.432923 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:39.432923 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:39.434750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-9cffeeab-cd58-4d7c-b596-2cdb2384e49b tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid 699d029a-ff1f-4b7a-9f22-c70410851cb5 for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:39.488506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:39.497680 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dce4ffdc-4ce7-482c-8bf1-b090dc4ee468 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.305991 Feb 12 21:02:39.498448 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 100/196] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:39 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:39.576115 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9cffeeab-cd58-4d7c-b596-2cdb2384e49b tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.148015 Feb 12 21:02:39.577950 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 97/197] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:39.592759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2f42ef40-186e-4c67-be41-f207cc4afd27 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:39.596562 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:39.596562 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:39.612632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2f42ef40-186e-4c67-be41-f207cc4afd27 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.613083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2f42ef40-186e-4c67-be41-f207cc4afd27 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.946349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:39.947312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:39.955752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.956332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:39.957232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:39.957864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.042486 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2f42ef40-186e-4c67-be41-f207cc4afd27 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 241 microversion: 2.1 time: 0.453491 Feb 12 21:02:40.048509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 101/198] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:39 2022] POST /compute/v2.1/os-aggregates/10/action => generated 241 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:40.059558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23587cd2-8e2a-436f-93fc-603781500fd3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:40.062689 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:40.062689 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:40.073087 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23587cd2-8e2a-436f-93fc-603781500fd3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.018509 Feb 12 21:02:40.074280 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 102/199] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:02:40 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:40.080777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:40.081634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:40.089042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.089765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.090768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.091350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.234139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:40.241737 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-504879be-a68b-4fd2-bd36-3815bc663d96 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1311 microversion: 2.1 time: 0.299613 Feb 12 21:02:40.255499 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 98/200] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:39 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:40.260525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe03067a-d047-412c-b877-164724e9fa89 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:40.265467 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:40.265467 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:40.271241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe03067a-d047-412c-b877-164724e9fa89 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.271696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe03067a-d047-412c-b877-164724e9fa89 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.565971 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe03067a-d047-412c-b877-164724e9fa89 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 226 microversion: 2.1 time: 0.308481 Feb 12 21:02:40.566671 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 99/201] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:40 2022] POST /compute/v2.1/os-aggregates/10/action => generated 226 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:40.574738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:40.575491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:40.584816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.588219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.588219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.588219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.707690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:40.709780 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5884650-233f-475d-a298-a6d9ae7cdec0 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.633780 Feb 12 21:02:40.710738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 103/202] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:40 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:40.718736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-66e30fe4-0f10-480f-967f-37d565f25cb2 req-c07c9fee-d4e7-470e-bfdb-9342f97f1c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb70780-dfdd-41df-8b16-34776dae9ee5", "name": "network-vif-plugged", "status": "completed", "tag": "7fe731ff-5471-4420-a35a-07898901b4d0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:40.720264 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:40.720264 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:40.727936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-66e30fe4-0f10-480f-967f-37d565f25cb2 req-c07c9fee-d4e7-470e-bfdb-9342f97f1c73 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.729026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-66e30fe4-0f10-480f-967f-37d565f25cb2 req-c07c9fee-d4e7-470e-bfdb-9342f97f1c73 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.751267 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-66e30fe4-0f10-480f-967f-37d565f25cb2 req-c07c9fee-d4e7-470e-bfdb-9342f97f1c73 service nova] Creating event network-vif-plugged:7fe731ff-5471-4420-a35a-07898901b4d0 for instance cdb70780-dfdd-41df-8b16-34776dae9ee5 on nch1-master-1 Feb 12 21:02:40.760028 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-66e30fe4-0f10-480f-967f-37d565f25cb2 req-c07c9fee-d4e7-470e-bfdb-9342f97f1c73 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047193 Feb 12 21:02:40.761062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 104/203] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:40.768843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:40.769754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:40.783149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.783853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.784662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:40.785171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:40.944425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:40.966912 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00a0d4cd-0d8b-4b29-95c6-48601d2089fe tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.397961 Feb 12 21:02:40.971814 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 100/204] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:40 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:40.976642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-065789ec-84e3-4623-a711-eebfadec4223 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:40.977604 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:40.977604 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:41.089532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:41.106978 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-18069f94-46eb-4186-94e9-3eeb590b649c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.343897 Feb 12 21:02:41.118612 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-065789ec-84e3-4623-a711-eebfadec4223 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.145332 Feb 12 21:02:41.120390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 101/205] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:40 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:41.123467 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 105/206] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:40 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:41.131156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-01b84904-b190-4243-9d55-b0b867231920 req-6a4e235a-4437-4706-a634-5d784ab7e5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065ab662-e01a-43c9-8858-ffc7dfd4f3f3", "tag": "a62ee376-bb72-4c87-b427-676dc3e67cfd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:41.137813 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:41.137813 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:41.141488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-73623ff1-21ba-40cb-87b9-3c61f2d14a06 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-888149512"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:41.144415 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:41.144415 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:41.147582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-73623ff1-21ba-40cb-87b9-3c61f2d14a06 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid 894253c1-b577-4fc6-a8a4-4ea4eee86fa0 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:41.160105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-01b84904-b190-4243-9d55-b0b867231920 req-6a4e235a-4437-4706-a634-5d784ab7e5a3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.160547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-01b84904-b190-4243-9d55-b0b867231920 req-6a4e235a-4437-4706-a634-5d784ab7e5a3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.176749 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-01b84904-b190-4243-9d55-b0b867231920 req-6a4e235a-4437-4706-a634-5d784ab7e5a3 service nova] Creating event network-changed:a62ee376-bb72-4c87-b427-676dc3e67cfd for instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 on nch2-master-1 Feb 12 21:02:41.194619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-01b84904-b190-4243-9d55-b0b867231920 req-6a4e235a-4437-4706-a634-5d784ab7e5a3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066494 Feb 12 21:02:41.195624 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 102/207] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:41.250190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-73623ff1-21ba-40cb-87b9-3c61f2d14a06 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.122446 Feb 12 21:02:41.254920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 106/208] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:41.265713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-adbae178-9a4b-4f5d-9cd9-7b628815b6db tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:41.265713 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:41.265713 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:41.275553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adbae178-9a4b-4f5d-9cd9-7b628815b6db tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.276325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adbae178-9a4b-4f5d-9cd9-7b628815b6db tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.277019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:41.278690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:41.298565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.300979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.303019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.306712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.594671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:41.601585 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-adbae178-9a4b-4f5d-9cd9-7b628815b6db tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.343667 Feb 12 21:02:41.602571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 107/209] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:41 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:41.603172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ec1d4dd-8c3b-4470-bad7-4b384833ee02 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1311 microversion: 2.1 time: 0.347277 Feb 12 21:02:41.613607 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 103/210] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:41 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:41.613796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2a9a41b9-6c9a-42ec-8885-2e58000a6c43 req-900a4195-78a9-442f-bf9e-c6bc0445bac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e82f99-dc16-48b4-987d-d57b003637ff", "tag": "27c22334-4595-4060-b8ea-dcc1f99639f0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:41.613796 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:41.613796 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:41.619282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2a9a41b9-6c9a-42ec-8885-2e58000a6c43 req-900a4195-78a9-442f-bf9e-c6bc0445bac2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.620005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2a9a41b9-6c9a-42ec-8885-2e58000a6c43 req-900a4195-78a9-442f-bf9e-c6bc0445bac2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.623090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ca79100-cef8-42eb-b298-c567b4e4319f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:41.625140 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:41.625140 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:41.632901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2a9a41b9-6c9a-42ec-8885-2e58000a6c43 req-900a4195-78a9-442f-bf9e-c6bc0445bac2 service nova] Creating event network-changed:27c22334-4595-4060-b8ea-dcc1f99639f0 for instance 77e82f99-dc16-48b4-987d-d57b003637ff on nch2-master-1 Feb 12 21:02:41.633591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ca79100-cef8-42eb-b298-c567b4e4319f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.634115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ca79100-cef8-42eb-b298-c567b4e4319f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.638453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2a9a41b9-6c9a-42ec-8885-2e58000a6c43 req-900a4195-78a9-442f-bf9e-c6bc0445bac2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034714 Feb 12 21:02:41.639053 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 108/211] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:41.729211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:41.730870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:41.741590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.742620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:41.743531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:41.755519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.000009 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ca79100-cef8-42eb-b298-c567b4e4319f tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.381728 Feb 12 21:02:42.000857 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 104/212] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:41 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:42.007109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:42.007734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:42.016950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:42.017633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.019350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:42.019350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.087376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:42.101833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c9abd62-b08e-4a7e-abec-3cf91dceb3fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.374461 Feb 12 21:02:42.103719 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 109/213] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:41 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:42.115754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25c7b3f4-7a07-450c-89dc-8f868f287eef tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:42.116612 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:42.116612 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:42.247561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25c7b3f4-7a07-450c-89dc-8f868f287eef tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.141464 Feb 12 21:02:42.253491 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 110/214] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:42 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:42.259868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:42.261313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:42.274568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:42.276373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.278103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:42.279394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.513690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:42.522336 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8850711b-fc06-4123-bf10-5ad094d30b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.520323 Feb 12 21:02:42.522931 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 105/215] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:42 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:42.527317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0a49e615-2a4b-4d1a-9d59-1b865e9464c3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-454893891"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:42.528648 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:42.528648 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:42.529859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-0a49e615-2a4b-4d1a-9d59-1b865e9464c3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid bce223ef-3e40-4997-b630-24bb9650046d for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:42.559112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:42.567215 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-01694afd-8a25-4e27-bd57-fff5252b9177 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.315622 Feb 12 21:02:42.568318 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 111/216] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:42 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:42.573270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-000f5b82-10ef-4e94-92d0-483cc599fd37 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-703481140"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:42.574620 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:42.574620 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:42.575834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-000f5b82-10ef-4e94-92d0-483cc599fd37 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid 9c4bf49b-29d4-4b31-8095-af4013d42e2f for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:42.662961 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0a49e615-2a4b-4d1a-9d59-1b865e9464c3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.138987 Feb 12 21:02:42.664041 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 106/217] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:42.709781 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-000f5b82-10ef-4e94-92d0-483cc599fd37 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.140324 Feb 12 21:02:42.710977 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 112/218] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:42.719337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:42.719948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:42.726699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:42.727150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.727934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:42.728365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:42.898032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-605127719", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:42.949560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:02:43.172646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:02:43.173107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:02:43.173620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:02:43.174299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:02:43.174959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:02:43.183981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.184973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.185881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.186953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.208377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Getting quotas for project bd0dea72a7f541e98ad63b8b8037fa42. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:02:43.212466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Getting quotas for user 10ccab50ed624d5b92320ad53b9f6d45 and project bd0dea72a7f541e98ad63b8b8037fa42. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:02:43.225272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:02:43.228767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:02:43.232326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:43.239965 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c163eaa1-daa3-4a87-a167-0455c6d526bc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1460 microversion: 2.1 time: 0.527083 Feb 12 21:02:43.240816 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 113/219] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:42 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1460 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:43.245760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0772c4c2-cb99-4c76-b2ca-c0ef0b69c4b3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.251654 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:43.251654 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:43.322510 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0772c4c2-cb99-4c76-b2ca-c0ef0b69c4b3 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.080415 Feb 12 21:02:43.323336 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 114/220] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:43 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:43.331924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5b97884-69fe-41c1-9860-de779385844c tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:43.333213 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:43.333213 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:43.342040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5b97884-69fe-41c1-9860-de779385844c tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.342894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5b97884-69fe-41c1-9860-de779385844c tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.392766 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca234224-ddc5-4df9-8005-0a9d872971e7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727606 Feb 12 21:02:43.393437 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 107/221] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:02:43.398150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7eed470f-0644-449a-b5c8-dffbcd6f1a19 req-29f08a70-1893-4955-9140-7c2364b407a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69d5d6c-82ee-44e8-930e-270484371efe", "name": "network-vif-plugged", "status": "completed", "tag": "066233ec-c2e8-467f-a414-c7bb91607730"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:43.400124 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:43.400124 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:43.409104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7eed470f-0644-449a-b5c8-dffbcd6f1a19 req-29f08a70-1893-4955-9140-7c2364b407a0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.409788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7eed470f-0644-449a-b5c8-dffbcd6f1a19 req-29f08a70-1893-4955-9140-7c2364b407a0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.423038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7eed470f-0644-449a-b5c8-dffbcd6f1a19 req-29f08a70-1893-4955-9140-7c2364b407a0 service nova] Creating event network-vif-plugged:066233ec-c2e8-467f-a414-c7bb91607730 for instance a69d5d6c-82ee-44e8-930e-270484371efe on nch1-master-1 Feb 12 21:02:43.430176 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7eed470f-0644-449a-b5c8-dffbcd6f1a19 req-29f08a70-1893-4955-9140-7c2364b407a0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033948 Feb 12 21:02:43.430176 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 108/222] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:43.434809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.435578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:43.443536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.444317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.445743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.446788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.630284 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5b97884-69fe-41c1-9860-de779385844c tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.303139 Feb 12 21:02:43.636576 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 115/223] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:43 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:43.683928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:43.692369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9186f83-8c92-4f17-a452-3ca8c008ee0b tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.261617 Feb 12 21:02:43.692971 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 109/224] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:43 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:43.706301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a170e78-20c3-411e-a822-c7efd0ac9479 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.707234 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:43.707234 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:43.713650 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-4a170e78-20c3-411e-a822-c7efd0ac9479 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Feb 12 21:02:43.714231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a170e78-20c3-411e-a822-c7efd0ac9479 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:43.715315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a170e78-20c3-411e-a822-c7efd0ac9479 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.021434 Feb 12 21:02:43.716008 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 110/225] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:02:43 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:02:43.720817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be187d19-1f89-4056-8108-a8a0a783cd16 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.721457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be187d19-1f89-4056-8108-a8a0a783cd16 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:43.776011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-be187d19-1f89-4056-8108-a8a0a783cd16 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:43.783755 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be187d19-1f89-4056-8108-a8a0a783cd16 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1215 microversion: 2.1 time: 0.066541 Feb 12 21:02:43.784321 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 111/226] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:43 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:43.789042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.789674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:43.796280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.796803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.797609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.798040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.843217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.844078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:43.851005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.851733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.852717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.853513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.946503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:43.954357 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58efd8a6-981a-4ff1-a132-4507377e9e65 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.168989 Feb 12 21:02:43.954925 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 112/227] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:43 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:43.959587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:43.960349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:43.966158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.966600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:43.968227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:43.968781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:44.116479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:44.125764 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-864602bf-64e0-4b04-8216-5ab93fa992d3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1390 microversion: 2.1 time: 0.169714 Feb 12 21:02:44.126321 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 113/228] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:43 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:44.130842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a12c9b0e-d980-4063-9a32-d647f275db35 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:44.132186 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.132186 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.133131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a12c9b0e-d980-4063-9a32-d647f275db35 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '4ef3498f3ace445fab7a613c2fd9639b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9719b96b4dfa4568b468c3a3a247fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:44.133801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a12c9b0e-d980-4063-9a32-d647f275db35 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:44.134571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a12c9b0e-d980-4063-9a32-d647f275db35 tempest-AggregatesAdminNegativeTestJSON-229799259 tempest-AggregatesAdminNegativeTestJSON-229799259-project] 10.222.0.31 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.007352 Feb 12 21:02:44.135071 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 114/229] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:44.139163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cddca945-036a-42e9-9c8f-3322d61ec684 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:44.140555 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.140555 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.152051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-cddca945-036a-42e9-9c8f-3322d61ec684 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Feb 12 21:02:44.152644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cddca945-036a-42e9-9c8f-3322d61ec684 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:44.153474 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cddca945-036a-42e9-9c8f-3322d61ec684 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.017550 Feb 12 21:02:44.154120 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 115/230] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:02:44.158803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38954e51-a55c-469e-945d-ad44cf688e38 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:44.169070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38954e51-a55c-469e-945d-ad44cf688e38 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:44.169565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38954e51-a55c-469e-945d-ad44cf688e38 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:44.215797 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa2c2838-41b4-4fd3-8cb3-d2b48a75b50c tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1611 microversion: 2.1 time: 0.576972 Feb 12 21:02:44.218029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 116/231] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:43 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1611 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:44.231184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f34b5997-a799-4f56-8f97-be8463767780 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1161477010", "name": "tempest-test_aggregate-865186038"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:44.232839 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.232839 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:44.234831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-f34b5997-a799-4f56-8f97-be8463767780 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid f6bb0ff2-7a53-4196-9512-6f51421303c8 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:44.339125 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f34b5997-a799-4f56-8f97-be8463767780 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.117534 Feb 12 21:02:44.339125 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 117/232] 10.222.0.31 () {60 vars in 1164 bytes} [Sat Feb 12 21:02:44 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:44.348064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:44.348738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:44.355379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:44.361843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:44.361843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:44.361843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:44.414733 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38954e51-a55c-469e-945d-ad44cf688e38 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.259387 Feb 12 21:02:44.419881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 116/233] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:44.419881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b3b39fe-eb90-401b-8e91-e6b4726c9166 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:44.423174 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.423174 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.451706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '20d7d6a104844b608d73b5e714bf63a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f4266b43c44dd9c60ed238e9fe0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:44.452524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] flavor_id is None. Assuming migration. {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4093}} Feb 12 21:02:44.454151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:02:44.540031 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b3b39fe-eb90-401b-8e91-e6b4726c9166 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.123621 Feb 12 21:02:44.540725 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 117/234] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:44 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:44.545267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8ba035b0-01f9-4ef7-8fff-64529171a8ad tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:44.546716 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.546716 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.656877 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8ba035b0-01f9-4ef7-8fff-64529171a8ad tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.115061 Feb 12 21:02:44.657846 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 118/235] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:44 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:44.663701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2ec1aa9-4781-47a3-8f75-06ad0c7b244e tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:44.664678 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.664678 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.672772 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a2ec1aa9-4781-47a3-8f75-06ad0c7b244e tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Feb 12 21:02:44.673642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2ec1aa9-4781-47a3-8f75-06ad0c7b244e tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:44.674529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a2ec1aa9-4781-47a3-8f75-06ad0c7b244e tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.015613 Feb 12 21:02:44.675334 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 119/236] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:02:44 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:02:44.685818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ad9ddc9-f8cd-4b7a-a7dd-605c66ac0b6d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1319585128"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:44.685818 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.685818 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.685818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-7ad9ddc9-f8cd-4b7a-a7dd-605c66ac0b6d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Generated uuid ad1281f8-f0ee-4e7a-b33f-e915ebb2c5b3 for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:44.834446 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ad9ddc9-f8cd-4b7a-a7dd-605c66ac0b6d tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.157832 Feb 12 21:02:44.835516 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 120/237] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:44.840890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a4005a0b-d3a6-4532-9ac9-4de0fdb2e626 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:44.841933 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:44.841933 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:44.852847 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a4005a0b-d3a6-4532-9ac9-4de0fdb2e626 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Feb 12 21:02:44.853624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a4005a0b-d3a6-4532-9ac9-4de0fdb2e626 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:44.854451 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a4005a0b-d3a6-4532-9ac9-4de0fdb2e626 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.017894 Feb 12 21:02:44.855144 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 121/238] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:44 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:02:44.863337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:44.864151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:44.871243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:44.871755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:44.872730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:44.873329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.031043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:45.038463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-efbb3df9-fabe-49a5-8699-92c5da75228c tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.182144 Feb 12 21:02:45.039023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 122/239] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:44 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:45.047745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.048456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:45.056734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.057289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.058174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.058685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.114787 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d22300d-7e5d-445c-b19e-bf853d5fda6d tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5/action" status: 202 len: 0 microversion: 2.1 time: 0.770652 Feb 12 21:02:45.115964 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 118/240] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:02:44 2022] POST /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:02:45.122254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:45.126177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:45.131851 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.131851 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:45.133142 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e46e8f0a-55a7-4c6a-aa91-d57260576d8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1219 microversion: 2.1 time: 0.091491 Feb 12 21:02:45.135158 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 123/241] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:45.137978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.138426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.141624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d1572acb-2a6d-47d2-9ad9-83615fa5ec39 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1684642789"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:45.143744 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.143744 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.145126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.145472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-d1572acb-2a6d-47d2-9ad9-83615fa5ec39 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid 61e055c2-74fa-4ed1-a963-ed2b40b9f9e6 for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:45.145600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.185663 ncdv-master-1 devstack@n-api.service[141726]: ERROR nova.api.openstack.compute.aggregates [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Feb 12 21:02:45.189123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Feb 12 21:02:45.189123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:45.189123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51bf9e8f-0e77-4580-ba9d-32bcb13da555 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.070624 Feb 12 21:02:45.189123 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 119/242] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:45 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:02:45.192852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.193763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:45.200368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.200857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.201662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.202944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.280743 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d1572acb-2a6d-47d2-9ad9-83615fa5ec39 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.142651 Feb 12 21:02:45.282629 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 124/243] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:45.287600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.288348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:45.297669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.298175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.298982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.299680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.435994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:45.445616 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51730de5-eca7-4461-8ed1-3da14a1b9f85 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.256032 Feb 12 21:02:45.446602 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 120/244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:45.451918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.452778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:45.459296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.461745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.461745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.461745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.488972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:45.496978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ac74cb2-8f31-4472-a7aa-192fbd8c440c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1469 microversion: 2.1 time: 0.213089 Feb 12 21:02:45.497798 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 125/245] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:45.502292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f58ad525-3767-4a70-9279-f4100b28a081 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.502863 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.502863 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.608874 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f58ad525-3767-4a70-9279-f4100b28a081 tempest-AggregatesAdminNegativeTestJSON-1970570438 tempest-AggregatesAdminNegativeTestJSON-1970570438-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.110187 Feb 12 21:02:45.614682 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 126/246] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:45.620731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce90cb56-88a9-49bc-a857-97238bf96e26 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.621745 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.621745 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.632333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce90cb56-88a9-49bc-a857-97238bf96e26 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.015900 Feb 12 21:02:45.633151 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 127/247] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:45.646259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:45.658547 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c82c438-8ca1-4719-b4d4-583ac270e879 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1589 microversion: 2.1 time: 0.210304 Feb 12 21:02:45.666204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 121/248] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1589 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:45.677671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82709b74-86e9-459c-8d29-62f1f778db43 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:45.679068 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.679068 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:45.789838 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82709b74-86e9-459c-8d29-62f1f778db43 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.122152 Feb 12 21:02:45.796969 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 122/249] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:02:45 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:45.800623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.801183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:45.809278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.810027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.810880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.814387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Action: 'update', calling method: .version_select at 0x7fa904351f70>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:45.815910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.816559 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.816559 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.820835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.820835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.829146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.829633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.838282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] HTTP exception thrown: Service 6320ca77-7d40-4d84-9b90-a6e24e628385 could not be found. Feb 12 21:02:45.838893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Returning 404 to user: Service 6320ca77-7d40-4d84-9b90-a6e24e628385 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:45.839722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-449366be-4b76-4131-9d47-323499c8ef0d tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-services/6320ca77-7d40-4d84-9b90-a6e24e628385" status: 404 len: 110 microversion: 2.53 time: 0.205328 Feb 12 21:02:45.840296 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 128/250] 10.222.0.31 () {62 vars in 1308 bytes} [Sat Feb 12 21:02:45 2022] PUT /compute/v2.1/os-services/6320ca77-7d40-4d84-9b90-a6e24e628385 => generated 110 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:02:45.850522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac5910f2-fecc-409f-8b59-29a1f89064f4 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.851812 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.851812 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.861262 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac5910f2-fecc-409f-8b59-29a1f89064f4 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.019760 Feb 12 21:02:45.862641 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 129/251] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:45.867895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Action: 'update', calling method: .version_select at 0x7fa904351ca0>, body: {"status": "disabled"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:45.869621 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.869621 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.871800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.872439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.879304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.880069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.885063 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] HTTP exception thrown: Service 6320ca77-7d40-4d84-9b90-a6e24e628385 could not be found. Feb 12 21:02:45.885854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Returning 404 to user: Service 6320ca77-7d40-4d84-9b90-a6e24e628385 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:45.887805 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5c3dcab-48dc-4fe7-a8e8-c8994608d928 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-services/6320ca77-7d40-4d84-9b90-a6e24e628385" status: 404 len: 110 microversion: 2.53 time: 0.023117 Feb 12 21:02:45.887805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 130/252] 10.222.0.31 () {62 vars in 1308 bytes} [Sat Feb 12 21:02:45 2022] PUT /compute/v2.1/os-services/6320ca77-7d40-4d84-9b90-a6e24e628385 => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:02:45.894000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-54e34b8f-3e3c-4b7b-a495-cf45a8c4b5c8 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.894769 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.894769 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:45.926695 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00b2d541-7b68-42e0-a917-fe4d521ea4ae tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131522 Feb 12 21:02:45.927345 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 123/253] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:45.932367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Action: 'update', calling method: .version_select at 0x7fa904075af0>, body: {"status": "enabled"} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:45.933949 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.933949 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:45.935429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.935887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.945202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.945400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.953820 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] HTTP exception thrown: Service 6320ca77-7d40-4d84-9b90-a6e24e628385 could not be found. Feb 12 21:02:45.962955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Returning 404 to user: Service 6320ca77-7d40-4d84-9b90-a6e24e628385 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:45.962955 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef2b2f83-b266-4ac0-85af-d91aea11ac72 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-services/6320ca77-7d40-4d84-9b90-a6e24e628385" status: 404 len: 110 microversion: 2.53 time: 0.027039 Feb 12 21:02:45.962955 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 124/254] 10.222.0.31 () {62 vars in 1308 bytes} [Sat Feb 12 21:02:45 2022] PUT /compute/v2.1/os-services/6320ca77-7d40-4d84-9b90-a6e24e628385 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:02:45.969596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa7644d5-9553-4833-b0e7-884e81ac6292 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:45.970936 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:45.970936 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:45.972587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa7644d5-9553-4833-b0e7-884e81ac6292 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.972899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa7644d5-9553-4833-b0e7-884e81ac6292 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:45.973928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa7644d5-9553-4833-b0e7-884e81ac6292 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:45.974355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa7644d5-9553-4833-b0e7-884e81ac6292 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.001072 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa7644d5-9553-4833-b0e7-884e81ac6292 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.035890 Feb 12 21:02:46.002098 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 125/255] 10.222.0.31 () {60 vars in 1177 bytes} [Sat Feb 12 21:02:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:02:46.013738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab241c1c-1d1a-4b49-8004-e66c03a00941 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:46.016105 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:46.016105 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:46.017910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab241c1c-1d1a-4b49-8004-e66c03a00941 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.018356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab241c1c-1d1a-4b49-8004-e66c03a00941 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.019170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab241c1c-1d1a-4b49-8004-e66c03a00941 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.019600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab241c1c-1d1a-4b49-8004-e66c03a00941 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.038027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-54e34b8f-3e3c-4b7b-a495-cf45a8c4b5c8 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.149729 Feb 12 21:02:46.043082 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 131/256] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:45 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:46.051305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-810132d6-af97-4f36-8c20-4c564e86705a tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-840011769", "availability_zone": "tempest-test_az-1705586149"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:46.070276 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab241c1c-1d1a-4b49-8004-e66c03a00941 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.061040 Feb 12 21:02:46.075454 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:46.075454 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:46.079346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-810132d6-af97-4f36-8c20-4c564e86705a tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid 60769682-530f-4039-b205-54a1b2344cee for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:46.079835 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 126/257] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:02:46.085284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:46.086292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:46.095932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.096804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.098476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.099153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.282315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-810132d6-af97-4f36-8c20-4c564e86705a tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.237213 Feb 12 21:02:46.283778 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 132/258] 10.222.0.31 () {60 vars in 1164 bytes} [Sat Feb 12 21:02:46 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:46.290806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63fac9d0-b0fb-4489-b1bf-8d646d0e123f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:46.293130 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:46.293130 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:46.295041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63fac9d0-b0fb-4489-b1bf-8d646d0e123f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.295908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63fac9d0-b0fb-4489-b1bf-8d646d0e123f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.298147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63fac9d0-b0fb-4489-b1bf-8d646d0e123f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.298813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63fac9d0-b0fb-4489-b1bf-8d646d0e123f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.367463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63fac9d0-b0fb-4489-b1bf-8d646d0e123f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.080236 Feb 12 21:02:46.372037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 133/259] 10.222.0.31 () {60 vars in 1177 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:46.386821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:46.387838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:46.404972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.408068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.418790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.418790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.499214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:46.516779 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eee86dd5-e799-42c3-a200-e1798fb802e2 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1275 microversion: 2.1 time: 0.143201 Feb 12 21:02:46.526374 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 134/260] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:46.530221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bec80973-6c58-4784-a731-44883cbd0068 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-840011769_new", "availability_zone": "tempest-test_az-1705586149_new"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:46.606246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:46.621676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b86c2a80-205d-4516-9842-a85c7cdbd212 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.540391 Feb 12 21:02:46.622618 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 127/261] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:46.628185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e42a0957-f991-41d4-afcc-cf175388d00f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:46.632402 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:46.632402 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:46.635463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42a0957-f991-41d4-afcc-cf175388d00f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.638035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42a0957-f991-41d4-afcc-cf175388d00f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.641243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42a0957-f991-41d4-afcc-cf175388d00f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.643251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42a0957-f991-41d4-afcc-cf175388d00f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.654371 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:46.654371 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:46.716197 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e42a0957-f991-41d4-afcc-cf175388d00f tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.092220 Feb 12 21:02:46.716828 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 128/262] 10.222.0.31 () {60 vars in 1236 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:46.725267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:46.725920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:46.746017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.747308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.748487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.749488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.783561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec80973-6c58-4784-a731-44883cbd0068 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:46.785760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec80973-6c58-4784-a731-44883cbd0068 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:46.991468 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bec80973-6c58-4784-a731-44883cbd0068 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.466296 Feb 12 21:02:46.992947 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 135/263] 10.222.0.31 () {60 vars in 1172 bytes} [Sat Feb 12 21:02:46 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:47.001557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.002380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:47.010750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.011221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.012033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.012477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.157924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:47.166206 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2a40913-e722-4e5f-98f1-1a3c720a6c27 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.447676 Feb 12 21:02:47.166788 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 129/264] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:47.173528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82a8522b-e03f-48ee-a7e7-cf8178c7f4d7 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.174906 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.174906 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:47.176496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a8522b-e03f-48ee-a7e7-cf8178c7f4d7 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.176950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a8522b-e03f-48ee-a7e7-cf8178c7f4d7 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.177926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a8522b-e03f-48ee-a7e7-cf8178c7f4d7 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.178388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a8522b-e03f-48ee-a7e7-cf8178c7f4d7 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.203491 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82a8522b-e03f-48ee-a7e7-cf8178c7f4d7 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.034955 Feb 12 21:02:47.204113 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 130/265] 10.222.0.31 () {60 vars in 1177 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:47.211687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f50f6fa8-d3cf-4ab9-81ec-c2a47c223a03 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.212033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:47.212505 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.212505 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:47.220113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c8d9d07-d61b-475c-890c-6e1494306b14 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1469 microversion: 2.1 time: 0.225745 Feb 12 21:02:47.220808 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 136/266] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:46 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:47.225861 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f50f6fa8-d3cf-4ab9-81ec-c2a47c223a03 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.020471 Feb 12 21:02:47.226216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e151c9e6-c112-4fb9-9c25-d90008ac27d8 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.227021 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 131/267] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:47.228209 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.228209 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:47.229985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e151c9e6-c112-4fb9-9c25-d90008ac27d8 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.230433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e151c9e6-c112-4fb9-9c25-d90008ac27d8 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.231317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e151c9e6-c112-4fb9-9c25-d90008ac27d8 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.231758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e151c9e6-c112-4fb9-9c25-d90008ac27d8 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.237004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6c7d47c-98c6-44e7-8de1-e47c384539b2 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.238455 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.238455 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:47.258503 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e151c9e6-c112-4fb9-9c25-d90008ac27d8 tempest-ServicesAdminNegativeV253TestJSON-720619442 tempest-ServicesAdminNegativeV253TestJSON-720619442-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036412 Feb 12 21:02:47.259503 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 137/268] 10.222.0.31 () {60 vars in 1238 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:47.362801 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6c7d47c-98c6-44e7-8de1-e47c384539b2 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.128687 Feb 12 21:02:47.364131 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 132/269] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:47 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:47.375456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90f180e8-4e87-4258-914d-e99a47a9bc49 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1691311047"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:47.377429 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.377429 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:47.378992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.aggregate [None req-90f180e8-4e87-4258-914d-e99a47a9bc49 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Generated uuid 79ce278a-4e1a-4723-b830-0b0ea439ef08 for aggregate {{(pid=141726) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:02:47.474828 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90f180e8-4e87-4258-914d-e99a47a9bc49 tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.104259 Feb 12 21:02:47.476029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 133/270] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:02:47 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:47.487210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ed9e134-760f-4de8-8ef4-36d84deab9be tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.488464 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.488464 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:47.504930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ed9e134-760f-4de8-8ef4-36d84deab9be tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.022100 Feb 12 21:02:47.508389 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 134/271] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:47.519352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-223ddefd-568d-4dbf-a565-e30725c657ba tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.523974 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.523974 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:47.528821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4034c09e-bbbe-4024-bb5d-d9a1f9b08734 tempest-ServicesAdminNegativeV253TestJSON-390314346 tempest-ServicesAdminNegativeV253TestJSON-390314346-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.530328 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.530328 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:47.534381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4034c09e-bbbe-4024-bb5d-d9a1f9b08734 tempest-ServicesAdminNegativeV253TestJSON-390314346 tempest-ServicesAdminNegativeV253TestJSON-390314346-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '697d72f8b7e841ad91c11755da9d87ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bab6bba6d2447fcadffdee4fd1c5292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:47.535088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4034c09e-bbbe-4024-bb5d-d9a1f9b08734 tempest-ServicesAdminNegativeV253TestJSON-390314346 tempest-ServicesAdminNegativeV253TestJSON-390314346-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:47.538167 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4034c09e-bbbe-4024-bb5d-d9a1f9b08734 tempest-ServicesAdminNegativeV253TestJSON-390314346 tempest-ServicesAdminNegativeV253TestJSON-390314346-project] 10.222.0.31 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.267521 Feb 12 21:02:47.538762 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 138/272] 10.222.0.31 () {60 vars in 1177 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/os-services => generated 112 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:02:47.559574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.560636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:47.570401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.571240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.572617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.573068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.636680 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-223ddefd-568d-4dbf-a565-e30725c657ba tempest-AggregatesAdminTestJSON-657403568 tempest-AggregatesAdminTestJSON-657403568-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.121060 Feb 12 21:02:47.638512 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 135/273] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:02:47 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:02:47.650623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.651462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:47.659474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.663914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.665166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.676412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.679197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:47.689048 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d351a2d-0174-40cb-b72d-da964e7f9e81 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1273 microversion: 2.1 time: 0.143848 Feb 12 21:02:47.689903 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 139/274] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:47.711110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.711950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:47.721991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.722629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.723670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.724435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.754032 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] HTTP exception thrown: Instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a could not be found. Feb 12 21:02:47.755231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Returning 404 to user: Instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:47.756194 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-26c77fe0-d889-491b-b975-29417b9ceb16 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "DELETE /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 404 len: 111 microversion: 2.1 time: 0.065495 Feb 12 21:02:47.756942 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 140/275] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:02:47 2022] DELETE /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:47.767600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f54782e4-775b-4411-ae6e-7ad7f7628d74 req-7604eeb4-81b5-417e-b0dc-7525fe05bfa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e82f99-dc16-48b4-987d-d57b003637ff", "name": "network-vif-plugged", "status": "completed", "tag": "27c22334-4595-4060-b8ea-dcc1f99639f0"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:47.769155 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:47.769155 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:47.780638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f54782e4-775b-4411-ae6e-7ad7f7628d74 req-7604eeb4-81b5-417e-b0dc-7525fe05bfa6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.780638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f54782e4-775b-4411-ae6e-7ad7f7628d74 req-7604eeb4-81b5-417e-b0dc-7525fe05bfa6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.795494 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f54782e4-775b-4411-ae6e-7ad7f7628d74 req-7604eeb4-81b5-417e-b0dc-7525fe05bfa6 service nova] Creating event network-vif-plugged:27c22334-4595-4060-b8ea-dcc1f99639f0 for instance 77e82f99-dc16-48b4-987d-d57b003637ff on nch2-master-1 Feb 12 21:02:47.801803 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f54782e4-775b-4411-ae6e-7ad7f7628d74 req-7604eeb4-81b5-417e-b0dc-7525fe05bfa6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040754 Feb 12 21:02:47.802577 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 141/276] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:47.809071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:47.809952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] [instance: be69994b-e4e2-4bc4-97c3-8d94d29fe78a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:47.819365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.819873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.820686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:47.821121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:47.838569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] HTTP exception thrown: Instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a could not be found. Feb 12 21:02:47.839202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] Returning 404 to user: Instance be69994b-e4e2-4bc4-97c3-8d94d29fe78a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:47.840040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a08a3928-423f-4b29-b90a-8ccf936e5a49 tempest-AggregatesAdminTestJSON-152238671 tempest-AggregatesAdminTestJSON-152238671-project] 10.222.0.31 "GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a" status: 404 len: 111 microversion: 2.1 time: 0.036521 Feb 12 21:02:47.840599 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 142/277] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/servers/be69994b-e4e2-4bc4-97c3-8d94d29fe78a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:48.185313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:48.188066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:48.196207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.201830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.202838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.203322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.211552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:48.219659 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-350a076b-1d7b-4c23-b8ac-21bef889847d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.579839 Feb 12 21:02:48.223003 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 136/278] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:47 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:48.239256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:48.240056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:48.253914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.254794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.255863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.260388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.432704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:48.442375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fd8a502c-e641-40f3-a63a-b6f5919d6fd9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.262123 Feb 12 21:02:48.443228 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 143/279] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:48 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:48.677150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:48.688891 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cac69129-c4a8-4d3b-8bce-a6b9a5e9e437 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1469 microversion: 2.1 time: 0.454136 Feb 12 21:02:48.689951 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 137/280] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:48 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:48.707624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:48.708837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:48.716193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.716698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.717635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.718070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.767749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:48.768469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:48.775022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.775558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.776680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.777130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.812707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:48.822397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6071f29e-8ce7-4a75-958f-a056f0756a10 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1273 microversion: 2.1 time: 0.118724 Feb 12 21:02:48.826695 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 144/281] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:48 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:48.834678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f7904ade-7cb3-4aaf-af01-05b81add6311 req-aa0c1bc1-4a57-4da2-a48a-e9a54bc27fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a69d5d6c-82ee-44e8-930e-270484371efe", "tag": "066233ec-c2e8-467f-a414-c7bb91607730"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:48.836254 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:48.836254 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:48.851438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f7904ade-7cb3-4aaf-af01-05b81add6311 req-aa0c1bc1-4a57-4da2-a48a-e9a54bc27fe2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:48.851880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f7904ade-7cb3-4aaf-af01-05b81add6311 req-aa0c1bc1-4a57-4da2-a48a-e9a54bc27fe2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:48.889112 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f7904ade-7cb3-4aaf-af01-05b81add6311 req-aa0c1bc1-4a57-4da2-a48a-e9a54bc27fe2 service nova] Creating event network-changed:066233ec-c2e8-467f-a414-c7bb91607730 for instance a69d5d6c-82ee-44e8-930e-270484371efe on nch1-master-1 Feb 12 21:02:48.903868 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f7904ade-7cb3-4aaf-af01-05b81add6311 req-aa0c1bc1-4a57-4da2-a48a-e9a54bc27fe2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074561 Feb 12 21:02:48.906859 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 145/282] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:49.239608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:49.240651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:49.259751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:49.260484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:49.261710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:49.262438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:49.400733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:49.415314 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d5eff25-bfa0-4e07-a8da-09490f1e6945 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 200 len: 1589 microversion: 2.1 time: 0.652589 Feb 12 21:02:49.416835 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 138/283] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:48 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 1589 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:49.461219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:49.462194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:49.470486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:49.471365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:49.472363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:49.472989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:49.735439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:49.749604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aaa586e0-0146-43ce-8601-251b4e3fe9da tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.513970 Feb 12 21:02:49.766848 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 146/284] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:49 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:49.770225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:49.771048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:49.786545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:49.787652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:49.794008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:49.794527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:50.107196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:50.118250 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-492007b7-ba06-4595-b788-7239a8127526 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1469 microversion: 2.1 time: 0.359464 Feb 12 21:02:50.120873 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 147/285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:49 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:50.132044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:50.133449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ef607034-94fc-43a5-8c6e-3c3e0568459e req-a65b43b8-6316-4c87-ac58-4c109737bafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065ab662-e01a-43c9-8858-ffc7dfd4f3f3", "name": "network-vif-plugged", "status": "completed", "tag": "a62ee376-bb72-4c87-b427-676dc3e67cfd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:50.135231 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:50.135231 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:50.146155 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aff5d612-64c7-4a22-b235-bd0d0c5ea41d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1310 microversion: 2.1 time: 0.688475 Feb 12 21:02:50.149013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ef607034-94fc-43a5-8c6e-3c3e0568459e req-a65b43b8-6316-4c87-ac58-4c109737bafe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:50.149418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 139/286] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:49 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1310 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:50.153347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ef607034-94fc-43a5-8c6e-3c3e0568459e req-a65b43b8-6316-4c87-ac58-4c109737bafe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:50.159082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:50.162617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:50.180888 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ef607034-94fc-43a5-8c6e-3c3e0568459e req-a65b43b8-6316-4c87-ac58-4c109737bafe service nova] Creating event network-vif-plugged:a62ee376-bb72-4c87-b427-676dc3e67cfd for instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 on nch2-master-1 Feb 12 21:02:50.181255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:50.181255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:50.181255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:50.185574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ef607034-94fc-43a5-8c6e-3c3e0568459e req-a65b43b8-6316-4c87-ac58-4c109737bafe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061501 Feb 12 21:02:50.187929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:50.193052 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 148/287] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:50.771932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:50.772701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:50.781177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:50.788809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:50.788809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:50.788809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:50.841836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:50.853628 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45dad5d8-5df5-403c-abd5-760c59c2a27d tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.702941 Feb 12 21:02:50.863409 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 140/288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:50 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:51.138973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:51.140972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:51.154545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.159719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.160823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.162152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.238237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:51.252633 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f7adc2ea-ae05-4459-b515-ec498bab376d tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1320 microversion: 2.1 time: 0.484929 Feb 12 21:02:51.253508 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 149/289] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:50 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:51.281956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:51.283694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:51.294339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.294967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.296053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.296492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.472346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:51.483944 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2328fc50-cad2-4d92-8993-4c7255f8179a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1469 microversion: 2.1 time: 0.349837 Feb 12 21:02:51.485815 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 141/290] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:51 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1469 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:51.527681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:51.536627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b20d79ea-bd9f-43f5-a9ff-5ba6b8d9d1bf tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1492 microversion: 2.1 time: 0.281763 Feb 12 21:02:51.537051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 150/291] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:51 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1492 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:51.663305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c0d1e813-1125-47a3-92eb-42bdfd3fbf5b req-56e7f742-676e-4874-b2e0-c8c7ec7dd1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dd78a6-6a4a-4a75-9884-8c6da08d8162", "tag": "b3117813-1a43-4a34-b05f-81ccfc0a50b9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:51.666459 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:51.666459 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:51.677465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c0d1e813-1125-47a3-92eb-42bdfd3fbf5b req-56e7f742-676e-4874-b2e0-c8c7ec7dd1fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.678162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c0d1e813-1125-47a3-92eb-42bdfd3fbf5b req-56e7f742-676e-4874-b2e0-c8c7ec7dd1fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.697550 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c0d1e813-1125-47a3-92eb-42bdfd3fbf5b req-56e7f742-676e-4874-b2e0-c8c7ec7dd1fe service nova] Creating event network-changed:b3117813-1a43-4a34-b05f-81ccfc0a50b9 for instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 on nch1-master-1 Feb 12 21:02:51.703725 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c0d1e813-1125-47a3-92eb-42bdfd3fbf5b req-56e7f742-676e-4874-b2e0-c8c7ec7dd1fe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045424 Feb 12 21:02:51.706076 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 151/292] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:51.870390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:51.873862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:51.878992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:51.879808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:51.887887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.888960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.890319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.892338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.892968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.894775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:51.895009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:51.897819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.096306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:52.104481 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19437534-893b-4bed-9d30-cd421ff9a7a1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.238070 Feb 12 21:02:52.105562 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 152/293] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:51 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:52.160168 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30a3656e-204e-4db7-b575-f2fffc9b64cd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1643 microversion: 2.1 time: 0.610571 Feb 12 21:02:52.161029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 142/294] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:51 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1643 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:52.176029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:52.176745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:52.182801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.183253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.184118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.184551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.282661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:52.283531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:52.292930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.296936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.296936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.296936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.343451 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-818ce5ae-79a2-4b3b-8b52-07d36f80e180 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1643 microversion: 2.1 time: 0.166995 Feb 12 21:02:52.343451 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 153/295] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:52 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1643 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:52.360379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-741f6d96-a330-4f46-8684-df6a8d6c87f6 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:52.363084 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:52.363084 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:52.365451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-741f6d96-a330-4f46-8684-df6a8d6c87f6 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.367070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-741f6d96-a330-4f46-8684-df6a8d6c87f6 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.368094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-741f6d96-a330-4f46-8684-df6a8d6c87f6 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.368740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-741f6d96-a330-4f46-8684-df6a8d6c87f6 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.403796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-741f6d96-a330-4f46-8684-df6a8d6c87f6 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048552 Feb 12 21:02:52.404832 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 154/296] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:02:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:02:52.419106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:52.422216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:52.435410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.435944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.437790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.438388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.567788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:52.575959 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a2e37d7c-452a-4f00-9c0f-42f9e0b0d0d5 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1469 microversion: 2.1 time: 0.298373 Feb 12 21:02:52.577884 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 143/297] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:52 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:52.588062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:52.590043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:52.600761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.601211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.602040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.602474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.755010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:52.761182 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-412d92dd-2ee1-467b-a7f2-226d5869f04e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.181914 Feb 12 21:02:52.761803 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 144/298] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:52 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:52.766815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:52.767808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:52.773604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.777808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.777808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:52.777808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:52.962901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lazy-loading 'flavor' on Instance uuid 77e82f99-dc16-48b4-987d-d57b003637ff {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:53.017919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Going to try to live migrate instance to nch1-master-1 {{(pid=141727) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:02:53.287420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-548005be-3645-4715-bad7-9774d572b09c tempest-DeleteServersAdminTestJSON-1308990651 tempest-DeleteServersAdminTestJSON-1308990651-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3/action" status: 202 len: 0 microversion: 2.1 time: 0.524515 Feb 12 21:02:53.291197 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 145/299] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:02:52 2022] POST /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:02:53.297789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:53.297789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:53.300538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:53.300892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:53.301857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:53.302283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:53.438697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:53.446263 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-afb4cdf1-1890-4ca4-a2d9-536f53522c7b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.157248 Feb 12 21:02:53.446832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 146/300] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:53 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:53.682906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9e880c1e-05b5-4d61-b590-aca03dd7de27 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1229589647", "id": 1415747577, "os-flavor-access:is_public": "False"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:53.684924 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:53.684924 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:53.787084 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9e880c1e-05b5-4d61-b590-aca03dd7de27 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.332245 Feb 12 21:02:53.787084 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 147/301] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:53 2022] POST /compute/v2.1/flavors => generated 431 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:53.787084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:53.787084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:53.793133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:53.793627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:53.794569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:53.795177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:53.831761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:53.832217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:53.832674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lazy-loading 'fault' on Instance uuid 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:53.960064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:53.970576 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7c3aa27-6f54-4b8a-94d1-8c5778532a21 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1452 microversion: 2.1 time: 0.188308 Feb 12 21:02:53.982046 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 148/302] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:53 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:53.989427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:53.990303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:53.999364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:53.999828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:54.001062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:54.001532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:54.154640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:54.162973 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a3448b7-3344-4057-aa06-b7264f5203cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.179505 Feb 12 21:02:54.163653 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 149/303] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:53 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:54.174067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66d10673-d27a-4685-aa2a-6bf4ac9e799c tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4eb2b36d2ae44aca8d999d202678e559"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:54.174067 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:54.174067 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:54.508592 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66d10673-d27a-4685-aa2a-6bf4ac9e799c tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1415747577/action" status: 200 len: 97 microversion: 2.1 time: 0.343617 Feb 12 21:02:54.515956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 150/304] 10.222.0.31 () {60 vars in 1199 bytes} [Sat Feb 12 21:02:54 2022] POST /compute/v2.1/flavors/1415747577/action => generated 97 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:54.520600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:54.521096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:54.528197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:54.528652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:54.529510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:54.530790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:54.581312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:02:54.870756 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-53d4dda1-dd7e-4275-a511-3c1818d82e99 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "DELETE /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 204 len: 0 microversion: 2.1 time: 0.353350 Feb 12 21:02:54.871334 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 151/305] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:02:54 2022] DELETE /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:02:54.877538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:54.878249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:54.884477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:54.884982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:54.885858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:54.886297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:55.093861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:55.101800 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bf5a8013-f0e7-4965-bad7-ce6a485aacea tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.229243 Feb 12 21:02:55.102757 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 152/306] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:54 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:55.269052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8eca93c0-2c7f-4963-ad79-768bd530ab1b tempest-FlavorsAccessTestJSON-20993753 tempest-FlavorsAccessTestJSON-20993753-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:55.291451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8eca93c0-2c7f-4963-ad79-768bd530ab1b tempest-FlavorsAccessTestJSON-20993753 tempest-FlavorsAccessTestJSON-20993753-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.1 time: 0.187647 Feb 12 21:02:55.292136 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 153/307] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:02:55 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:55.348077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67ca5768-bbce-410a-aeae-f205dc0d68b0 tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-338436534", "id": 925516787, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:55.349691 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:55.349691 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:55.489292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67ca5768-bbce-410a-aeae-f205dc0d68b0 tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.195940 Feb 12 21:02:55.489891 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 154/308] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:02:55 2022] POST /compute/v2.1/flavors => generated 467 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:02:55.494335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:55.494962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:55.505818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:55.506500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:55.507307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:55.507745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:55.546396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:55.547472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:55.548215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lazy-loading 'fault' on Instance uuid 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:55.730668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:55.738857 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e48916bc-24ce-473b-bcdd-45e404de0072 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1458 microversion: 2.1 time: 0.247890 Feb 12 21:02:55.740897 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 155/309] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:55 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1458 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:55.743809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:55.744404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:55.751778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:55.752230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:55.753088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:55.753581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:56.144246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:56.153495 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ebef218-5748-4e43-8d79-d1001db8d449 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.413046 Feb 12 21:02:56.154321 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 156/310] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:55 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:56.168639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2e5c305-bd0c-496e-b696-ac82267e5c64 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4eb2b36d2ae44aca8d999d202678e559"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:56.170096 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:56.170096 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:56.453137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2e5c305-bd0c-496e-b696-ac82267e5c64 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1415747577/action" status: 200 len: 21 microversion: 2.1 time: 0.288135 Feb 12 21:02:56.457539 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 157/311] 10.222.0.31 () {60 vars in 1199 bytes} [Sat Feb 12 21:02:56 2022] POST /compute/v2.1/flavors/1415747577/action => generated 21 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:02:56.459318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d6c50f6-109e-47f1-b8b5-18b9824fca78 tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:56.460891 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:56.460891 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:56.819505 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d6c50f6-109e-47f1-b8b5-18b9824fca78 tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/925516787/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.364364 Feb 12 21:02:56.820004 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 158/312] 10.222.0.31 () {62 vars in 1261 bytes} [Sat Feb 12 21:02:56 2022] POST /compute/v2.1/flavors/925516787/os-extra_specs => generated 62 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:56.829660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:56.830172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f23f4d4f-cf50-45fe-8f62-cfc86a54a96c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff/action" status: 202 len: 0 microversion: 2.1 time: 4.417574 Feb 12 21:02:56.830636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:56.830779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 155/313] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:02:52 2022] POST /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff/action => generated 0 bytes in 4419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:02:56.837653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:56.838236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:56.839269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:56.839389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-704db9de-5754-4071-b695-6e6d74b675cc tempest-FlavorsAccessTestJSON-20993753 tempest-FlavorsAccessTestJSON-20993753-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:56.839894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:56.864012 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-704db9de-5754-4071-b695-6e6d74b675cc tempest-FlavorsAccessTestJSON-20993753 tempest-FlavorsAccessTestJSON-20993753-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6236 microversion: 2.1 time: 0.030985 Feb 12 21:02:56.864614 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 156/314] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:02:56 2022] GET /compute/v2.1/flavors/detail => generated 6236 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:56.869560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:56.870478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:56.881058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:56.881899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:56.882877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:56.883314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:56.917771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:56.918220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:56.918711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lazy-loading 'fault' on Instance uuid 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:57.051671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:57.061147 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-038a743d-421a-466a-9f3a-d671012acb5a tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1458 microversion: 2.1 time: 0.195024 Feb 12 21:02:57.062358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 157/315] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:56 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1458 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:57.069855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb45a8ea-3d18-4665-816c-316b169faf5c tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.070955 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:57.070955 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:57.196542 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb45a8ea-3d18-4665-816c-316b169faf5c tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/925516787" status: 202 len: 0 microversion: 2.86 time: 0.130692 Feb 12 21:02:57.197325 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 158/316] 10.222.0.31 () {60 vars in 1198 bytes} [Sat Feb 12 21:02:57 2022] DELETE /compute/v2.1/flavors/925516787 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:02:57.202389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.203435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:57.212594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:57.222832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:57.224782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:57.225678 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57948e7c-094a-4256-a972-ca6be296c9c1 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.403959 Feb 12 21:02:57.226553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:57.226913 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 159/317] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:56 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:57.231765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-592f4c47-dbac-4f6d-ae4b-e31df44b311d tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.232730 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:57.232730 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:02:57.237277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:57.339422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-592f4c47-dbac-4f6d-ae4b-e31df44b311d tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1415747577" status: 202 len: 0 microversion: 2.1 time: 0.111048 Feb 12 21:02:57.344477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 160/318] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:02:57 2022] DELETE /compute/v2.1/flavors/1415747577 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:02:57.357115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.357752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:57.365400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:57.366162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:57.367140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:57.367726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:57.445035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:57.456202 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca17685f-6fb6-44f3-9b4e-87fbe89eb050 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.257616 Feb 12 21:02:57.457179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 159/319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:57 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:57.469146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e8428d16-b329-4ebf-a2f9-df811ae97a2c tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.501178 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e8428d16-b329-4ebf-a2f9-df811ae97a2c tempest-FlavorMetadataValidation-1474264551 tempest-FlavorMetadataValidation-1474264551-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6682 microversion: 2.86 time: 0.037710 Feb 12 21:02:57.501811 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 160/320] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:02:57 2022] GET /compute/v2.1/flavors/detail => generated 6682 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:02:57.506373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e1266dd-acd3-46fe-994b-235c3c530e8b tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.531422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e1266dd-acd3-46fe-994b-235c3c530e8b tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.028227 Feb 12 21:02:57.541537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 161/321] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:02:57 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:57.557285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc9a1167-81c7-4db2-b8f8-67c427c5945a tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2146819466", "id": 1436234613, "os-flavor-access:is_public": "False"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:57.559032 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:57.559032 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:57.659010 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc9a1167-81c7-4db2-b8f8-67c427c5945a tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.105744 Feb 12 21:02:57.659930 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 162/322] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:02:57 2022] POST /compute/v2.1/flavors => generated 431 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:57.673196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00ef7fe2-909a-4a80-aa59-b0371245aa60 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.674228 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:57.674228 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:57.688783 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00ef7fe2-909a-4a80-aa59-b0371245aa60 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/1436234613/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.021131 Feb 12 21:02:57.693730 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 163/323] 10.222.0.31 () {58 vars in 1208 bytes} [Sat Feb 12 21:02:57 2022] GET /compute/v2.1/flavors/1436234613/os-flavor-access => generated 21 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:02:57.706156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1d78e617-1ed9-42e6-a460-fdd33a20f3f4 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.706916 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:57.706916 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:57.826352 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1d78e617-1ed9-42e6-a460-fdd33a20f3f4 tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1436234613" status: 202 len: 0 microversion: 2.1 time: 0.130204 Feb 12 21:02:57.830818 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 164/324] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:02:57 2022] DELETE /compute/v2.1/flavors/1436234613 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:02:57.835999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7dcdcba1-3d4e-4419-bc96-fa1b9990e93c tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:57.882879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7dcdcba1-3d4e-4419-bc96-fa1b9990e93c tempest-FlavorsAccessTestJSON-2106925194 tempest-FlavorsAccessTestJSON-2106925194-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.050950 Feb 12 21:02:57.883491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 165/325] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:02:57 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:57.921167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-15fdbacb-3883-4e14-9acb-f444f8f1b06f req-583972e5-6ab2-4702-a9bf-931247ccf645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065ab662-e01a-43c9-8858-ffc7dfd4f3f3", "name": "network-vif-deleted", "tag": "a62ee376-bb72-4c87-b427-676dc3e67cfd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:57.922459 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:57.922459 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:57.953291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-15fdbacb-3883-4e14-9acb-f444f8f1b06f req-583972e5-6ab2-4702-a9bf-931247ccf645 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:57.953778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-15fdbacb-3883-4e14-9acb-f444f8f1b06f req-583972e5-6ab2-4702-a9bf-931247ccf645 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:57.982652 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-15fdbacb-3883-4e14-9acb-f444f8f1b06f req-583972e5-6ab2-4702-a9bf-931247ccf645 service nova] Creating event network-vif-deleted:a62ee376-bb72-4c87-b427-676dc3e67cfd for instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 on nch2-master-1 Feb 12 21:02:57.992964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-15fdbacb-3883-4e14-9acb-f444f8f1b06f req-583972e5-6ab2-4702-a9bf-931247ccf645 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087265 Feb 12 21:02:57.994339 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 166/326] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:58.090393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:58.091787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:58.114764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.115275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.116134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.116580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.242381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.244861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.248341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lazy-loading 'fault' on Instance uuid 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:02:58.258819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:58.267368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31410e03-ff07-41ed-b35e-71fcbe1ac20e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.917738 Feb 12 21:02:58.277745 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 161/327] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:57 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:58.283575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:58.288481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:58.299350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.314382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.315768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.316625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.340988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '025db9daf7864d258b3453ec4381626c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b9d29252e43d597ac37f401de9de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:58.353287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c7358536-667b-41d5-9f26-86183d8b35fb tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 200 len: 1416 microversion: 2.1 time: 0.271727 Feb 12 21:02:58.353925 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 167/328] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:58 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 1416 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:02:58.367047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-924be98a-3756-43b2-9b9d-3ca01a856d09 req-cd7417bd-4162-42f3-aeec-a2021fffb57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd78a6-6a4a-4a75-9884-8c6da08d8162", "name": "network-vif-plugged", "status": "completed", "tag": "b3117813-1a43-4a34-b05f-81ccfc0a50b9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:02:58.373321 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:02:58.373321 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:02:58.387295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-924be98a-3756-43b2-9b9d-3ca01a856d09 req-cd7417bd-4162-42f3-aeec-a2021fffb57d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.387657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-924be98a-3756-43b2-9b9d-3ca01a856d09 req-cd7417bd-4162-42f3-aeec-a2021fffb57d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.401520 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-924be98a-3756-43b2-9b9d-3ca01a856d09 req-cd7417bd-4162-42f3-aeec-a2021fffb57d service nova] Creating event network-vif-plugged:b3117813-1a43-4a34-b05f-81ccfc0a50b9 for instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 on nch1-master-1 Feb 12 21:02:58.409051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-924be98a-3756-43b2-9b9d-3ca01a856d09 req-cd7417bd-4162-42f3-aeec-a2021fffb57d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048120 Feb 12 21:02:58.410111 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 168/329] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:02:58.477263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:58.478216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:58.494557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.497046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.501588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:58.502202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:58.695281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:58.721984 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b20f00e-3262-4563-91fb-a2952273098f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.249534 Feb 12 21:02:58.726894 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 169/330] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:58 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:58.911123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:58.918979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7b0cb0c7-d128-4cdf-9d0f-51c3102b0224 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.639875 Feb 12 21:02:58.929548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 162/331] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:58 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:59.284705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.286395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.301315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.301791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.302639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.303079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.372151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.373214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.383602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.384268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.385634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.386218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.408530 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] HTTP exception thrown: Instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 could not be found. Feb 12 21:02:59.409184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Returning 404 to user: Instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:59.410253 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3380eaa1-9574-4e32-8a7d-1d8c288add30 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 404 len: 111 microversion: 2.1 time: 0.042759 Feb 12 21:02:59.417103 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 163/332] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:59 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:59.424944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.425663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.432815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.433345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.434674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.440213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.452368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] HTTP exception thrown: Instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 could not be found. Feb 12 21:02:59.453202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Returning 404 to user: Instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:59.454234 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cacf73df-a5c2-4ed0-adfa-30345a4f6508 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "DELETE /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 404 len: 111 microversion: 2.1 time: 0.035408 Feb 12 21:02:59.455293 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 164/333] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:02:59 2022] DELETE /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:02:59.474272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.474894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 065ab662-e01a-43c9-8858-ffc7dfd4f3f3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.482127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.482584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.484060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.484496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.505294 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] HTTP exception thrown: Instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 could not be found. Feb 12 21:02:59.506102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Returning 404 to user: Instance 065ab662-e01a-43c9-8858-ffc7dfd4f3f3 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:59.507029 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f09d22c-b81d-43a1-ac9c-530f3fbf42e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3" status: 404 len: 111 microversion: 2.1 time: 0.047235 Feb 12 21:02:59.507731 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 165/334] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:59 2022] GET /compute/v2.1/servers/065ab662-e01a-43c9-8858-ffc7dfd4f3f3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:02:59.517309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.518438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.520738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:02:59.525890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.537587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.537587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.537587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.537855 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0b92766-3ba1-45ee-8d37-84237594b53a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.248544 Feb 12 21:02:59.537855 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 170/335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:59 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:02:59.548108 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] HTTP exception thrown: Instance 6e264a5e-a4b7-4947-b94b-331176328e63 could not be found. Feb 12 21:02:59.549091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Returning 404 to user: Instance 6e264a5e-a4b7-4947-b94b-331176328e63 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:59.550393 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f97e66c6-9bc7-4a1b-b0fb-229a7b55f7e8 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 404 len: 111 microversion: 2.1 time: 0.038502 Feb 12 21:02:59.551034 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 166/336] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:02:59 2022] DELETE /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:59.568743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.568743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] [instance: 6e264a5e-a4b7-4947-b94b-331176328e63] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.572650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.577915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.596292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.596292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.647320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] HTTP exception thrown: Instance 6e264a5e-a4b7-4947-b94b-331176328e63 could not be found. Feb 12 21:02:59.653202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] Returning 404 to user: Instance 6e264a5e-a4b7-4947-b94b-331176328e63 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:02:59.653202 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81d5ffb0-0515-46f8-b27c-f047d5ce2375 tempest-DeleteServersAdminTestJSON-879106040 tempest-DeleteServersAdminTestJSON-879106040-project] 10.222.0.31 "GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63" status: 404 len: 111 microversion: 2.1 time: 0.094160 Feb 12 21:02:59.653202 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 171/337] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:59 2022] GET /compute/v2.1/servers/6e264a5e-a4b7-4947-b94b-331176328e63 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:02:59.744111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.744111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.753442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.754572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.755687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.756988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.937607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:02:59.938799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:02:59.945960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.947039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:02:59.948130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:02:59.949056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:00.136158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:00.146455 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb2b87de-d3c9-41b2-9f10-375e8d965e40 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1315 microversion: 2.1 time: 0.213869 Feb 12 21:03:00.148359 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 172/338] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:59 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:00.314613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:00.327142 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d769d311-93c0-4084-ae37-d6de7709481f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.590656 Feb 12 21:03:00.328455 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 167/339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:02:59 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:00.537009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6bc797c9-7ad9-40c5-a0f8-30351f727836 req-e4be4529-d3cb-4957-aec9-28aec078e579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e82f99-dc16-48b4-987d-d57b003637ff", "name": "network-vif-unplugged", "status": "completed", "tag": "27c22334-4595-4060-b8ea-dcc1f99639f0"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:00.544083 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:00.544083 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:00.546997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6bc797c9-7ad9-40c5-a0f8-30351f727836 req-e4be4529-d3cb-4957-aec9-28aec078e579 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:00.547509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6bc797c9-7ad9-40c5-a0f8-30351f727836 req-e4be4529-d3cb-4957-aec9-28aec078e579 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:00.547904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:00.548627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:00.554991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:00.555598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:00.556594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:00.557092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:00.559160 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6bc797c9-7ad9-40c5-a0f8-30351f727836 req-e4be4529-d3cb-4957-aec9-28aec078e579 service nova] Creating event network-vif-unplugged:27c22334-4595-4060-b8ea-dcc1f99639f0 for instance 77e82f99-dc16-48b4-987d-d57b003637ff on nch2-master-1 Feb 12 21:03:00.565034 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6bc797c9-7ad9-40c5-a0f8-30351f727836 req-e4be4529-d3cb-4957-aec9-28aec078e579 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031550 Feb 12 21:03:00.573016 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 173/340] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:00.834183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:00.845184 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd312488-996b-4ee7-b53b-c5370d85d20c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.302419 Feb 12 21:03:00.856134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 168/341] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:00 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:01.170051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:01.171623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:01.180167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.181654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.184766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.185450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.346751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:01.347782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:01.363157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.364847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.366113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.367121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.605885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:01.620068 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5d224ed-0d45-42b5-a2a7-9abf1b65a771 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.278338 Feb 12 21:03:01.620803 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 169/342] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:01 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:01.634564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:01.643419 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d7877d7e-3d28-47b0-9a5b-3fb44aecd57b tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1464 microversion: 2.1 time: 0.482903 Feb 12 21:03:01.644000 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 174/343] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:01 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1464 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:01.660701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:01.661444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:01.667401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.667847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.668684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.669222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.698234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:03:01.873166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:01.877377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:01.895330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.896091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:01.897153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:01.897810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:02.264617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:02.274036 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bec7373f-a74e-40b0-8bbd-816241510841 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.406780 Feb 12 21:03:02.274933 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 175/344] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:01 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:02.308376 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ccc4480-a365-43b1-b2be-83a38acabca5 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "DELETE /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 204 len: 0 microversion: 2.1 time: 0.649238 Feb 12 21:03:02.314374 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 170/345] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:01 2022] DELETE /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:03:02.318680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:02.319361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:02.326013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:02.327791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:02.328697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:02.329401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:02.585311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-60769dc8-c768-43d7-aab5-6e12f9771fff req-ab326c6e-fad8-4e58-87e1-cbfdd169fdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e82f99-dc16-48b4-987d-d57b003637ff", "tag": "27c22334-4595-4060-b8ea-dcc1f99639f0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:02.587565 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:02.587565 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:02.596647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-60769dc8-c768-43d7-aab5-6e12f9771fff req-ab326c6e-fad8-4e58-87e1-cbfdd169fdb6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:02.597524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-60769dc8-c768-43d7-aab5-6e12f9771fff req-ab326c6e-fad8-4e58-87e1-cbfdd169fdb6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:02.599812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:02.608789 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16793587-a39b-4a86-a346-1e5efd078c1c tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1470 microversion: 2.1 time: 0.294219 Feb 12 21:03:02.610555 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 176/346] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:02 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1470 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:02.620926 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-60769dc8-c768-43d7-aab5-6e12f9771fff req-ab326c6e-fad8-4e58-87e1-cbfdd169fdb6 service nova] Creating event network-changed:27c22334-4595-4060-b8ea-dcc1f99639f0 for instance 77e82f99-dc16-48b4-987d-d57b003637ff on nch2-master-1 Feb 12 21:03:02.633465 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-60769dc8-c768-43d7-aab5-6e12f9771fff req-ab326c6e-fad8-4e58-87e1-cbfdd169fdb6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051053 Feb 12 21:03:02.634652 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 171/347] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:02.652879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:02.654489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:02.680574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:02.680574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:02.680574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:02.680574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:02.908136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:02.918537 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-75ce52b5-8ca8-4091-8954-132032040be9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.282420 Feb 12 21:03:02.927984 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 177/348] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:02 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:03.294396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:03.301177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:03.312022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:03.312675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:03.313288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:03.313744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:03.618788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:03.626431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:03.627275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:03.635025 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe1bf0c2-638e-40ef-a9c3-1dd3810ce05b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.346432 Feb 12 21:03:03.635636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:03.636271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:03.638277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:03.638930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:03.649115 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 172/349] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:03 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:03.839835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:03.849264 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bfe6ac5a-43f9-40d4-ab93-76d01308a0d4 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1470 microversion: 2.1 time: 0.226846 Feb 12 21:03:03.850336 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 178/350] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:03 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:03.946655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:03.956398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:03.970765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:03.971223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:03.972015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:03.973795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:04.180090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:04.194862 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6b837887-a535-4b83-9e1d-aae2f42ecff3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.260662 Feb 12 21:03:04.195450 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 179/351] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:03 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:04.315353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2032693070", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "00db7637-715c-44c7-a356-d7a146fc856c"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:04.402528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] validate_networks() for [('00db7637-715c-44c7-a356-d7a146fc856c', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:04.659601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:04.659601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:04.670937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:04.671366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:04.672129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:04.672561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:04.949156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:04.958614 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3071ade-9145-4913-b8e2-a0c73e981963 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.305183 Feb 12 21:03:04.969081 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 180/352] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:04 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:04.974911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-38965f50-7499-4b07-81a0-c9687ca885ee req-effc31c5-ff7e-4215-bb81-35a31c99e3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd78a6-6a4a-4a75-9884-8c6da08d8162", "name": "network-vif-deleted", "tag": "b3117813-1a43-4a34-b05f-81ccfc0a50b9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:04.976779 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:04.976779 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:04.986181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-38965f50-7499-4b07-81a0-c9687ca885ee req-effc31c5-ff7e-4215-bb81-35a31c99e3bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:04.987111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-38965f50-7499-4b07-81a0-c9687ca885ee req-effc31c5-ff7e-4215-bb81-35a31c99e3bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.003475 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-38965f50-7499-4b07-81a0-c9687ca885ee req-effc31c5-ff7e-4215-bb81-35a31c99e3bf service nova] Creating event network-vif-deleted:b3117813-1a43-4a34-b05f-81ccfc0a50b9 for instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 on nch1-master-1 Feb 12 21:03:05.009831 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-38965f50-7499-4b07-81a0-c9687ca885ee req-effc31c5-ff7e-4215-bb81-35a31c99e3bf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039423 Feb 12 21:03:05.012102 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 181/353] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:05.017943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:05.018646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:05.024989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.025674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.026662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.027976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.063207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.063907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.064539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lazy-loading 'fault' on Instance uuid 96dd78a6-6a4a-4a75-9884-8c6da08d8162 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:03:05.111231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ccab50ed624d5b92320ad53b9f6d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd0dea72a7f541e98ad63b8b8037fa42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:05.111659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:05.112134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:05.112548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:05.112957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:05.113382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:05.122314 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ee28c25-e6bf-4748-9da9-b4803bb072a9 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 200 len: 1305 microversion: 2.1 time: 0.110576 Feb 12 21:03:05.125799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 182/354] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:05 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:05.146668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.147208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.148122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.148633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.167856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Getting quotas for project 65e530a89835494485cff388fdc9d69b. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:05.172886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Getting quotas for user 15b8a9ad9daa4969a1fd89aeb28431d5 and project 65e530a89835494485cff388fdc9d69b. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:05.185065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:05.187448 ncdv-master-1 devstack@n-api.service[141726]: WARNING nova.utils [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2032693070 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-203269307 Feb 12 21:03:05.188626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:05.212258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:05.223210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:05.227162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.227622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.228466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.228901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.359001 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-83abba73-aa7d-40b4-9538-64828cbd8f1b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434319 Feb 12 21:03:05.367980 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 173/355] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:05.380034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7019b885-db06-4dcc-8d1c-8ded0855cb0e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:05.381082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7019b885-db06-4dcc-8d1c-8ded0855cb0e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:05.459253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:05.470602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63f9041f-22fc-4d80-9b8a-fff59f6d3351 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.260124 Feb 12 21:03:05.471206 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 183/356] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:05 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:05.491464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7019b885-db06-4dcc-8d1c-8ded0855cb0e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:05.491464 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7019b885-db06-4dcc-8d1c-8ded0855cb0e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1232 microversion: 2.1 time: 0.121817 Feb 12 21:03:05.492064 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 174/357] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:05 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1232 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:05.977261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:05.978231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:05.987834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.989170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:05.990912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:05.991522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.148086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:06.148893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:06.159973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.160879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.162346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.162802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.178459 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. Feb 12 21:03:06.179682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.180828 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-299295e7-1be0-4fe5-8e49-40b0fba93308 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 404 len: 111 microversion: 2.1 time: 0.037765 Feb 12 21:03:06.181577 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 175/358] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:06 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:03:06.190830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-979660062", "metadata": {"image_type": "test"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:06.192501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:06.199205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.200583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.200929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.201381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.213109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:06.219116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. Feb 12 21:03:06.221080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.222238 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-38447a41-ff0d-4898-b6e6-5a30b1b737ee tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "POST /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162/action" status: 404 len: 111 microversion: 2.1 time: 0.035843 Feb 12 21:03:06.224610 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 176/359] 10.222.0.31 () {60 vars in 1278 bytes} [Sat Feb 12 21:03:06 2022] POST /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:06.225067 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c7574d1-93ed-4be3-8b1e-c79deda07a78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.252160 Feb 12 21:03:06.228508 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 184/360] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:05 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:06.237057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6c071c4-0ced-41a9-8dbe-ed680d27dc71 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1988558615", "metadata": {"image_type": "test"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:06.238161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a6c071c4-0ced-41a9-8dbe-ed680d27dc71 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Failed to fetch instance by id tempest-invalid-1291495542 {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:03:06.238665 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a6c071c4-0ced-41a9-8dbe-ed680d27dc71 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance tempest-invalid-1291495542 could not be found. Feb 12 21:03:06.239330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6c071c4-0ced-41a9-8dbe-ed680d27dc71 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance tempest-invalid-1291495542 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.240185 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a6c071c4-0ced-41a9-8dbe-ed680d27dc71 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "POST /compute/v2.1/servers/tempest-invalid-1291495542/action" status: 404 len: 101 microversion: 2.1 time: 0.007791 Feb 12 21:03:06.251539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66c8ef17-a7dd-4cb2-87df-49705d045a1a tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-154551561"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:06.252664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66c8ef17-a7dd-4cb2-87df-49705d045a1a tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:03:06.253188 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-66c8ef17-a7dd-4cb2-87df-49705d045a1a tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Feb 12 21:03:06.253785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66c8ef17-a7dd-4cb2-87df-49705d045a1a tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.254681 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-66c8ef17-a7dd-4cb2-87df-49705d045a1a tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.008172 Feb 12 21:03:06.260060 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 177/361] 10.222.0.31 () {60 vars in 1248 bytes} [Sat Feb 12 21:03:06 2022] POST /compute/v2.1/servers/tempest-invalid-1291495542/action => generated 101 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:06.261328 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 185/362] 10.222.0.31 () {60 vars in 1274 bytes} [Sat Feb 12 21:03:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:06.268970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f007550-0f7c-4134-b610-8db203d8c7eb tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1991613875"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:06.277856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f007550-0f7c-4134-b610-8db203d8c7eb tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:03:06.277856 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3f007550-0f7c-4134-b610-8db203d8c7eb tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Feb 12 21:03:06.277856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f007550-0f7c-4134-b610-8db203d8c7eb tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.277856 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f007550-0f7c-4134-b610-8db203d8c7eb tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010314 Feb 12 21:03:06.284506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:06.285456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:06.288984 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 178/363] 10.222.0.31 () {60 vars in 1280 bytes} [Sat Feb 12 21:03:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:06.293995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.294867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.296676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.297623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.316855 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. Feb 12 21:03:06.317669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.318667 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf367599-2cee-406a-b8e3-48f602a06a8f tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "DELETE /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 404 len: 111 microversion: 2.1 time: 0.038642 Feb 12 21:03:06.319726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 186/364] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:06 2022] DELETE /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:06.338484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:06.338484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] [instance: 96dd78a6-6a4a-4a75-9884-8c6da08d8162] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:06.338484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.338484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.338925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.338925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.352912 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] HTTP exception thrown: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. Feb 12 21:03:06.353576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] Returning 404 to user: Instance 96dd78a6-6a4a-4a75-9884-8c6da08d8162 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:06.354408 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55f604de-ca01-4b29-850a-5ec71485c6c7 tempest-ImagesNegativeTestJSON-1880091916 tempest-ImagesNegativeTestJSON-1880091916-project] 10.222.0.31 "GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162" status: 404 len: 111 microversion: 2.1 time: 0.030453 Feb 12 21:03:06.357470 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 179/365] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:06 2022] GET /compute/v2.1/servers/96dd78a6-6a4a-4a75-9884-8c6da08d8162 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:06.489719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:06.490410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:06.503749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.504213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.510788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a9680cde-d4b0-4e0c-98b9-72fbf0939fa1 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:06.511405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a9680cde-d4b0-4e0c-98b9-72fbf0939fa1 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:06.511924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:06.512987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:06.575065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a9680cde-d4b0-4e0c-98b9-72fbf0939fa1 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:06.582203 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a9680cde-d4b0-4e0c-98b9-72fbf0939fa1 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1232 microversion: 2.1 time: 0.074834 Feb 12 21:03:06.582794 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 180/366] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:06 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:06.742279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:06.751591 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-11215578-9064-4f88-8de6-b14b7895c91e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.259455 Feb 12 21:03:06.751591 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 187/367] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:06 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:07.125701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d07acb5-3c33-429c-ac21-84bfcdeeb37c tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Calling method '.version_select at 0x7fa904630dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.127431 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.127431 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:07.128693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d07acb5-3c33-429c-ac21-84bfcdeeb37c tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.130152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d07acb5-3c33-429c-ac21-84bfcdeeb37c tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.131375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d07acb5-3c33-429c-ac21-84bfcdeeb37c tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.131972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d07acb5-3c33-429c-ac21-84bfcdeeb37c tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.186487 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d07acb5-3c33-429c-ac21-84bfcdeeb37c tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.396385 Feb 12 21:03:07.186487 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 181/368] 10.222.0.31 () {58 vars in 1127 bytes} [Sat Feb 12 21:03:06 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:07.356560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1f39f27-61d3-4052-825c-47da81161840 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa90416d160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.358860 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.358860 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:07.360743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1f39f27-61d3-4052-825c-47da81161840 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.361469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1f39f27-61d3-4052-825c-47da81161840 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.364839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1f39f27-61d3-4052-825c-47da81161840 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.371280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1f39f27-61d3-4052-825c-47da81161840 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.405291 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1f39f27-61d3-4052-825c-47da81161840 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.411318 Feb 12 21:03:07.434356 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 188/369] 10.222.0.31 () {58 vars in 1127 bytes} [Sat Feb 12 21:03:06 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:07.439679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.444156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:07.451189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.451940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.452945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.454108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.648663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-94366dc1-5366-4cc1-81b6-2d2fd14a2df8 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Calling method '.version_select at 0x7fa8fe7544c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.653442 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.653442 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:07.658207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-94366dc1-5366-4cc1-81b6-2d2fd14a2df8 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a31814f17c7d4045be0c7265de2e309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6fd9b1ab3045e8b8e59948fbe824e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:07.661125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-94366dc1-5366-4cc1-81b6-2d2fd14a2df8 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:07.662103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-94366dc1-5366-4cc1-81b6-2d2fd14a2df8 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] 10.222.0.31 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.474146 Feb 12 21:03:07.663115 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 182/370] 10.222.0.31 () {58 vars in 1127 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 476 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:07.669272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-190f2fcc-4358-40ee-9f27-404023f418e0 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa8fe737820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.680026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-190f2fcc-4358-40ee-9f27-404023f418e0 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.680721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-190f2fcc-4358-40ee-9f27-404023f418e0 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.684182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-190f2fcc-4358-40ee-9f27-404023f418e0 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.684835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-190f2fcc-4358-40ee-9f27-404023f418e0 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.716573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:07.727016 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-190f2fcc-4358-40ee-9f27-404023f418e0 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.062047 Feb 12 21:03:07.727884 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 183/371] 10.222.0.31 () {58 vars in 1138 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:07.734178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.735008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:07.735529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-985e3d19-a0ac-4610-bfc5-e0a491ef3ddc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.292336 Feb 12 21:03:07.737511 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 189/372] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:07.742035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.742345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-682f3f87-bc0f-45ac-9be4-aff582a72c4e tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Calling method '.version_select at 0x7fa90416d670>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.742486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.743281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.743389 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.743389 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:07.743725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.756368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-682f3f87-bc0f-45ac-9be4-aff582a72c4e tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a31814f17c7d4045be0c7265de2e309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6fd9b1ab3045e8b8e59948fbe824e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:07.762606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-682f3f87-bc0f-45ac-9be4-aff582a72c4e tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:07.763346 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-682f3f87-bc0f-45ac-9be4-aff582a72c4e tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] 10.222.0.31 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.024750 Feb 12 21:03:07.770811 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 190/373] 10.222.0.31 () {58 vars in 1190 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:07.780466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c44316c-8818-4697-8f1e-9ad49e709f57 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa904164550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.789668 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.789668 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:07.799851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c44316c-8818-4697-8f1e-9ad49e709f57 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.800791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c44316c-8818-4697-8f1e-9ad49e709f57 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.802548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c44316c-8818-4697-8f1e-9ad49e709f57 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.803367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c44316c-8818-4697-8f1e-9ad49e709f57 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.835206 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c44316c-8818-4697-8f1e-9ad49e709f57 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.063410 Feb 12 21:03:07.836223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 191/374] 10.222.0.31 () {58 vars in 1144 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:07.841265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.841825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:07.851039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.851578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.852483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.857100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:07.865604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.868933 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd836289-4372-41f2-88fe-9b8da5ba0969 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1284 microversion: 2.1 time: 0.139821 Feb 12 21:03:07.871393 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 184/375] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:07.882934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab54b494-65c4-4812-83e9-018a97f707b5 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Calling method '.version_select at 0x7fa8fe6f3820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.885121 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.885121 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:07.910118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ab54b494-65c4-4812-83e9-018a97f707b5 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 12 21:03:07.910799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab54b494-65c4-4812-83e9-018a97f707b5 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:07.911847 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab54b494-65c4-4812-83e9-018a97f707b5 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035069 Feb 12 21:03:07.912621 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 185/376] 10.222.0.31 () {58 vars in 1211 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:07.924713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6fc7bcd5-6d6f-44f5-8423-e0c9ad9d35ee tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa8fe682820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.927547 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.927547 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:07.929723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fc7bcd5-6d6f-44f5-8423-e0c9ad9d35ee tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.930452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fc7bcd5-6d6f-44f5-8423-e0c9ad9d35ee tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.932171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fc7bcd5-6d6f-44f5-8423-e0c9ad9d35ee tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:07.932885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fc7bcd5-6d6f-44f5-8423-e0c9ad9d35ee tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:07.966123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6fc7bcd5-6d6f-44f5-8423-e0c9ad9d35ee tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.047270 Feb 12 21:03:07.971646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 186/377] 10.222.0.31 () {58 vars in 1127 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:07.981320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-567ba50d-e5d1-44e0-a276-0509701a5843 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Calling method '.version_select at 0x7fa8fe682dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:07.982891 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:07.982891 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:07.987740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-567ba50d-e5d1-44e0-a276-0509701a5843 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a31814f17c7d4045be0c7265de2e309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6fd9b1ab3045e8b8e59948fbe824e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:07.988553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-567ba50d-e5d1-44e0-a276-0509701a5843 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:07.989618 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-567ba50d-e5d1-44e0-a276-0509701a5843 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] 10.222.0.31 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.016861 Feb 12 21:03:07.990335 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 187/378] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:08.001142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc60ffe5-9d0c-4e60-98dc-9ca2bae30b3c tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa8fe6f3f70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.002734 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.002734 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:08.004684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc60ffe5-9d0c-4e60-98dc-9ca2bae30b3c tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.005580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc60ffe5-9d0c-4e60-98dc-9ca2bae30b3c tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.007442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc60ffe5-9d0c-4e60-98dc-9ca2bae30b3c tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.008029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc60ffe5-9d0c-4e60-98dc-9ca2bae30b3c tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.057109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc60ffe5-9d0c-4e60-98dc-9ca2bae30b3c tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.065179 Feb 12 21:03:08.061522 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 188/379] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:08.068791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb5627c2-6079-44dd-bb95-b87f35ab5192 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Calling method '.version_select at 0x7fa8fe737a60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.069623 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.069623 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:08.076057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-fb5627c2-6079-44dd-bb95-b87f35ab5192 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 12 21:03:08.077277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb5627c2-6079-44dd-bb95-b87f35ab5192 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.078305 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb5627c2-6079-44dd-bb95-b87f35ab5192 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015652 Feb 12 21:03:08.078988 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 189/380] 10.222.0.31 () {58 vars in 1190 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:08.089082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-039db2cb-63b4-4445-ac91-1278c184657d tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa8fe6f3c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.090471 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.090471 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:08.093283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-039db2cb-63b4-4445-ac91-1278c184657d tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.093979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-039db2cb-63b4-4445-ac91-1278c184657d tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.095160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-039db2cb-63b4-4445-ac91-1278c184657d tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.095751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-039db2cb-63b4-4445-ac91-1278c184657d tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.110067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:08.120308 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0e3e33f-26e1-4396-9969-dfc2e0157533 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.282740 Feb 12 21:03:08.121523 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 192/381] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:07 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:08.125669 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-039db2cb-63b4-4445-ac91-1278c184657d tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.045056 Feb 12 21:03:08.126270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 190/382] 10.222.0.31 () {58 vars in 1127 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:08.135422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa58d228-13c9-4200-b427-8ae5a19b664b tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa8fe6f34c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.136457 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.136457 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:08.143254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa58d228-13c9-4200-b427-8ae5a19b664b tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.143713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa58d228-13c9-4200-b427-8ae5a19b664b tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.153096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e9529c6-9d78-4592-94fb-ef61958c0abe tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Calling method '.version_select at 0x7fa904265550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.156691 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.156691 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:08.157686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa58d228-13c9-4200-b427-8ae5a19b664b tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.158138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa58d228-13c9-4200-b427-8ae5a19b664b tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.160268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e9529c6-9d78-4592-94fb-ef61958c0abe tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a31814f17c7d4045be0c7265de2e309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6fd9b1ab3045e8b8e59948fbe824e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:08.161129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e9529c6-9d78-4592-94fb-ef61958c0abe tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.164162 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e9529c6-9d78-4592-94fb-ef61958c0abe tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] 10.222.0.31 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.040087 Feb 12 21:03:08.164772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 193/383] 10.222.0.31 () {58 vars in 1196 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:08.176132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-762db2f2-1540-427b-8d37-4670f02a7c02 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Calling method '.version_select at 0x7fa90416d700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.187492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-762db2f2-1540-427b-8d37-4670f02a7c02 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 12 21:03:08.188248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-762db2f2-1540-427b-8d37-4670f02a7c02 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.189077 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-762db2f2-1540-427b-8d37-4670f02a7c02 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017609 Feb 12 21:03:08.190473 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 194/384] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:08.192331 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fa58d228-13c9-4200-b427-8ae5a19b664b tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.060361 Feb 12 21:03:08.192899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 191/385] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:08.201112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d217ac0-21e0-4835-905f-5c50c262dcb3 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Calling method '.version_select at 0x7fa90416d1f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.202229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-032645fc-6bff-46f5-a6c8-5f47fa074b47 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Calling method '.version_select at 0x7fa90406c1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.202683 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.202683 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:08.203019 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.203019 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:08.203946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3d217ac0-21e0-4835-905f-5c50c262dcb3 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a31814f17c7d4045be0c7265de2e309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6fd9b1ab3045e8b8e59948fbe824e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:08.204807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d217ac0-21e0-4835-905f-5c50c262dcb3 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.205804 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d217ac0-21e0-4835-905f-5c50c262dcb3 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] 10.222.0.31 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.009064 Feb 12 21:03:08.207732 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 195/386] 10.222.0.31 () {58 vars in 1193 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:03:08.209729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-032645fc-6bff-46f5-a6c8-5f47fa074b47 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.210179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-032645fc-6bff-46f5-a6c8-5f47fa074b47 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.216730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-928e1f63-1cc2-40be-980c-6d7aa9a06c81 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Calling method '.version_select at 0x7fa9042e3040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.223285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-032645fc-6bff-46f5-a6c8-5f47fa074b47 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.223731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-032645fc-6bff-46f5-a6c8-5f47fa074b47 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.226221 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-928e1f63-1cc2-40be-980c-6d7aa9a06c81 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 12 21:03:08.226799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-928e1f63-1cc2-40be-980c-6d7aa9a06c81 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.227604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-928e1f63-1cc2-40be-980c-6d7aa9a06c81 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.014301 Feb 12 21:03:08.232834 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 196/387] 10.222.0.31 () {58 vars in 1214 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:03:08.240327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50c2a232-427f-4f17-a05f-98f1eaee4147 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Action: 'update', calling method: .version_select at 0x7fa904265550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:08.240327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50c2a232-427f-4f17-a05f-98f1eaee4147 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.240535 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50c2a232-427f-4f17-a05f-98f1eaee4147 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.006457 Feb 12 21:03:08.241160 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 197/388] 10.222.0.31 () {60 vars in 1189 bytes} [Sat Feb 12 21:03:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:03:08.251011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0afba58-653a-420c-ae05-a59898852a9b tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Action: 'update', calling method: .version_select at 0x7fa90416d8b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:08.252107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0afba58-653a-420c-ae05-a59898852a9b tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.252898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0afba58-653a-420c-ae05-a59898852a9b tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.006374 Feb 12 21:03:08.253437 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 198/389] 10.222.0.31 () {60 vars in 1189 bytes} [Sat Feb 12 21:03:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:03:08.261333 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-032645fc-6bff-46f5-a6c8-5f47fa074b47 tempest-HostsAdminTestJSON-1799318788 tempest-HostsAdminTestJSON-1799318788-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 598 microversion: 2.1 time: 0.063448 Feb 12 21:03:08.262247 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 192/390] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 598 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:08.282406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa62eab9-c7e3-49c7-8023-63448bc68723 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Action: 'update', calling method: .version_select at 0x7fa8fe70ef70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:08.283843 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.283843 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:08.285094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fa62eab9-c7e3-49c7-8023-63448bc68723 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a31814f17c7d4045be0c7265de2e309e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6fd9b1ab3045e8b8e59948fbe824e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:08.285976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa62eab9-c7e3-49c7-8023-63448bc68723 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.286990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fa62eab9-c7e3-49c7-8023-63448bc68723 tempest-HostsAdminNegativeTestJSON-1502106665 tempest-HostsAdminNegativeTestJSON-1502106665-project] 10.222.0.31 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.023762 Feb 12 21:03:08.287718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 193/391] 10.222.0.31 () {60 vars in 1189 bytes} [Sat Feb 12 21:03:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:08.298370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-269747ec-8c8d-4c33-be44-31e166a0d7ab tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe7374c0>, body: {"status": null, "maintenance_mode": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:08.299937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-269747ec-8c8d-4c33-be44-31e166a0d7ab tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.300938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-269747ec-8c8d-4c33-be44-31e166a0d7ab tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.007046 Feb 12 21:03:08.306589 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 194/392] 10.222.0.31 () {60 vars in 1189 bytes} [Sat Feb 12 21:03:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:03:08.313013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8dfbbc2b-e476-4505-8de2-b79bfebd2d16 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe7c71f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:08.315581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.hosts [None req-8dfbbc2b-e476-4505-8de2-b79bfebd2d16 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Enabling host nonexistent_hostname. Feb 12 21:03:08.323639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8dfbbc2b-e476-4505-8de2-b79bfebd2d16 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Feb 12 21:03:08.324488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8dfbbc2b-e476-4505-8de2-b79bfebd2d16 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:08.325542 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8dfbbc2b-e476-4505-8de2-b79bfebd2d16 tempest-HostsAdminNegativeTestJSON-1935835141 tempest-HostsAdminNegativeTestJSON-1935835141-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017558 Feb 12 21:03:08.330703 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 195/393] 10.222.0.31 () {60 vars in 1210 bytes} [Sat Feb 12 21:03:08 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:08.758264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:08.759411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:08.768438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.769470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.770646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:08.771467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:08.864549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-11666a35-dc1a-4273-9116-00c00f8c2c9e tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-298060929", "id": 2109807829, "os-flavor-access:is_public": "True"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:08.868158 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:08.868158 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:08.993163 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-11666a35-dc1a-4273-9116-00c00f8c2c9e tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.732858 Feb 12 21:03:09.001431 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 199/394] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:08 2022] POST /compute/v2.1/flavors => generated 429 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:09.007082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.007968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:09.025446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:09.025446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:09.025446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:09.025718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:09.093649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:09.102300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-44db7274-1580-436f-b5d2-09dca193eb2f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.351031 Feb 12 21:03:09.102888 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 196/395] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:08 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:09.109093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a4d78948-d5a2-4c60-be38-e9dffd885a62 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.110284 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:09.110284 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:09.196877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a4d78948-d5a2-4c60-be38-e9dffd885a62 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/2109807829" status: 202 len: 0 microversion: 2.1 time: 0.092210 Feb 12 21:03:09.201397 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 197/396] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:09 2022] DELETE /compute/v2.1/flavors/2109807829 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:09.211638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.212903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:09.221221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:09.222319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:09.223505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:09.224163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:09.363550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:09.381624 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0dd6cdeb-24a8-4b1d-bc8b-2ec72b02622b tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1290 microversion: 2.1 time: 0.376236 Feb 12 21:03:09.382671 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 200/397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:09 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1290 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:09.395248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a78654f9-de7a-47da-8cb3-d9b77cdcf525 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.443328 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a78654f9-de7a-47da-8cb3-d9b77cdcf525 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.058288 Feb 12 21:03:09.445542 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 201/398] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:09 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:09.462548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4bb0c766-5de0-4fd2-a3e2-ce0c8688dcec tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-992346652", "id": 1997178203, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:09.464368 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:09.464368 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:09.511394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:09.521795 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-756cb322-6076-449a-82af-bd3464488e0e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1502 microversion: 2.1 time: 0.318027 Feb 12 21:03:09.523174 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 198/399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:09 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:09.619400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4bb0c766-5de0-4fd2-a3e2-ce0c8688dcec tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.160049 Feb 12 21:03:09.620766 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 202/400] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:09 2022] POST /compute/v2.1/flavors => generated 416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:09.631985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d240f1e1-b839-490a-9230-2545b1cfba7a tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.666705 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d240f1e1-b839-490a-9230-2545b1cfba7a tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.038600 Feb 12 21:03:09.667661 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 199/401] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:09 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:09.687939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d76ec94-2818-4448-b1e8-419ce64ee5eb tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.688723 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:09.688723 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:09.798087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d76ec94-2818-4448-b1e8-419ce64ee5eb tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1997178203" status: 202 len: 0 microversion: 2.1 time: 0.114656 Feb 12 21:03:09.798642 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 203/402] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:09 2022] DELETE /compute/v2.1/flavors/1997178203 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:09.808775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1904118-b32a-4f21-ba4c-74ac4ae8a011 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:09.851073 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1904118-b32a-4f21-ba4c-74ac4ae8a011 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.047746 Feb 12 21:03:09.852129 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 200/403] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:09 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:09.871486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a31e52d9-0c8c-4edc-8ae0-ec3b3c8b1c42 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1028797297", "id": 1110260417, "os-flavor-access:is_public": "True"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:10.016483 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a31e52d9-0c8c-4edc-8ae0-ec3b3c8b1c42 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.151508 Feb 12 21:03:10.017154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 204/404] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:09 2022] POST /compute/v2.1/flavors => generated 429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:10.027397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cfca8bfe-fed1-4ef3-8fd9-e01624e3ea10 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.030810 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:10.030810 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:10.120472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.121082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:10.127918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.128640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.129557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.130140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.177314 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cfca8bfe-fed1-4ef3-8fd9-e01624e3ea10 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1110260417" status: 202 len: 0 microversion: 2.1 time: 0.153435 Feb 12 21:03:10.178268 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 201/405] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:10 2022] DELETE /compute/v2.1/flavors/1110260417 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:10.195335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-058dc600-3e6d-4d06-a451-90466e1a259c tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.221375 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-058dc600-3e6d-4d06-a451-90466e1a259c tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.031139 Feb 12 21:03:10.222903 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 202/406] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:10.243407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3898bd10-ba89-45f2-9f37-a845e54795ae tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-818547064", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:10.244981 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:10.244981 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:10.353792 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3898bd10-ba89-45f2-9f37-a845e54795ae tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.114188 Feb 12 21:03:10.360444 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 203/407] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:10 2022] POST /compute/v2.1/flavors => generated 506 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:10.366214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd617c15-e201-47ba-9066-d0fdbfed3c9d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.504944 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd617c15-e201-47ba-9066-d0fdbfed3c9d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/05b49d14-90c3-4213-abef-cf08352986b2" status: 202 len: 0 microversion: 2.1 time: 0.142421 Feb 12 21:03:10.505500 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 204/408] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:10 2022] DELETE /compute/v2.1/flavors/05b49d14-90c3-4213-abef-cf08352986b2 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:10.511509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.512119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:10.519636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.520414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.521253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.521678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.534919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:10.547375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-46d509cc-8ffd-43c7-884a-cb60af328e42 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.430901 Feb 12 21:03:10.548645 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 205/409] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:10.553246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-acd81e12-b190-4dbd-9807-64cf966678fe tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.575878 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-acd81e12-b190-4dbd-9807-64cf966678fe tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.025850 Feb 12 21:03:10.577324 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 206/410] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:10.582119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.583037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:10.595293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.595293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.596253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.599779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.737823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:10.748368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-536690d5-58bb-4b6d-a353-8c3589206711 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.241177 Feb 12 21:03:10.749839 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 205/411] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:10.757253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c091bfe-46aa-4732-82b6-c42263b0acd1 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-258424178", "id": "ae7320af-2203-46ee-9fb6-280f3d953fff", "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:10.759135 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:10.759135 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:10.880504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:10.891327 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88781cff-c63b-41b4-9e8f-9f50cbca90f7 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1492 microversion: 2.1 time: 0.309287 Feb 12 21:03:10.891327 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 207/412] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1492 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:10.903552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9774d6e0-c39f-4714-b233-5ff3ecaece2b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '.version_select at 0x7fa90414ae50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.905459 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:10.905459 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:10.906852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9774d6e0-c39f-4714-b233-5ff3ecaece2b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.907300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9774d6e0-c39f-4714-b233-5ff3ecaece2b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.922898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9774d6e0-c39f-4714-b233-5ff3ecaece2b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.022691 Feb 12 21:03:10.923505 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 208/413] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:10.944146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.954374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:10.954374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.954374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.954374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:10.955718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:10.971821 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c091bfe-46aa-4732-82b6-c42263b0acd1 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.217602 Feb 12 21:03:10.973097 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 206/414] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:10 2022] POST /compute/v2.1/flavors => generated 506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:10.990487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4a9d3f9b-4e00-467f-8b23-5ee0258b41ec tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:10.991639 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:10.991639 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:11.162605 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4a9d3f9b-4e00-467f-8b23-5ee0258b41ec tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/ae7320af-2203-46ee-9fb6-280f3d953fff" status: 202 len: 0 microversion: 2.1 time: 0.180803 Feb 12 21:03:11.163380 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 207/415] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:10 2022] DELETE /compute/v2.1/flavors/ae7320af-2203-46ee-9fb6-280f3d953fff => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:11.176509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09c43fde-1606-4cc0-8455-598b8477a76c tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:11.224021 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09c43fde-1606-4cc0-8455-598b8477a76c tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.054977 Feb 12 21:03:11.230512 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 208/416] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:11 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:11.256940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c68e61b-4c78-4979-91db-a779f74e7fde tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1968732658", "id": 774184116, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:11.271469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c44da6a2-b9d4-4682-90f4-254876ff042b tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1643 microversion: 2.1 time: 0.331204 Feb 12 21:03:11.290034 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 209/417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:10 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1643 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:11.431139 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c68e61b-4c78-4979-91db-a779f74e7fde tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.182862 Feb 12 21:03:11.437473 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 209/418] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:11 2022] POST /compute/v2.1/flavors => generated 411 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:11.443091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32166a0b-132f-426c-a4c5-9a84bafa116b tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:11.456644 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32166a0b-132f-426c-a4c5-9a84bafa116b tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/774184116" status: 200 len: 411 microversion: 2.1 time: 0.017525 Feb 12 21:03:11.457517 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 210/419] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:03:11 2022] GET /compute/v2.1/flavors/774184116 => generated 411 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:11.498009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-299689649", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "04e4405d-ac34-418d-b812-924c095df566"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:11.566405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] validate_networks() for [('04e4405d-ac34-418d-b812-924c095df566', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:11.755021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ca7f7060-feaa-47c2-8d3e-94433aee099b tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:11.805022 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ca7f7060-feaa-47c2-8d3e-94433aee099b tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.340630 Feb 12 21:03:11.808630 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 210/420] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:11 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:11.824069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-19955085-1ca6-424e-b76c-f27e22e6817c req-b4b3145d-7128-43bc-81d4-39a615ba7790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfc153c-f638-4c53-b728-a2b9ed7b8d37", "tag": "f3148623-80dd-4c7e-bf9b-5e8808871e70"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:11.830421 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:11.830421 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:11.854125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-19955085-1ca6-424e-b76c-f27e22e6817c req-b4b3145d-7128-43bc-81d4-39a615ba7790 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:11.855193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-19955085-1ca6-424e-b76c-f27e22e6817c req-b4b3145d-7128-43bc-81d4-39a615ba7790 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:11.867350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-19955085-1ca6-424e-b76c-f27e22e6817c req-b4b3145d-7128-43bc-81d4-39a615ba7790 service nova] Creating event network-changed:f3148623-80dd-4c7e-bf9b-5e8808871e70 for instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 on nch2-master-1 Feb 12 21:03:11.877198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-19955085-1ca6-424e-b76c-f27e22e6817c req-b4b3145d-7128-43bc-81d4-39a615ba7790 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062647 Feb 12 21:03:11.877198 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 211/421] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:11.879316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:11.880106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:11.890751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:11.893197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:11.894133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:11.894650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:12.071012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:12.079135 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bbb70b4e-0ce2-4603-840f-6d5babeebdeb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.204210 Feb 12 21:03:12.079705 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 212/422] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:11 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:12.084108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.084894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:12.090790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:12.091251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:12.092079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:12.093021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:12.259831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:12.271741 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c89fc13-ca63-47bf-8303-da262809f142 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.190523 Feb 12 21:03:12.272480 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 213/423] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:12.278353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-872a717d-83d1-4a50-8988-5977a4161817 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.279217 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:12.279217 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:12.372180 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-872a717d-83d1-4a50-8988-5977a4161817 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/774184116" status: 202 len: 0 microversion: 2.1 time: 0.098204 Feb 12 21:03:12.372763 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 214/424] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:12 2022] DELETE /compute/v2.1/flavors/774184116 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:12.388025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50d7f5b0-154d-47ee-8a77-cff6e0b7243d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.401621 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50d7f5b0-154d-47ee-8a77-cff6e0b7243d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.023374 Feb 12 21:03:12.402200 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 215/425] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:12.418996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d3b080d-4d46-46e2-a52f-1bd329e40e28 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1062900700", "id": 1421420402, "os-flavor-access:is_public": "False"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:12.421277 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:12.421277 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:12.492962 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d3b080d-4d46-46e2-a52f-1bd329e40e28 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.077549 Feb 12 21:03:12.493588 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 216/426] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:12 2022] POST /compute/v2.1/flavors => generated 430 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:12.504414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ba69c99-7bef-463f-9223-3a10a058c27e tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "1421420402"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:12.513871 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8ba69c99-7bef-463f-9223-3a10a058c27e tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] HTTP exception thrown: Flavor 1421420402 could not be found. Feb 12 21:03:12.514643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ba69c99-7bef-463f-9223-3a10a058c27e tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] Returning 400 to user: Flavor 1421420402 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:12.515573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ba69c99-7bef-463f-9223-3a10a058c27e tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.015110 Feb 12 21:03:12.516330 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 217/427] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:12 2022] POST /compute/v2.1/servers => generated 81 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Feb 12 21:03:12.528086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2176067e-86ea-4b22-bc18-7aee7fcc4497 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.620925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:12.621930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:12.622578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:12.622985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:12.624122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:12.630964 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2176067e-86ea-4b22-bc18-7aee7fcc4497 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1421420402" status: 202 len: 0 microversion: 2.1 time: 0.107054 Feb 12 21:03:12.635343 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 218/428] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:12 2022] DELETE /compute/v2.1/flavors/1421420402 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:12.646770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6ee7c52-50b9-4235-a174-7739f15fec84 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.647520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:12.647520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:12.647520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:12.665383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:12.669243 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6ee7c52-50b9-4235-a174-7739f15fec84 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.031700 Feb 12 21:03:12.681870 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 219/429] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:12.691039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6ca07be-1461-4312-aabb-36d5e550e256 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1731062243", "id": 177019247, "os-flavor-access:is_public": "False"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:12.708840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:12.718477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for user f126f64ca5e64defb9bbcf4c6bab2fd8 and project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:12.736835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:12.739693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:12.793119 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b6ca07be-1461-4312-aabb-36d5e550e256 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.109308 Feb 12 21:03:12.798754 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 220/430] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:12 2022] POST /compute/v2.1/flavors => generated 412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:12.805861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97e2c0e7-de25-471d-b87d-fd4a1d5b0fc2 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-608959106", "id": 407223446, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:12.884388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d1e0e86b-a782-4384-8383-87c1d4cddf13 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390147 Feb 12 21:03:12.885048 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 211/431] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:12.895571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fea2c01-d53b-4d27-8e13-85ab86a68389 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.896621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fea2c01-d53b-4d27-8e13-85ab86a68389 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:12.922101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97e2c0e7-de25-471d-b87d-fd4a1d5b0fc2 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.114127 Feb 12 21:03:12.922899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 221/432] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:12 2022] POST /compute/v2.1/flavors => generated 410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:12.927573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7b7c6a53-90b5-4139-9794-48ca1f9e5532 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.944696 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7b7c6a53-90b5-4139-9794-48ca1f9e5532 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.020537 Feb 12 21:03:12.945939 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 222/433] 10.222.0.31 () {58 vars in 1168 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:12.971906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1015d999-a1bb-4a35-bf0c-7746a2c46193 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:12.974891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6fea2c01-d53b-4d27-8e13-85ab86a68389 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:12.983769 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1015d999-a1bb-4a35-bf0c-7746a2c46193 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.017076 Feb 12 21:03:12.986997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fea2c01-d53b-4d27-8e13-85ab86a68389 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1210 microversion: 2.1 time: 0.095107 Feb 12 21:03:12.987638 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 212/434] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:12.996605 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 223/435] 10.222.0.31 () {58 vars in 1176 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:12.997122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccec071b-e29e-4009-ab90-acb8f148bb79 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.007311 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccec071b-e29e-4009-ab90-acb8f148bb79 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.014712 Feb 12 21:03:13.009531 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 224/436] 10.222.0.31 () {58 vars in 1170 bytes} [Sat Feb 12 21:03:12 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:13.027018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee194c92-e1e9-4e5a-8c44-f08b72a4dd7d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.048076 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee194c92-e1e9-4e5a-8c44-f08b72a4dd7d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.024903 Feb 12 21:03:13.054738 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 213/437] 10.222.0.31 () {58 vars in 1168 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:13.062028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-262aa523-a81e-4803-92d8-df591e905023 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.087720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-262aa523-a81e-4803-92d8-df591e905023 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6218 microversion: 2.1 time: 0.030855 Feb 12 21:03:13.101297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.102663 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 225/438] 10.222.0.31 () {58 vars in 1168 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6218 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.103159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:13.106638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d803bf9b-c903-4045-aa17-f4a677014637 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.116893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:13.118223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:13.119062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:13.119495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:13.129726 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d803bf9b-c903-4045-aa17-f4a677014637 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6218 microversion: 2.1 time: 0.026778 Feb 12 21:03:13.142079 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 226/439] 10.222.0.31 () {58 vars in 1174 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6218 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.147383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6ffcaaa1-66b5-43ff-9d4e-b7d057ac71dc tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.176865 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6ffcaaa1-66b5-43ff-9d4e-b7d057ac71dc tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6218 microversion: 2.1 time: 0.033074 Feb 12 21:03:13.177415 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 227/440] 10.222.0.31 () {58 vars in 1172 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6218 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.195375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-32ecf1a3-6777-4aba-9230-0848ee1f4d3b tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.227962 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-32ecf1a3-6777-4aba-9230-0848ee1f4d3b tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6218 microversion: 2.1 time: 0.038079 Feb 12 21:03:13.228659 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 228/441] 10.222.0.31 () {58 vars in 1168 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6218 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.246436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25b383d3-3559-4dbb-92b0-74a06816c076 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.367825 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25b383d3-3559-4dbb-92b0-74a06816c076 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/407223446" status: 202 len: 0 microversion: 2.1 time: 0.127665 Feb 12 21:03:13.377719 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 229/442] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:13 2022] DELETE /compute/v2.1/flavors/407223446 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:13.385336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.386506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:13.400909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:13.402471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:13.403289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:13.403743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:13.672951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:13.684639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:13.699738 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df6d5c22-a9df-4782-a3e5-cbf14c8f62e8 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.317307 Feb 12 21:03:13.700351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-75df6736-f2c3-4536-8944-6f9863425b97 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1474 microversion: 2.1 time: 0.606245 Feb 12 21:03:13.728248 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 214/443] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1474 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:13.728896 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 230/444] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.736979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce5369ce-5b49-47b1-a78d-64e5b1ea00e9 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.772080 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce5369ce-5b49-47b1-a78d-64e5b1ea00e9 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.040633 Feb 12 21:03:13.772900 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 231/445] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.787893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0a5e2595-0163-4a94-8cdc-b382d0193343 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.788902 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:13.788902 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:13.899665 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0a5e2595-0163-4a94-8cdc-b382d0193343 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/177019247" status: 202 len: 0 microversion: 2.1 time: 0.115476 Feb 12 21:03:13.900584 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 215/446] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:13 2022] DELETE /compute/v2.1/flavors/177019247 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:13.909578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95769b0a-0a72-425f-882b-547e21de1206 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:13.931901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-95769b0a-0a72-425f-882b-547e21de1206 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.026923 Feb 12 21:03:13.932899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 232/447] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:13 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:13.955671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d19fbb45-8c32-4045-a1ec-1c22a3169f90 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1389422575", "id": 1689785314, "os-flavor-access:is_public": "False"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:13.958329 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:13.958329 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:14.038242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d19fbb45-8c32-4045-a1ec-1c22a3169f90 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.089277 Feb 12 21:03:14.038944 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 216/448] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:13 2022] POST /compute/v2.1/flavors => generated 415 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:14.044372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.044372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:14.051526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.052070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.052953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.053481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.124682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:14.132589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1078891132", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "0eed6e37-8043-4850-b995-a80bb2fd1c53"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:14.133591 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c6efb96d-083f-4f38-9a27-a454ff0554cb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1214 microversion: 2.1 time: 0.093516 Feb 12 21:03:14.134209 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 217/449] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:14.138700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41fd9144-b2ea-4ef8-aa6e-21e1d6e42393 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.204734 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41fd9144-b2ea-4ef8-aa6e-21e1d6e42393 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.067735 Feb 12 21:03:14.215347 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 218/450] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:14.221071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b8d3b6db-7ba3-4fe6-955c-afe412905a3c tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.243715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] validate_networks() for [('0eed6e37-8043-4850-b995-a80bb2fd1c53', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:14.246048 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b8d3b6db-7ba3-4fe6-955c-afe412905a3c tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.029256 Feb 12 21:03:14.246840 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 219/451] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:14.263886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c8fae3ea-1243-41ed-94ff-5d7decd9935b tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.265415 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:14.265415 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:14.345218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c8fae3ea-1243-41ed-94ff-5d7decd9935b tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1689785314" status: 202 len: 0 microversion: 2.1 time: 0.085779 Feb 12 21:03:14.345933 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 220/452] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:14 2022] DELETE /compute/v2.1/flavors/1689785314 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:14.355126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0bebb6bf-90d5-4fa6-923a-b0b46e7c8e06 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.385842 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0bebb6bf-90d5-4fa6-923a-b0b46e7c8e06 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.035335 Feb 12 21:03:14.386435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 221/453] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:14.409659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b927d2b-10fe-49e8-b427-96405613e6a4 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-515925537", "id": 449564605, "os-flavor-access:is_public": "True"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:14.411998 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:14.411998 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:14.532966 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b927d2b-10fe-49e8-b427-96405613e6a4 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.131286 Feb 12 21:03:14.539772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 222/454] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:14 2022] POST /compute/v2.1/flavors => generated 410 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:14.546751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fd82cf9c-dbf0-40be-868c-963fec4d125a tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.595954 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fd82cf9c-dbf0-40be-868c-963fec4d125a tempest-FlavorsAdminTestJSON-1481528320 tempest-FlavorsAdminTestJSON-1481528320-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.054476 Feb 12 21:03:14.596799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 223/455] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:14.612540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3cdbb495-5180-49c2-8801-14e45e5d7604 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.687750 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3cdbb495-5180-49c2-8801-14e45e5d7604 tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/449564605" status: 202 len: 0 microversion: 2.1 time: 0.078915 Feb 12 21:03:14.691489 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 224/456] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:14 2022] DELETE /compute/v2.1/flavors/449564605 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:14.695983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2457488f-116c-430f-a187-699c7a676c3d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.711666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:14.712548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:14.713397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:14.714002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:14.714612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:14.718852 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2457488f-116c-430f-a187-699c7a676c3d tempest-FlavorsAdminTestJSON-484927454 tempest-FlavorsAdminTestJSON-484927454-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.026229 Feb 12 21:03:14.719528 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 225/457] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:14.742005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.742467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.743274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.743707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.751356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.752186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:14.768963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.769387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Getting quotas for project c83d16b9025244b1af9db6745cab9163. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:14.769622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.770504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.770882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.774014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Getting quotas for user 8b726bab201a4d8f8e69c35ae5e1b815 and project c83d16b9025244b1af9db6745cab9163. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:14.786799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:14.789218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:14.937425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:14.946620 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05315723-5e1c-4b0b-83fc-595acb69ad84 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.208322 Feb 12 21:03:14.953737 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 226/458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:14.960183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:14.960755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:14.964572 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e875929d-2174-4c01-9cd3-82b0d42cf149 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972197 Feb 12 21:03:14.965801 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 233/459] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:03:14.968550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.969060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.970141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.970766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:14.972973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-48a25add-44fc-408d-a4a3-69fa1ad03aeb req-36da750d-cf3a-4308-b8c2-fdf46caac30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb70780-dfdd-41df-8b16-34776dae9ee5", "name": "network-vif-unplugged", "status": "completed", "tag": "7fe731ff-5471-4420-a35a-07898901b4d0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:14.976593 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:14.976593 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:14.988159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-48a25add-44fc-408d-a4a3-69fa1ad03aeb req-36da750d-cf3a-4308-b8c2-fdf46caac30d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:14.989055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-48a25add-44fc-408d-a4a3-69fa1ad03aeb req-36da750d-cf3a-4308-b8c2-fdf46caac30d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:15.007479 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-48a25add-44fc-408d-a4a3-69fa1ad03aeb req-36da750d-cf3a-4308-b8c2-fdf46caac30d service nova] Creating event network-vif-unplugged:7fe731ff-5471-4420-a35a-07898901b4d0 for instance cdb70780-dfdd-41df-8b16-34776dae9ee5 on nch2-master-1 Feb 12 21:03:15.023004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-48a25add-44fc-408d-a4a3-69fa1ad03aeb req-36da750d-cf3a-4308-b8c2-fdf46caac30d service nova] Instance cdb70780-dfdd-41df-8b16-34776dae9ee5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:03:15.039420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-48a25add-44fc-408d-a4a3-69fa1ad03aeb req-36da750d-cf3a-4308-b8c2-fdf46caac30d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071977 Feb 12 21:03:15.040024 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 234/460] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:15.045026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8aa1e9e7-0e64-4125-8e5c-c9049dab5d08 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:15.046325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8aa1e9e7-0e64-4125-8e5c-c9049dab5d08 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:15.117221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8aa1e9e7-0e64-4125-8e5c-c9049dab5d08 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:15.143433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8aa1e9e7-0e64-4125-8e5c-c9049dab5d08 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1217 microversion: 2.1 time: 0.101970 Feb 12 21:03:15.144021 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 235/461] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:15 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:15.162874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:15.169631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:15.187798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:15.188317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:15.189149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:15.189601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:15.295900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:15.304374 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fbd30406-6771-43ef-ace9-eff6b445c65f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1473 microversion: 2.1 time: 0.348073 Feb 12 21:03:15.309691 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 227/462] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:14 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:15.340706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:15.350256 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e42062cb-4834-456e-85c2-21d1a0c4e760 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1262 microversion: 2.1 time: 0.198905 Feb 12 21:03:15.351777 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 236/463] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:15 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1262 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:15.964880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:15.966249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:15.975947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:15.976404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:15.980405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:15.982756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:16.093977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-419938521", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:16.205097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:16.620978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:16.621856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:16.622744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:16.623413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:16.624140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:16.634397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:16.635067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:16.636227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:16.637218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:16.651124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:16.661184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Getting quotas for project 7203bbecaaef4f3ba3ff7f46109eaff9. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:16.666467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Getting quotas for user 9b832260e76e44c6a35fa2402160d0ef and project 7203bbecaaef4f3ba3ff7f46109eaff9. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:16.669343 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36d764e3-e7dd-41dc-849b-274fbb5f13bc tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.707283 Feb 12 21:03:16.671856 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 237/464] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:15 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:16.678527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:16.679289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:16.687983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:16.689335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:16.691350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:16.696500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:16.696500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:16.697367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:16.817782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:16.825301 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66fde342-a6b8-4202-a51b-0de940530ffd tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1221 microversion: 2.1 time: 0.151298 Feb 12 21:03:16.826183 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 238/465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:16 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:16.901853 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65c5103e-d19e-4316-ac39-efb2d01104a2 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094896 Feb 12 21:03:16.902920 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 228/466] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:16.912340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:16.913511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:16.925556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:16.925556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:16.926342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:16.926957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.036981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Calling method '.version_select at 0x7fa8fe7e7940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.039866 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:17.039866 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:17.041900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.042363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.089294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.089868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.154140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.155518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.170871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.171707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.194320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:17.198158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.198607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.203180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b379d5e-64eb-4f39-9643-9672d8c5eb68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1471 microversion: 2.1 time: 0.299010 Feb 12 21:03:17.203749 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 229/467] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:16 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:17.206403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f8074066-86d6-426f-838b-8d0af83b18ce tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.378358 Feb 12 21:03:17.209087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.212695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:17.216490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 239/468] 10.222.0.31 () {60 vars in 1242 bytes} [Sat Feb 12 21:03:16 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:03:17.216807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.217541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.219276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.219802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.221001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59f14a85-9993-490a-bc49-fc21d20cc42a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.221652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59f14a85-9993-490a-bc49-fc21d20cc42a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:17.276469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-59f14a85-9993-490a-bc49-fc21d20cc42a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:17.284340 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59f14a85-9993-490a-bc49-fc21d20cc42a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1218 microversion: 2.1 time: 0.066739 Feb 12 21:03:17.285084 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 240/469] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:17 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:17.291015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-487c0cc8-3caa-44c4-b60b-ea29f8e19ed5 req-b27f2732-9776-40fd-a85a-df2780ebccce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb70780-dfdd-41df-8b16-34776dae9ee5", "tag": "7fe731ff-5471-4420-a35a-07898901b4d0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:17.292545 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:17.292545 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:17.300801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-487c0cc8-3caa-44c4-b60b-ea29f8e19ed5 req-b27f2732-9776-40fd-a85a-df2780ebccce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.301450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-487c0cc8-3caa-44c4-b60b-ea29f8e19ed5 req-b27f2732-9776-40fd-a85a-df2780ebccce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.318420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-487c0cc8-3caa-44c4-b60b-ea29f8e19ed5 req-b27f2732-9776-40fd-a85a-df2780ebccce service nova] Creating event network-changed:7fe731ff-5471-4420-a35a-07898901b4d0 for instance cdb70780-dfdd-41df-8b16-34776dae9ee5 on nch2-master-1 Feb 12 21:03:17.324401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-487c0cc8-3caa-44c4-b60b-ea29f8e19ed5 req-b27f2732-9776-40fd-a85a-df2780ebccce service nova] Instance cdb70780-dfdd-41df-8b16-34776dae9ee5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:03:17.335939 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-487c0cc8-3caa-44c4-b60b-ea29f8e19ed5 req-b27f2732-9776-40fd-a85a-df2780ebccce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049503 Feb 12 21:03:17.336545 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 241/470] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:17.341719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Calling method '.version_select at 0x7fa8fe737160>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.344320 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:17.344320 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:17.346323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.347153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.363931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.364558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.398035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.398787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.411675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.414053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.437328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:17.438168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.439164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.448597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fd77e20-c019-415a-9fed-8a1ed5a72636 tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.109436 Feb 12 21:03:17.452198 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6999e755-2c85-4135-8f7e-d8e45ec630a2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.246689 Feb 12 21:03:17.453069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 230/471] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:17 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:17.456378 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 242/472] 10.222.0.31 () {60 vars in 1221 bytes} [Sat Feb 12 21:03:17 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:03:17.460863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a3c87ac-0306-41fa-bcbe-3abf979f879e tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Calling method '.version_select at 0x7fa904164a60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.462112 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:17.462112 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:17.468355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3c87ac-0306-41fa-bcbe-3abf979f879e tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.468355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3c87ac-0306-41fa-bcbe-3abf979f879e tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.505195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3c87ac-0306-41fa-bcbe-3abf979f879e tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.505923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3c87ac-0306-41fa-bcbe-3abf979f879e tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.515234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a3c87ac-0306-41fa-bcbe-3abf979f879e tempest-HypervisorAdminV253TestBase-658208045 tempest-HypervisorAdminV253TestBase-658208045-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/6d0bab03-eecc-4311-a3dd-dd8b734cd681" status: 200 len: 792 microversion: 2.53 time: 0.057883 Feb 12 21:03:17.516438 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 231/473] 10.222.0.31 () {60 vars in 1297 bytes} [Sat Feb 12 21:03:17 2022] GET /compute/v2.1/os-hypervisors/6d0bab03-eecc-4311-a3dd-dd8b734cd681 => generated 792 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:03:17.695485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.696718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:17.716172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.718992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.729129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ab4391b6-1c48-4be0-924e-035e80040f70 req-65ed934d-3f1f-4221-887f-4fdaa32a1b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfc153c-f638-4c53-b728-a2b9ed7b8d37", "name": "network-vif-plugged", "status": "completed", "tag": "f3148623-80dd-4c7e-bf9b-5e8808871e70"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:17.730754 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:17.730754 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:17.736915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.737392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.739345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ab4391b6-1c48-4be0-924e-035e80040f70 req-65ed934d-3f1f-4221-887f-4fdaa32a1b56 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.740188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ab4391b6-1c48-4be0-924e-035e80040f70 req-65ed934d-3f1f-4221-887f-4fdaa32a1b56 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.752668 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ab4391b6-1c48-4be0-924e-035e80040f70 req-65ed934d-3f1f-4221-887f-4fdaa32a1b56 service nova] Creating event network-vif-plugged:f3148623-80dd-4c7e-bf9b-5e8808871e70 for instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 on nch2-master-1 Feb 12 21:03:17.759568 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ab4391b6-1c48-4be0-924e-035e80040f70 req-65ed934d-3f1f-4221-887f-4fdaa32a1b56 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 Feb 12 21:03:17.760666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 232/474] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:17.843875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:17.855578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:17.855578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.855578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.855578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:17.856358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:17.981810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:17.994873 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88da3977-dcc7-4c3e-af27-687f8fb0ab58 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1269 microversion: 2.1 time: 0.154939 Feb 12 21:03:18.006237 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 233/475] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:17 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:18.220214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:18.220817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:18.227241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:18.228566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:18.228566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:18.230502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:18.239977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:18.247827 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad5156ca-cc50-4cfa-90af-20d6e82a9b1c tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.563744 Feb 12 21:03:18.249184 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 243/476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:17 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:18.301654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a9e875ae-cfa8-4095-a49a-d6b7e3720a9d tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:18.302597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a9e875ae-cfa8-4095-a49a-d6b7e3720a9d tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:18.449457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a9e875ae-cfa8-4095-a49a-d6b7e3720a9d tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:18.476036 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a9e875ae-cfa8-4095-a49a-d6b7e3720a9d tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1218 microversion: 2.1 time: 0.178172 Feb 12 21:03:18.476702 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 244/477] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:18 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:18.496626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:18.499289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:18.508806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:18.509258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:18.510288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:18.510721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:18.555607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:18.568505 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df6b0fdb-c359-458c-8d04-d70b09a75ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1471 microversion: 2.1 time: 0.352072 Feb 12 21:03:18.569779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 234/478] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:18 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:19.013511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:19.016740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:19.027160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.027994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.029021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.030226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.032850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:19.042584 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-65ff093d-f313-42f0-a321-03978bb06753 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.558817 Feb 12 21:03:19.052135 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 245/479] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:18 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:19.132371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:19.146365 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1af1502d-2871-40df-96df-7cbbd2ab3b4c tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1275 microversion: 2.1 time: 0.137119 Feb 12 21:03:19.146980 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 235/480] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:19 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:19.267030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:19.267647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:19.276507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.276954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.278648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.279080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.288307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ec7e9433-ba6b-4ace-a961-a098e5a26f6e req-824a4355-b97a-45b1-9479-71a9bb424993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c8f616-0ac8-49ea-8569-b8e0e83a636a", "tag": "c3effa86-57bb-42fc-8e61-cc0f745f1657"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:19.292412 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:19.292412 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:19.302852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ec7e9433-ba6b-4ace-a961-a098e5a26f6e req-824a4355-b97a-45b1-9479-71a9bb424993 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.303626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ec7e9433-ba6b-4ace-a961-a098e5a26f6e req-824a4355-b97a-45b1-9479-71a9bb424993 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.316668 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ec7e9433-ba6b-4ace-a961-a098e5a26f6e req-824a4355-b97a-45b1-9479-71a9bb424993 service nova] Creating event network-changed:c3effa86-57bb-42fc-8e61-cc0f745f1657 for instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a on nch2-master-1 Feb 12 21:03:19.321996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ec7e9433-ba6b-4ace-a961-a098e5a26f6e req-824a4355-b97a-45b1-9479-71a9bb424993 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038720 Feb 12 21:03:19.323243 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 236/481] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:19.495479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:19.497857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:19.507253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.509931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.509931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.509931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.587237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:19.599014 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0695fe20-6553-4c3b-9935-d6ee44ad9f8b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1270 microversion: 2.1 time: 0.108944 Feb 12 21:03:19.600581 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 237/482] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:19 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:19.606368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:19.607256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:19.614838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.615399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.616371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.616809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.925808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:19.933398 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa8efe97-caed-4f85-a214-410ae34209ba tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1468 microversion: 2.1 time: 0.330876 Feb 12 21:03:19.934011 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 238/483] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:19 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1468 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:19.951189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:19.952287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:19.959010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.959459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.960245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:19.960678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:19.993818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:20.024128 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a50fc86-2f0c-4395-8148-939535b25827 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1332 microversion: 2.1 time: 0.760686 Feb 12 21:03:20.038070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 246/484] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:19 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1332 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:20.063920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:20.064871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:20.077748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.086783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.087936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.088570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.195892 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60614d1c-a8da-4668-a976-021e118d3b78 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5/action" status: 204 len: 0 microversion: 2.1 time: 0.249065 Feb 12 21:03:20.196585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 239/485] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:19 2022] POST /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5/action => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:03:20.216416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:20.217983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:20.226265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.227501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.228335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.228814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.374723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:20.386044 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b3f570fc-6d18-41e4-804e-0b876984b1d7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1275 microversion: 2.1 time: 0.187915 Feb 12 21:03:20.387417 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 240/486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:20 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:20.392964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:20.394010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:20.408329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.409165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.410201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.411112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.684538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:20.697116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7108043-139f-407b-bfe2-d3ad12b40544 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.640816 Feb 12 21:03:20.698414 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 247/487] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:20 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:20.705207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:20.712940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:20.713799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:20.715338 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df5ed0b4-bedb-4a4b-a0c0-85b1c12617f8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1468 microversion: 2.1 time: 0.326104 Feb 12 21:03:20.721587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.722044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.722853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:20.723295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:20.724264 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 241/488] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:20 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:20.906001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:20.923056 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe6c29ec-d21b-42b0-acbe-7644b92f61a9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1276 microversion: 2.1 time: 0.221820 Feb 12 21:03:20.925318 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 248/489] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:20 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:21.043893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:21.044500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:21.057630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:21.058397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:21.059432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:21.060399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:21.402897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:21.403995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:21.411868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:21.412673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:21.413736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:21.414381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:21.437570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:21.445183 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c3be7b8-7e95-4488-bf26-0ac631486dd9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1536 microversion: 2.1 time: 0.404887 Feb 12 21:03:21.448743 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 242/490] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:21 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1536 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:21.471146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37b9f764-40c7-416d-befd-97c7716f3205 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'create', calling method: .version_select at 0x7fa904146dc0>, body: {"pool": "7cc7114b-c087-413f-bd63-e2248ab8f781"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:21.851691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:21.867317 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d84505c6-b335-4b19-90f0-61dbcf3a9cf3 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.466771 Feb 12 21:03:21.880450 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 249/491] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:21 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:21.888050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:21.890809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:21.899887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:21.901629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:21.903418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:21.904155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:22.236446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:22.243903 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef102964-654c-4de2-ba75-0e3248ce4c15 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.362280 Feb 12 21:03:22.244484 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 250/492] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:21 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:22.252754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:22.267820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:22.274238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:22.274764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:22.275652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:22.276164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:22.560197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:22.568114 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4643dc02-6442-49af-b859-e5ce5a5fc236 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1468 microversion: 2.1 time: 0.319635 Feb 12 21:03:22.577743 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 251/493] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:22 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:22.583664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:22.584281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:22.590391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:22.591020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:22.593935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:22.594731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:22.961023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:22.970048 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04f64af2-f7eb-4fcd-927d-f9a28f108313 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.391125 Feb 12 21:03:22.970631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 252/494] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:22 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:22.985527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-40c05d99-3439-4e2d-b0bf-536f748bcced req-2ffc9e67-173b-4e16-8f2f-453ca052f041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb70780-dfdd-41df-8b16-34776dae9ee5", "name": "network-vif-plugged", "status": "completed", "tag": "7fe731ff-5471-4420-a35a-07898901b4d0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:22.987231 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:22.987231 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:22.997218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-40c05d99-3439-4e2d-b0bf-536f748bcced req-2ffc9e67-173b-4e16-8f2f-453ca052f041 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:22.997842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-40c05d99-3439-4e2d-b0bf-536f748bcced req-2ffc9e67-173b-4e16-8f2f-453ca052f041 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:23.011597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-40c05d99-3439-4e2d-b0bf-536f748bcced req-2ffc9e67-173b-4e16-8f2f-453ca052f041 service nova] Creating event network-vif-plugged:7fe731ff-5471-4420-a35a-07898901b4d0 for instance cdb70780-dfdd-41df-8b16-34776dae9ee5 on nch2-master-1 Feb 12 21:03:23.036026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-40c05d99-3439-4e2d-b0bf-536f748bcced req-2ffc9e67-173b-4e16-8f2f-453ca052f041 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055172 Feb 12 21:03:23.036935 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 253/495] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:23.041890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:23.042601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:23.055731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:23.060281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:23.060281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:23.060281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:23.667345 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37b9f764-40c7-416d-befd-97c7716f3205 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.205069 Feb 12 21:03:23.670287 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 243/496] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:03:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:03:23.727740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:23.737683 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2455a525-6d5d-48a7-a438-c7c9d67339d6 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.699364 Feb 12 21:03:23.738386 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 254/497] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:23 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:23.744071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7c5e9104-5256-48e2-8b26-85cdd026b01a req-c51d930b-2a3c-423a-82f7-a1d918dedf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdef2d8-833d-43c2-b10b-8ef367b63a3b", "tag": "2c833eba-0a02-439d-bc70-890fa6352eef"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:23.747510 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:23.747510 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:23.758491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7c5e9104-5256-48e2-8b26-85cdd026b01a req-c51d930b-2a3c-423a-82f7-a1d918dedf46 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:23.759594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7c5e9104-5256-48e2-8b26-85cdd026b01a req-c51d930b-2a3c-423a-82f7-a1d918dedf46 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:23.774286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7c5e9104-5256-48e2-8b26-85cdd026b01a req-c51d930b-2a3c-423a-82f7-a1d918dedf46 service nova] Creating event network-changed:2c833eba-0a02-439d-bc70-890fa6352eef for instance 2bdef2d8-833d-43c2-b10b-8ef367b63a3b on nch1-master-1 Feb 12 21:03:23.781491 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7c5e9104-5256-48e2-8b26-85cdd026b01a req-c51d930b-2a3c-423a-82f7-a1d918dedf46 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 Feb 12 21:03:23.782762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 255/498] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:23.795979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:23.797096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:23.805163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:23.805846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:23.807421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:23.808069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:23.958533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3db364a2-dbc3-4dd4-8eeb-ffc9c4f63d75 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1605254208", "id": 1086731493, "os-flavor-access:is_public": "False"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:23.960196 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:23.960196 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:24.036516 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3db364a2-dbc3-4dd4-8eeb-ffc9c4f63d75 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.366408 Feb 12 21:03:24.037310 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 244/499] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:23 2022] POST /compute/v2.1/flavors => generated 439 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:24.041499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:24.042128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:24.048678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.049139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.049959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.050426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.189279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:24.191090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:24.204769 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ae5eccf-d0a2-4856-977e-66e0dfb4d298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.414322 Feb 12 21:03:24.205255 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d7322c82-b9d6-48db-a5d2-6c93e94d4e66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1460 microversion: 2.1 time: 0.166563 Feb 12 21:03:24.205419 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 256/500] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:23 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:24.206261 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 245/501] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:24 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1460 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:24.213261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'action', calling method: .version_select at 0x7fa905250160>, body: {"addFloatingIp": {"address": "172.35.2.233"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:24.215421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:24.222718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.223174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.223967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.224393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.297251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Acquired lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:03:24.362046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9924c7d3-9182-4f4e-bc8e-1b7a594bde1a tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Calling method '.version_select at 0x7fa90409de50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:24.363206 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:24.363206 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:24.365205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9924c7d3-9182-4f4e-bc8e-1b7a594bde1a tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '3b1a9dfa6eb546b297d8c5c904aefd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4a93a7a8a24ae999340d4be8ab5a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:24.366158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9924c7d3-9182-4f4e-bc8e-1b7a594bde1a tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:24.367565 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9924c7d3-9182-4f4e-bc8e-1b7a594bde1a tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.160028 Feb 12 21:03:24.368176 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 246/502] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 21:03:24 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:24.372476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:24.373258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:24.381063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.381836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.382778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.383410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.541131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:24.550958 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-956f7075-5093-436e-bbda-519856364cfc tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.181718 Feb 12 21:03:24.551533 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 247/503] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:24 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:24.555920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49bcc742-e7c0-4beb-bc08-b3502f87ae5e tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:24.557467 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:24.557467 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:24.694129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49bcc742-e7c0-4beb-bc08-b3502f87ae5e tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1086731493/action" status: 200 len: 97 microversion: 2.1 time: 0.141422 Feb 12 21:03:24.694782 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 248/504] 10.222.0.31 () {60 vars in 1199 bytes} [Sat Feb 12 21:03:24 2022] POST /compute/v2.1/flavors/1086731493/action => generated 97 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:24.706483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:24.707091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:24.713900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.714357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.715153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.715600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.850400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32b74ba0-e378-4185-960b-f2d2edebca12 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1611 microversion: 2.1 time: 0.154613 Feb 12 21:03:24.851023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 249/505] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:24 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:24.855734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad2f3df5-9710-4cd8-9083-084cc5d13ec4 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Calling method '.version_select at 0x7fa90443b790>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:24.856540 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:24.856540 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:24.858837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ad2f3df5-9710-4cd8-9083-084cc5d13ec4 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '3b1a9dfa6eb546b297d8c5c904aefd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4a93a7a8a24ae999340d4be8ab5a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:24.859696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad2f3df5-9710-4cd8-9083-084cc5d13ec4 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:24.860494 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad2f3df5-9710-4cd8-9083-084cc5d13ec4 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008089 Feb 12 21:03:24.861291 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 250/506] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:24 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:24.865983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f0263daf-e1e3-4752-90ea-f9ab89a51131 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:24.871891 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:24.871891 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:24.966872 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f0263daf-e1e3-4752-90ea-f9ab89a51131 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project d774dd8a2f364fb6aa9a356761e08193 combination. Feb 12 21:03:24.972216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f0263daf-e1e3-4752-90ea-f9ab89a51131 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project d774dd8a2f364fb6aa9a356761e08193 combination. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:24.972216 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f0263daf-e1e3-4752-90ea-f9ab89a51131 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1086731493/action" status: 409 len: 152 microversion: 2.1 time: 0.105854 Feb 12 21:03:24.972216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 251/507] 10.222.0.31 () {60 vars in 1199 bytes} [Sat Feb 12 21:03:24 2022] POST /compute/v2.1/flavors/1086731493/action => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:24.973823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:24.974481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:24.981019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.981491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:24.982267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:24.983258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.136265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:25.152528 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93db885c-87ea-4b6b-a7e9-120cd0100762 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.181968 Feb 12 21:03:25.164036 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 252/508] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:24 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:25.169184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d156963-569b-4eca-83bd-bf3f9fb91db0 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Calling method '.version_select at 0x7fa904055d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:25.170699 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:25.170699 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:25.172361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d156963-569b-4eca-83bd-bf3f9fb91db0 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '3b1a9dfa6eb546b297d8c5c904aefd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4a93a7a8a24ae999340d4be8ab5a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:25.173021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d156963-569b-4eca-83bd-bf3f9fb91db0 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:25.173937 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d156963-569b-4eca-83bd-bf3f9fb91db0 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008638 Feb 12 21:03:25.180365 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 253/509] 10.222.0.31 () {58 vars in 1178 bytes} [Sat Feb 12 21:03:25 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:25.186356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-97434e93-34c8-44a3-884b-7346a42db913 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '.version_select at 0x7fa9040c4af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:25.186356 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:25.186356 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:25.188651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-97434e93-34c8-44a3-884b-7346a42db913 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.189108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-97434e93-34c8-44a3-884b-7346a42db913 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.198789 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-97434e93-34c8-44a3-884b-7346a42db913 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.022196 Feb 12 21:03:25.211536 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 254/510] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:03:25 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:25.211536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27d0f465-933b-45b2-bb18-d387e1373ca6 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:25.211536 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:25.211536 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:25.390315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27d0f465-933b-45b2-bb18-d387e1373ca6 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1086731493/action" status: 200 len: 21 microversion: 2.1 time: 0.189088 Feb 12 21:03:25.391012 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 255/511] 10.222.0.31 () {60 vars in 1199 bytes} [Sat Feb 12 21:03:25 2022] POST /compute/v2.1/flavors/1086731493/action => generated 21 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:25.444703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Calling method '.version_select at 0x7fa90444b940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:25.445578 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:25.445578 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:25.447052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.447519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.463478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.463910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.477840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.478085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.485865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-091965b3-2534-40cd-9037-b2ce589352a0 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093435 Feb 12 21:03:25.491324 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 256/512] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:25.495466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:25.496265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:25.503299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.503752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.504695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.505134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.653499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:25.662144 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d61e75c-a898-4b4c-9ecc-d98edc530ce5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.174079 Feb 12 21:03:25.663033 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 257/513] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:25 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:25.668569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-930077605", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:25.728676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:25.965531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:25.965962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:25.966440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:25.967096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:25.967328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:25.978913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.980241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.980241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:25.980802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:25.999506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:26.004157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for user 424f5011a4ef40c48465523369eab808 and project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:26.016846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:26.019253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:26.214173 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0573507-c4f4-4313-8d4f-4d497cdb7e7a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549828 Feb 12 21:03:26.215056 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 258/514] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:26.219899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a629f02-3815-4194-bdc0-986258dc174f tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:26.220661 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:26.220661 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:26.343840 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a629f02-3815-4194-bdc0-986258dc174f tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1086731493" status: 202 len: 0 microversion: 2.1 time: 0.127510 Feb 12 21:03:26.344862 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 259/515] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:26 2022] DELETE /compute/v2.1/flavors/1086731493 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:26.350112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f19c97a-501f-4e56-b35a-9ec4cab77003 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Calling method '.version_select at 0x7fa9040559d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:26.350910 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:26.350910 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:26.352219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f19c97a-501f-4e56-b35a-9ec4cab77003 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '3b1a9dfa6eb546b297d8c5c904aefd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4a93a7a8a24ae999340d4be8ab5a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:26.352905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f19c97a-501f-4e56-b35a-9ec4cab77003 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:26.353780 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f19c97a-501f-4e56-b35a-9ec4cab77003 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.007236 Feb 12 21:03:26.359914 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 260/516] 10.222.0.31 () {58 vars in 1172 bytes} [Sat Feb 12 21:03:26 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:26.364111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:26.364777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:26.372378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:26.372832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:26.374367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:26.374969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:26.518649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:26.526409 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-489b91dc-d9dd-42fe-84c7-ad6793ad7843 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.169982 Feb 12 21:03:26.527048 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 261/517] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:26 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:26.531683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:26.532284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:26.538370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:26.538892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:26.539758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:26.540260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:26.566826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:03:26.620930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Building network info cache for instance {{(pid=141726) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:03:26.974172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f42b9246-48d4-4f40-92ef-4d733a45ed72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 204 len: 0 microversion: 2.1 time: 0.445757 Feb 12 21:03:26.974777 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 262/518] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:26 2022] DELETE /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:03:26.980104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-55254b88-2d48-464b-a5ab-a6edb9fadc9e req-5d45919b-75ac-450b-9069-e9feab132c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7", "tag": "3e469e4d-bd4c-43d8-966a-65aac1e95ee8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:26.981682 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:26.981682 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:26.989720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-55254b88-2d48-464b-a5ab-a6edb9fadc9e req-5d45919b-75ac-450b-9069-e9feab132c33 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:26.990212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-55254b88-2d48-464b-a5ab-a6edb9fadc9e req-5d45919b-75ac-450b-9069-e9feab132c33 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.011567 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-55254b88-2d48-464b-a5ab-a6edb9fadc9e req-5d45919b-75ac-450b-9069-e9feab132c33 service nova] Creating event network-changed:3e469e4d-bd4c-43d8-966a-65aac1e95ee8 for instance 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 on nch1-master-1 Feb 12 21:03:27.018039 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-55254b88-2d48-464b-a5ab-a6edb9fadc9e req-5d45919b-75ac-450b-9069-e9feab132c33 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041435 Feb 12 21:03:27.018702 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 263/519] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:27.023196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:27.023886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:27.030724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.031188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.031967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.032595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.211826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:27.584431 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a8357df-8f23-404a-8123-39e3f8f6f899 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.202742 Feb 12 21:03:27.584431 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 264/520] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:27 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:27.584431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:27.584431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:27.584431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.585993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.585993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.585993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.586344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:27.586344 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d7919383-525c-48e9-97d0-228f4e289be0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1216 microversion: 2.1 time: 0.087461 Feb 12 21:03:27.586344 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 265/521] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:27 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:27.586344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cc41bac0-a9c6-42e2-9a79-79dc794b50b6 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:27.586788 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cc41bac0-a9c6-42e2-9a79-79dc794b50b6 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.024176 Feb 12 21:03:27.586788 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 266/522] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:27 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:27.586788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7bd392b-767b-4c7d-ae28-894aafe4458f tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Calling method '.version_select at 0x7fa9040d73a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:27.586788 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:27.586788 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:27.586788 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a7bd392b-767b-4c7d-ae28-894aafe4458f tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] HTTP exception thrown: Hypervisor with ID 'e07c542b-3246-474a-9934-dd059aac0db3' could not be found. Feb 12 21:03:27.587330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7bd392b-767b-4c7d-ae28-894aafe4458f tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Returning 404 to user: Hypervisor with ID 'e07c542b-3246-474a-9934-dd059aac0db3' could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:27.587330 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7bd392b-767b-4c7d-ae28-894aafe4458f tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/e07c542b-3246-474a-9934-dd059aac0db3/uptime" status: 404 len: 123 microversion: 2.1 time: 0.007268 Feb 12 21:03:27.587330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 267/523] 10.222.0.31 () {58 vars in 1277 bytes} [Sat Feb 12 21:03:27 2022] GET /compute/v2.1/os-hypervisors/e07c542b-3246-474a-9934-dd059aac0db3/uptime => generated 123 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:27.587330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:27.587330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:27.587836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.587836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.587836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.587836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.588265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Updating instance_info_cache with network_info: [{"id": "f3148623-80dd-4c7e-bf9b-5e8808871e70", "address": "fa:16:3e:b1:4c:47", "network": {"id": "00db7637-715c-44c7-a356-d7a146fc856c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1484278550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65e530a89835494485cff388fdc9d69b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf3148623-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:03:27.588475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:27.588475 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c564f76-d6b8-4a64-a670-c4c1d3b48797 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.176495 Feb 12 21:03:27.588475 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 268/524] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:27 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:27.588849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-361223285", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "772016053", "adminPass": "***", "networks": [{"uuid": "b9b58e18-4724-4374-98c5-14f3d3ee43a0"}], "security_groups": [{"name": "tempest-securitygroup--1079256265"}], "key_name": "tempest-keypair-1862670838", "user_data": "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:27.683920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] validate_networks() for [('b9b58e18-4724-4374-98c5-14f3d3ee43a0', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:27.932505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Releasing lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:03:27.933573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ffa918a-890b-4878-a166-afad2d3e71b4 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action" status: 202 len: 0 microversion: 2.1 time: 3.727121 Feb 12 21:03:27.934613 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 257/525] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:24 2022] POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action => generated 0 bytes in 3729 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:03:27.941200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:27.942160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:27.950151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.950697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:27.952860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:27.953329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.108248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:28.108899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:28.110030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:28.110030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:28.110590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:28.128345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.128903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.130047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.130324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.138473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:28.150212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:28.150472 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f89636a-2f29-432a-aa4f-2369a7ee79f0 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.213827 Feb 12 21:03:28.151744 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 258/526] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:27 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:28.157429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Calling method '.version_select at 0x7fa8fe600dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.158330 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.158330 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:28.159829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.160278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.167215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Getting quotas for user daeed6cf1bbe4a8995815673f0866266 and project 0c59817262e9431fa88f725ab4b5f7a3. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:28.182295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.182933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:28.183172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.188914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:28.197606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.198116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.206578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92702944-ea04-4438-9296-2c9bd33a1d07 tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053615 Feb 12 21:03:28.207449 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 259/527] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:28.212294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76015fad-7b76-4649-8b9f-d41464bca4cc tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-511019383", "id": 144336997, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:28.214061 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.214061 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:28.287697 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76015fad-7b76-4649-8b9f-d41464bca4cc tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.079294 Feb 12 21:03:28.288300 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 260/528] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:28 2022] POST /compute/v2.1/flavors => generated 434 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:28.298256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c916de11-fb6d-4edd-a908-6d5e95b526c3 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'create', calling method: .version_select at 0x7fa904054160>, body: {"pool": "7cc7114b-c087-413f-bd63-e2248ab8f781"} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:28.367549 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50872f33-f04b-4825-bada-c922c4935601 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.834775 Feb 12 21:03:28.368470 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 269/529] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:28.374341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-56ee35a2-fe3c-4203-9c8f-b879483d447e req-03a2763c-1f00-4ebf-8bda-412352f2e7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c8f616-0ac8-49ea-8569-b8e0e83a636a", "name": "network-vif-plugged", "status": "completed", "tag": "c3effa86-57bb-42fc-8e61-cc0f745f1657"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:28.378897 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.378897 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:28.386266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-56ee35a2-fe3c-4203-9c8f-b879483d447e req-03a2763c-1f00-4ebf-8bda-412352f2e7ea service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.386517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-56ee35a2-fe3c-4203-9c8f-b879483d447e req-03a2763c-1f00-4ebf-8bda-412352f2e7ea service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.401781 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-56ee35a2-fe3c-4203-9c8f-b879483d447e req-03a2763c-1f00-4ebf-8bda-412352f2e7ea service nova] Creating event network-vif-plugged:c3effa86-57bb-42fc-8e61-cc0f745f1657 for instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a on nch2-master-1 Feb 12 21:03:28.408210 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-56ee35a2-fe3c-4203-9c8f-b879483d447e req-03a2763c-1f00-4ebf-8bda-412352f2e7ea service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038403 Feb 12 21:03:28.409622 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 270/530] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:28.414597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-474f0a35-00f1-417e-9ba3-52f8f1176815 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Calling method '.version_select at 0x7fa90409de50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.415702 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.415702 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:28.417056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-474f0a35-00f1-417e-9ba3-52f8f1176815 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '3b1a9dfa6eb546b297d8c5c904aefd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4a93a7a8a24ae999340d4be8ab5a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:28.417731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-474f0a35-00f1-417e-9ba3-52f8f1176815 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:28.418523 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-474f0a35-00f1-417e-9ba3-52f8f1176815 tempest-HypervisorAdminNegativeTestJSON-869235333 tempest-HypervisorAdminNegativeTestJSON-869235333-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.007742 Feb 12 21:03:28.419446 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 271/531] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:28.424594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3246a42f-20e8-49c5-ae3e-30c78bad4224 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.425664 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.425664 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:28.433545 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3246a42f-20e8-49c5-ae3e-30c78bad4224 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] HTTP exception thrown: Access list not available for public flavors. Feb 12 21:03:28.434371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3246a42f-20e8-49c5-ae3e-30c78bad4224 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:28.435397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3246a42f-20e8-49c5-ae3e-30c78bad4224 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/144336997/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.014745 Feb 12 21:03:28.436777 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 272/532] 10.222.0.31 () {58 vars in 1205 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/flavors/144336997/os-flavor-access => generated 91 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:28.441902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df930737-0357-4445-a11c-f97b9309b632 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.442819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df930737-0357-4445-a11c-f97b9309b632 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:28.522383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df930737-0357-4445-a11c-f97b9309b632 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:28.528334 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df930737-0357-4445-a11c-f97b9309b632 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1262 microversion: 2.1 time: 0.090249 Feb 12 21:03:28.529614 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 273/533] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:28.535437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b684c6b4-4511-451e-9b2e-f917903990ee tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Calling method '.version_select at 0x7fa90409d820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.536236 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.536236 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:28.537700 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b684c6b4-4511-451e-9b2e-f917903990ee tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] HTTP exception thrown: Hypervisor with ID '2aabecc5-d93d-418f-90e3-0dc117398af6' could not be found. Feb 12 21:03:28.538841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b684c6b4-4511-451e-9b2e-f917903990ee tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] Returning 404 to user: Hypervisor with ID '2aabecc5-d93d-418f-90e3-0dc117398af6' could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:28.539840 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b684c6b4-4511-451e-9b2e-f917903990ee tempest-HypervisorAdminNegativeTestJSON-737213390 tempest-HypervisorAdminNegativeTestJSON-737213390-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/2aabecc5-d93d-418f-90e3-0dc117398af6" status: 404 len: 123 microversion: 2.1 time: 0.008546 Feb 12 21:03:28.540527 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 274/534] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/os-hypervisors/2aabecc5-d93d-418f-90e3-0dc117398af6 => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:28.547461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e56b7eae-4024-4ef1-af0f-6dc85c08a377 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.548500 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:28.548500 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:28.649040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e56b7eae-4024-4ef1-af0f-6dc85c08a377 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/144336997" status: 202 len: 0 microversion: 2.1 time: 0.107170 Feb 12 21:03:28.650215 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 275/535] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:28 2022] DELETE /compute/v2.1/flavors/144336997 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:28.661913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.661913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:28.677103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.677958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.679906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.680567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.844595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:28.869530 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2184963-5823-46cc-9517-0e47dfb7be92 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.217893 Feb 12 21:03:28.882131 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 276/536] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:28.886779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.887592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:28.896739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.897297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.897946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.901985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.968836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:28.976770 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd4c9dd7-66b2-4424-a451-5b050d4de708 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1264 microversion: 2.1 time: 0.093554 Feb 12 21:03:28.981415 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 277/537] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1264 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:28.982511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:28.983553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:28.989697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.989983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:28.990776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:28.991214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:29.188846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:29.197743 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e64ab299-1a15-49ff-a50a-a9f94a42483f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1310 microversion: 2.1 time: 0.218929 Feb 12 21:03:29.218141 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 278/538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:28 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1310 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:29.225341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c8645b5f-b9db-40cf-bcab-e2f3bf2d897a tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:29.248883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c8645b5f-b9db-40cf-bcab-e2f3bf2d897a tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.028376 Feb 12 21:03:29.249869 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 279/539] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:29 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:29.254483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3aa69a4a-cf97-4077-995c-a15557c9fa6f req-2d9048e3-493b-493d-9c0a-75e264a91b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfc153c-f638-4c53-b728-a2b9ed7b8d37", "tag": "f3148623-80dd-4c7e-bf9b-5e8808871e70"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:29.256389 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:29.256389 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:29.265917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3aa69a4a-cf97-4077-995c-a15557c9fa6f req-2d9048e3-493b-493d-9c0a-75e264a91b32 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:29.266356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3aa69a4a-cf97-4077-995c-a15557c9fa6f req-2d9048e3-493b-493d-9c0a-75e264a91b32 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:29.280368 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3aa69a4a-cf97-4077-995c-a15557c9fa6f req-2d9048e3-493b-493d-9c0a-75e264a91b32 service nova] Creating event network-changed:f3148623-80dd-4c7e-bf9b-5e8808871e70 for instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 on nch2-master-1 Feb 12 21:03:29.287114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3aa69a4a-cf97-4077-995c-a15557c9fa6f req-2d9048e3-493b-493d-9c0a-75e264a91b32 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 Feb 12 21:03:29.287713 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 280/540] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:29.296603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:29.297321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:29.305338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:29.305814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:29.306609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:29.307046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:29.462780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:29.473621 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-30df1c3d-4b25-4967-9a69-0998e4d3b8dd tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.184341 Feb 12 21:03:29.477214 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 281/541] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:29 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:29.482100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-153192bb-9e3b-4ab0-a8d1-b17bb8f551e9 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-986761647", "id": 174281891, "os-flavor-access:is_public": "False"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:29.485183 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:29.485183 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:29.612553 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-153192bb-9e3b-4ab0-a8d1-b17bb8f551e9 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.135978 Feb 12 21:03:29.619061 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 282/542] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:29 2022] POST /compute/v2.1/flavors => generated 435 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:29.623364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:29.628203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:29.634706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:29.635239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:29.636110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:29.636667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:29.774084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:29.783043 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96ddd326-d13f-40b3-8fe4-806f7e765cf8 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1266 microversion: 2.1 time: 0.168026 Feb 12 21:03:29.793416 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 283/543] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:29 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:29.997301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-617635fb-9925-47bb-8a00-204dda5bf0e6 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:30.008500 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:30.008500 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:30.008500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-617635fb-9925-47bb-8a00-204dda5bf0e6 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '561d9dd25c4746d997e9d09b3739a059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd774dd8a2f364fb6aa9a356761e08193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:30.010860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-617635fb-9925-47bb-8a00-204dda5bf0e6 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:30.012509 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-617635fb-9925-47bb-8a00-204dda5bf0e6 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] 10.222.0.31 "POST /compute/v2.1/flavors/174281891/action" status: 403 len: 130 microversion: 2.1 time: 0.217945 Feb 12 21:03:30.017116 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 284/544] 10.222.0.31 () {60 vars in 1196 bytes} [Sat Feb 12 21:03:29 2022] POST /compute/v2.1/flavors/174281891/action => generated 130 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:30.026214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:30.037495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:30.053645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:30.053884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:30.054715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:30.055225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:30.350420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:30.362215 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff812b10-4133-4f5f-a178-adb961f21ff7 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.343270 Feb 12 21:03:30.362825 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 285/545] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:30 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:30.374432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:30.375060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:30.397071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:30.397604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:30.398438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:30.398879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:30.520227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:30.543179 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b9b1f77-72e1-42fe-9740-c7833b6d72a7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1270 microversion: 2.1 time: 0.167581 Feb 12 21:03:30.543179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 286/546] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:30 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:30.544437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a00c388c-95c9-48f8-8c37-9620f14c523e tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:30.546139 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:30.546139 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:30.653951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a00c388c-95c9-48f8-8c37-9620f14c523e tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/174281891" status: 202 len: 0 microversion: 2.1 time: 0.117013 Feb 12 21:03:30.656038 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 287/547] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:30 2022] DELETE /compute/v2.1/flavors/174281891 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:30.661197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:30.661917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:30.671671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:30.672425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:30.673763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:30.674443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:31.688983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:31.699065 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2c4244e-8ec9-4952-9b27-ed1602ad11e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1492 microversion: 2.1 time: 1.041490 Feb 12 21:03:31.713156 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 288/548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:30 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1492 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:31.728162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:31.733922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:31.735066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:31.735528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:31.736324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:31.736833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.380050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:32.388864 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db8dbd0d-0017-4810-b5c1-147470c1c36f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.674133 Feb 12 21:03:32.393740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 289/549] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:31 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:32.400906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-335ff45e-0055-4fc6-8264-86017d4c67fb req-44d4d7c8-8793-4540-82a4-1603a103fac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdef2d8-833d-43c2-b10b-8ef367b63a3b", "name": "network-vif-plugged", "status": "completed", "tag": "2c833eba-0a02-439d-bc70-890fa6352eef"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:32.407183 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:32.407183 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:32.424986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-335ff45e-0055-4fc6-8264-86017d4c67fb req-44d4d7c8-8793-4540-82a4-1603a103fac9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.425664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-335ff45e-0055-4fc6-8264-86017d4c67fb req-44d4d7c8-8793-4540-82a4-1603a103fac9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.454917 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-335ff45e-0055-4fc6-8264-86017d4c67fb req-44d4d7c8-8793-4540-82a4-1603a103fac9 service nova] Creating event network-vif-plugged:2c833eba-0a02-439d-bc70-890fa6352eef for instance 2bdef2d8-833d-43c2-b10b-8ef367b63a3b on nch1-master-1 Feb 12 21:03:32.462431 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-335ff45e-0055-4fc6-8264-86017d4c67fb req-44d4d7c8-8793-4540-82a4-1603a103fac9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067319 Feb 12 21:03:32.463463 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 290/550] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:32.472957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b3e0d2ae-8c11-4882-9e2b-d34e12420e63 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:32.524586 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b3e0d2ae-8c11-4882-9e2b-d34e12420e63 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.059483 Feb 12 21:03:32.537345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 291/551] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:32 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:32.542610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:32.543509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:32.552511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.553100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.554092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.554872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.768973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:32.779771 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3443ac18-8391-4b59-8e4e-50165c87015e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1320 microversion: 2.1 time: 0.240542 Feb 12 21:03:32.784813 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 292/552] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:32 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:32.791907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:32.792844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:32.801334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.802624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.804580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.805496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.877889 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c916de11-fb6d-4edd-a908-6d5e95b526c3 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.583131 Feb 12 21:03:32.884473 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 261/553] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:03:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:32.889955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:32.894532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:32.905791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.906530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:32.913437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:32.914287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:33.166689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:33.176263 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-315e8932-b02a-4e58-b7c4-703e6c436bb5 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1317 microversion: 2.1 time: 0.393671 Feb 12 21:03:33.182263 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 293/554] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:32 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:33.192590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:33.193699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:33.207248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:33.215464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:33.215464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:33.215464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:33.680075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0933044b-2d1d-40bc-ad13-f5bf3b3fcc04 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1643 microversion: 2.1 time: 0.496693 Feb 12 21:03:33.687670 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 294/555] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:33 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1643 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:33.720748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7548d21d-3e69-4764-a865-74cea1e99d05 req-a578cba9-e0e4-48cc-8423-892319a3821f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a69d5d6c-82ee-44e8-930e-270484371efe", "name": "network-vif-deleted", "tag": "066233ec-c2e8-467f-a414-c7bb91607730"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:33.730617 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:33.730617 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:33.767375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7548d21d-3e69-4764-a865-74cea1e99d05 req-a578cba9-e0e4-48cc-8423-892319a3821f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:33.768522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7548d21d-3e69-4764-a865-74cea1e99d05 req-a578cba9-e0e4-48cc-8423-892319a3821f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:33.792016 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7548d21d-3e69-4764-a865-74cea1e99d05 req-a578cba9-e0e4-48cc-8423-892319a3821f service nova] Creating event network-vif-deleted:066233ec-c2e8-467f-a414-c7bb91607730 for instance a69d5d6c-82ee-44e8-930e-270484371efe on nch1-master-1 Feb 12 21:03:33.799888 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7548d21d-3e69-4764-a865-74cea1e99d05 req-a578cba9-e0e4-48cc-8423-892319a3821f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086472 Feb 12 21:03:33.801167 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 295/556] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:33.808496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-40a253fe-cac8-469b-9c21-6b1a30cc556e tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2987582", "id": 549626792, "os-flavor-access:is_public": "False"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:33.811598 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:33.811598 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:33.947756 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-40a253fe-cac8-469b-9c21-6b1a30cc556e tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.137088 Feb 12 21:03:33.947756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 296/557] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:33 2022] POST /compute/v2.1/flavors => generated 433 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:33.953799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'action', calling method: .version_select at 0x7fa905249b80>, body: {"addFloatingIp": {"address": "172.35.2.240"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:33.955333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:33.968017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:33.968698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:33.970033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:33.971319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:33.973690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:33.981802 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8191eaa7-bb89-4bb7-b59c-d5839f3381d0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1312 microversion: 2.1 time: 1.096159 Feb 12 21:03:33.994023 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 262/558] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:32 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1312 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:34.004542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:34.007637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:34.017611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:34.018796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:34.023271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:34.023806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:34.058877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Acquired lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:03:34.367256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:34.386768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-220292fd-c1b3-4619-9b99-9a13f9ef61a7 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.391509 Feb 12 21:03:34.388558 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 263/559] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:33 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:34.400233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:34.401159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:34.410681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:34.411751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:34.415213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:34.415839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:34.605019 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-502e7e80-9255-4ceb-9e7a-21fef520b898 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1643 microversion: 2.1 time: 0.212017 Feb 12 21:03:34.605627 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 264/560] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:34 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1643 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:34.610755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:34.611640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:34.624418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:34.629652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:34.629652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:34.629652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:34.798325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:34.810310 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43a7204f-9ccb-4a3b-b108-da72eb5bfe20 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.203217 Feb 12 21:03:34.813260 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 265/561] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:34 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:34.819165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-253e615c-37d0-4bcd-b2ca-790343a9fb9d tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:34.821708 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:34.821708 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:35.151690 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-253e615c-37d0-4bcd-b2ca-790343a9fb9d tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/549626792/action" status: 200 len: 96 microversion: 2.1 time: 0.338211 Feb 12 21:03:35.158321 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 266/562] 10.222.0.31 () {60 vars in 1196 bytes} [Sat Feb 12 21:03:34 2022] POST /compute/v2.1/flavors/549626792/action => generated 96 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:35.164362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:35.165247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:35.183808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.183808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.183808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.183808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.320326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:35.329814 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eeb0bfdb-c8bb-4159-a3a9-4a0ae388a33b tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1506 microversion: 2.1 time: 0.169972 Feb 12 21:03:35.330402 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 267/563] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:35 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:35.335073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-489ec9f0-c83d-430d-8f2f-dfac0e6db802 req-1b16cdf7-916f-44cd-9709-4d2d495ee010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8e14fe-6904-44f4-a8bf-c1e9b349e419", "tag": "e68c6c44-abe5-4ce9-ab41-24f9c4276607"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:35.336561 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:35.336561 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:35.344419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-489ec9f0-c83d-430d-8f2f-dfac0e6db802 req-1b16cdf7-916f-44cd-9709-4d2d495ee010 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.345041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-489ec9f0-c83d-430d-8f2f-dfac0e6db802 req-1b16cdf7-916f-44cd-9709-4d2d495ee010 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.359588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-489ec9f0-c83d-430d-8f2f-dfac0e6db802 req-1b16cdf7-916f-44cd-9709-4d2d495ee010 service nova] Creating event network-changed:e68c6c44-abe5-4ce9-ab41-24f9c4276607 for instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 on nch2-master-1 Feb 12 21:03:35.362579 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-489ec9f0-c83d-430d-8f2f-dfac0e6db802 req-1b16cdf7-916f-44cd-9709-4d2d495ee010 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Feb 12 21:03:35.363166 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 268/564] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:35.368290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-970d63f1-65fd-43c6-90f0-459a1149ef15 req-f1b8244a-50c7-4685-8b91-1978c5369c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7", "name": "network-vif-plugged", "status": "completed", "tag": "3e469e4d-bd4c-43d8-966a-65aac1e95ee8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:35.369885 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:35.369885 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:35.378314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-970d63f1-65fd-43c6-90f0-459a1149ef15 req-f1b8244a-50c7-4685-8b91-1978c5369c83 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.378750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-970d63f1-65fd-43c6-90f0-459a1149ef15 req-f1b8244a-50c7-4685-8b91-1978c5369c83 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.390855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-970d63f1-65fd-43c6-90f0-459a1149ef15 req-f1b8244a-50c7-4685-8b91-1978c5369c83 service nova] Creating event network-vif-plugged:3e469e4d-bd4c-43d8-966a-65aac1e95ee8 for instance 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 on nch1-master-1 Feb 12 21:03:35.398462 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-970d63f1-65fd-43c6-90f0-459a1149ef15 req-f1b8244a-50c7-4685-8b91-1978c5369c83 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031844 Feb 12 21:03:35.398462 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 269/565] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:35.402332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a0dc2b75-71fe-4ae1-aaf7-06933eaf8842 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:35.405169 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:35.405169 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:35.408052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0dc2b75-71fe-4ae1-aaf7-06933eaf8842 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.408676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0dc2b75-71fe-4ae1-aaf7-06933eaf8842 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.409882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0dc2b75-71fe-4ae1-aaf7-06933eaf8842 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.410547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0dc2b75-71fe-4ae1-aaf7-06933eaf8842 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.411700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.2.240 (74dbd6e1-b287-4b6b-a709-6d36fbed18a4) with port f3148623-80dd-4c7e-bf9b-5e8808871e70 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 7cc7114b-c087-413f-bd63-e2248ab8f781.", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:03:35.412277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Releasing lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:03:35.412946 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] HTTP exception thrown: Cannot associate floating IP 172.35.2.240 (74dbd6e1-b287-4b6b-a709-6d36fbed18a4) with port f3148623-80dd-4c7e-bf9b-5e8808871e70 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 7cc7114b-c087-413f-bd63-e2248ab8f781. Feb 12 21:03:35.412946 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-7016ae89-8522-4c9f-acbb-f8148a3a6cce'] Feb 12 21:03:35.413575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Returning 400 to user: Cannot associate floating IP 172.35.2.240 (74dbd6e1-b287-4b6b-a709-6d36fbed18a4) with port f3148623-80dd-4c7e-bf9b-5e8808871e70 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 7cc7114b-c087-413f-bd63-e2248ab8f781. Feb 12 21:03:35.413575 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-7016ae89-8522-4c9f-acbb-f8148a3a6cce'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:35.418581 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e191b845-ed7b-4ca9-b154-2bdb60d77736 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action" status: 400 len: 381 microversion: 2.1 time: 1.468608 Feb 12 21:03:35.418581 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 297/566] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:33 2022] POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action => generated 381 bytes in 1473 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:03:35.422452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:35.423297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:35.430535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.431263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.432318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.432965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.437931 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a0dc2b75-71fe-4ae1-aaf7-06933eaf8842 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039392 Feb 12 21:03:35.438550 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 270/567] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:03:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:35.449893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8abdbdcc-69b8-4858-874e-12ba1e1801f5 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:35.451667 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:35.451667 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:35.452618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8abdbdcc-69b8-4858-874e-12ba1e1801f5 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '561d9dd25c4746d997e9d09b3739a059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd774dd8a2f364fb6aa9a356761e08193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:35.453303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8abdbdcc-69b8-4858-874e-12ba1e1801f5 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:35.454142 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8abdbdcc-69b8-4858-874e-12ba1e1801f5 tempest-FlavorsAccessNegativeTestJSON-2021557150 tempest-FlavorsAccessNegativeTestJSON-2021557150-project] 10.222.0.31 "POST /compute/v2.1/flavors/549626792/action" status: 403 len: 133 microversion: 2.1 time: 0.008733 Feb 12 21:03:35.458557 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 271/568] 10.222.0.31 () {60 vars in 1196 bytes} [Sat Feb 12 21:03:35 2022] POST /compute/v2.1/flavors/549626792/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:35.463194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:35.463854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:35.474240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.474689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.475768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.476222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.511838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:35.512752 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13b8fa8e-4db5-43dd-aa6a-4713affdb7be tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b/os-instance-actions/req-e875929d-2174-4c01-9cd3-82b0d42cf149" status: 200 len: 313 microversion: 2.1 time: 0.053222 Feb 12 21:03:35.513337 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 272/569] 10.222.0.31 () {58 vars in 1418 bytes} [Sat Feb 12 21:03:35 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b/os-instance-actions/req-e875929d-2174-4c01-9cd3-82b0d42cf149 => generated 313 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:35.518460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:35.519402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:35.527194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.528081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.529064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.529901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.695262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:35.713596 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e9e8a10e-d3e2-4e3a-93ca-f0be21159894 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1318 microversion: 2.1 time: 0.198739 Feb 12 21:03:35.724060 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 273/570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:35 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:35.729269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-87f0872b-e716-4b50-b48a-8552ec8dad36 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '.version_select at 0x7fa8fe6175e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:35.906726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:35.917742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41609fe0-f89a-48cd-9843-fbbf73fa12e5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1312 microversion: 2.1 time: 0.499612 Feb 12 21:03:35.918452 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 298/571] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:35 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:35.925575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:35.926552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:35.933700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.934329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:35.935285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:35.935762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:36.340268 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3bd94fba-f9cb-414b-83c6-cd279bd552fd tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a/action" status: 202 len: 0 microversion: 2.1 time: 0.420227 Feb 12 21:03:36.344838 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 299/572] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:35 2022] POST /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:36.349560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1978b02f-b1a0-4ce3-bed2-7a89ce7d05a5 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d774dd8a2f364fb6aa9a356761e08193"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:36.350929 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:36.350929 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:36.833470 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-87f0872b-e716-4b50-b48a-8552ec8dad36 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/74dbd6e1-b287-4b6b-a709-6d36fbed18a4" status: 202 len: 0 microversion: 2.1 time: 1.107297 Feb 12 21:03:36.835146 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 274/573] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:03:35 2022] DELETE /compute/v2.1/os-floating-ips/74dbd6e1-b287-4b6b-a709-6d36fbed18a4 => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:36.843630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:36.845143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:36.855612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:36.856409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:36.858335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:36.859362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:36.947227 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1978b02f-b1a0-4ce3-bed2-7a89ce7d05a5 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/549626792/action" status: 200 len: 21 microversion: 2.1 time: 0.603158 Feb 12 21:03:36.948905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 300/574] 10.222.0.31 () {60 vars in 1196 bytes} [Sat Feb 12 21:03:36 2022] POST /compute/v2.1/flavors/549626792/action => generated 21 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:36.955073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:36.957702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:36.980834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:36.985185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:36.985185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:36.985185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.200661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-001e3b3b-d2d8-42bf-851e-739e021777e4 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "POST /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b/action" status: 202 len: 0 microversion: 2.1 time: 0.363892 Feb 12 21:03:37.201537 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 275/575] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:36 2022] POST /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:37.207741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:37.208627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:37.215356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.216056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.217840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.218290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.290750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:37.300637 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a84e5c3-6348-4c21-a131-601282130b8e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.350044 Feb 12 21:03:37.301305 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 301/576] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:36 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:37.306616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:37.307225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:37.314193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.314719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.315762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.316265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.374135 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a69ebcf-e509-4972-a6d2-4c80efb17695 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1628 microversion: 2.1 time: 0.170994 Feb 12 21:03:37.374711 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 276/577] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:37 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1628 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:37.387303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'action', calling method: .version_select at 0x7fa9052501f0>, body: {"removeFloatingIp": {"address": "172.35.2.233"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:37.460843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:37.468872 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b9d013c-aa94-435a-897b-73bfbbe7e225 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1467 microversion: 2.1 time: 0.166554 Feb 12 21:03:37.469471 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 302/578] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:37 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1467 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:37.604610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:37.611406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.612176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.612986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.613447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.645662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Calling method '.version_select at 0x7fa8fef145e0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:37.646476 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:37.646476 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:37.647971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.648427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.662856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.663299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.673460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.673846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.682500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e791fea5-bceb-4ac9-ad6c-cdf637e7196c tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.211932 Feb 12 21:03:37.683085 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 303/579] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:37.687966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:37.689379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:37.695221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.695669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.696462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.696900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.841512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:37.848901 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f867700-2237-48e9-bfaf-37fabd974317 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1312 microversion: 2.1 time: 0.164794 Feb 12 21:03:37.849498 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 304/580] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:37 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:37.853975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee89c211-232c-4066-9398-7063e8fba7bf tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:37.855521 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:37.855521 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:37.931807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee89c211-232c-4066-9398-7063e8fba7bf tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/549626792" status: 202 len: 0 microversion: 2.1 time: 0.081057 Feb 12 21:03:37.932406 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 305/581] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:37 2022] DELETE /compute/v2.1/flavors/549626792 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:37.937502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:37.938642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:37.944160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.944628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.945464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:37.945907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:37.959223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Acquired lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:03:38.082876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:38.092183 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-04e923ec-8377-4d5b-b785-2764a4051602 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1508 microversion: 2.1 time: 0.158047 Feb 12 21:03:38.092760 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 306/582] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:37 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:38.097406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ae65f587-6982-40d5-959e-3d5da353bf70 req-8a621e42-a5f6-4339-9cda-ea4348e53219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63522777-b7a9-4334-8154-9970f7cb4783", "tag": "89194c07-8746-4aad-bb48-3af933bde09d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:38.098881 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:38.098881 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:38.105666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ae65f587-6982-40d5-959e-3d5da353bf70 req-8a621e42-a5f6-4339-9cda-ea4348e53219 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:38.106119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ae65f587-6982-40d5-959e-3d5da353bf70 req-8a621e42-a5f6-4339-9cda-ea4348e53219 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:38.117496 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ae65f587-6982-40d5-959e-3d5da353bf70 req-8a621e42-a5f6-4339-9cda-ea4348e53219 service nova] Creating event network-changed:89194c07-8746-4aad-bb48-3af933bde09d for instance 63522777-b7a9-4334-8154-9970f7cb4783 on nch2-master-1 Feb 12 21:03:38.122248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ae65f587-6982-40d5-959e-3d5da353bf70 req-8a621e42-a5f6-4339-9cda-ea4348e53219 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028403 Feb 12 21:03:38.122862 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 307/583] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:38.128259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:38.129458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:38.135662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:38.136112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:38.137107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:38.137573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:38.164781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lazy-loading 'flavor' on Instance uuid 19c8f616-0ac8-49ea-8569-b8e0e83a636a {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:03:38.179425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Going to try to live migrate instance to nch1-master-1 {{(pid=141727) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:03:39.069044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Building network info cache for instance {{(pid=141726) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:03:39.563363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Updating instance_info_cache with network_info: [{"id": "f3148623-80dd-4c7e-bf9b-5e8808871e70", "address": "fa:16:3e:b1:4c:47", "network": {"id": "00db7637-715c-44c7-a356-d7a146fc856c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1484278550-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65e530a89835494485cff388fdc9d69b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf3148623-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:03:39.686014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Releasing lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:03:39.687074 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b1e1c755-72b0-4452-92e1-a12e080f51e5 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action" status: 202 len: 0 microversion: 2.1 time: 2.304010 Feb 12 21:03:39.687701 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 277/584] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:37 2022] POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action => generated 0 bytes in 2305 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:03:39.826116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-841857077", "block_migration": true, "disk_over_commit": false}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:39.828156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:39.836261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:39.837229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:39.838277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:39.838867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:39.907474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lazy-loading 'flavor' on Instance uuid 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:03:39.957244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Going to try to live migrate instance to tempest-host-841857077 {{(pid=141726) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:03:39.965546 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] HTTP exception thrown: Compute host tempest-host-841857077 could not be found. Feb 12 21:03:39.966153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Returning 400 to user: Compute host tempest-host-841857077 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:39.967391 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c39a5df4-c93d-4378-a504-d0b9cb3592c5 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7/action" status: 400 len: 99 microversion: 2.1 time: 0.278577 Feb 12 21:03:39.967982 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 278/585] 10.222.0.31 () {60 vars in 1278 bytes} [Sat Feb 12 21:03:39 2022] POST /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7/action => generated 99 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:03:40.082205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-956e8cff-93a1-4d6e-8a9d-11191376e361 tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] Calling method '.version_select at 0x7fa8fe548310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.083125 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:40.083125 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:40.084388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-956e8cff-93a1-4d6e-8a9d-11191376e361 tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '7eecc17f6d2f4e5ca08199964717c964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fcefccd40043a5991fba872cf7c751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:40.085078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-956e8cff-93a1-4d6e-8a9d-11191376e361 tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:40.090414 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-956e8cff-93a1-4d6e-8a9d-11191376e361 tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.116999 Feb 12 21:03:40.090414 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 279/586] 10.222.0.31 () {58 vars in 1208 bytes} [Sat Feb 12 21:03:39 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 118 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:40.091127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26877261-58d9-4cd1-97e4-1e40de935ef7 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.116282 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-26877261-58d9-4cd1-97e4-1e40de935ef7 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.028864 Feb 12 21:03:40.117187 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 280/587] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:40 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:40.121699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.122305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:40.129673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.130119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.130978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.131589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.284770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:40.293780 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fc304cb-d1d9-4677-9bb6-a85212d4cb94 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.175503 Feb 12 21:03:40.294549 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 281/588] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:40 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:40.299603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.300203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:40.306392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.306844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.307631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.308123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.465222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:40.473335 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-908be2b0-8671-4975-8197-9d614cea7336 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1312 microversion: 2.1 time: 0.177251 Feb 12 21:03:40.474133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 282/589] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:40 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:40.478666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8802dec3-2d0b-4dca-991d-ef50b07b4825 req-0e9411a4-12a9-4282-9767-c768a5cdc1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfc153c-f638-4c53-b728-a2b9ed7b8d37", "tag": "f3148623-80dd-4c7e-bf9b-5e8808871e70"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:40.480336 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:40.480336 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:40.488661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8802dec3-2d0b-4dca-991d-ef50b07b4825 req-0e9411a4-12a9-4282-9767-c768a5cdc1ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.489199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8802dec3-2d0b-4dca-991d-ef50b07b4825 req-0e9411a4-12a9-4282-9767-c768a5cdc1ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.500244 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8802dec3-2d0b-4dca-991d-ef50b07b4825 req-0e9411a4-12a9-4282-9767-c768a5cdc1ba service nova] Creating event network-changed:f3148623-80dd-4c7e-bf9b-5e8808871e70 for instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 on nch2-master-1 Feb 12 21:03:40.505466 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8802dec3-2d0b-4dca-991d-ef50b07b4825 req-0e9411a4-12a9-4282-9767-c768a5cdc1ba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030046 Feb 12 21:03:40.506422 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 283/590] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:40.512279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.512978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:40.520378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.520772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.521779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.522216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.666063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:40.673877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-534b56d4-60ce-45ba-ace0-21606b89ef1d tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1506 microversion: 2.1 time: 0.166327 Feb 12 21:03:40.674448 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 284/591] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:40 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:40.678805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a55b656-d6ef-4042-a125-518fb58787c9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '.version_select at 0x7fa8fe5cd280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.968836 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ccdd3b4-fa72-4d3b-b97f-305dbbba117d tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a/action" status: 202 len: 0 microversion: 2.1 time: 2.844520 Feb 12 21:03:40.972881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 308/592] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:38 2022] POST /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a/action => generated 0 bytes in 2846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:40.974370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:40.975023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:40.985346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.985853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:40.986948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:40.987366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.218039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:41.227090 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80e6fc5a-1ab4-4208-841d-abc81c8c9a4b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1467 microversion: 2.1 time: 0.256257 Feb 12 21:03:41.237160 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 309/593] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:40 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:41.250081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58510ea5-ca12-4e5b-b595-88c3c49253ea tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Calling method '.version_select at 0x7fa8fef1cca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:41.250172 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:41.250172 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:41.256589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58510ea5-ca12-4e5b-b595-88c3c49253ea tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.257056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58510ea5-ca12-4e5b-b595-88c3c49253ea tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.279367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-58510ea5-ca12-4e5b-b595-88c3c49253ea tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Feb 12 21:03:41.279922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58510ea5-ca12-4e5b-b595-88c3c49253ea tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:41.280750 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58510ea5-ca12-4e5b-b595-88c3c49253ea tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.042515 Feb 12 21:03:41.281627 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 310/594] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:03:41 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:41.287813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d950f4b4-421a-416c-b469-d90451b1a92b tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-999064615", "id": 384621652, "os-flavor-access:is_public": "False"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:41.299827 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:41.299827 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:41.411874 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d950f4b4-421a-416c-b469-d90451b1a92b tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.129447 Feb 12 21:03:41.412750 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 311/595] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:41.422369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '.version_select at 0x7fa904088f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:41.423666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:41.430722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.431375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.432168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.432610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.468295 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91e66ed9-bf2f-484e-bb37-6e6bc6d7c447 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054506 Feb 12 21:03:41.468887 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 312/596] 10.222.0.31 () {58 vars in 1295 bytes} [Sat Feb 12 21:03:41 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b/os-instance-actions => generated 611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:41.473504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:41.474127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:41.480425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.481094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.481748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.482721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.649912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:41.659811 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d164034-daf4-42cc-95c8-d6f06db7a599 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.189728 Feb 12 21:03:41.666070 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 313/597] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:41 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:41.666070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Calling method '.version_select at 0x7fa8fef14af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:41.666504 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:41.666504 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:41.668337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.668752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.683510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.684110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.696668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.697262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.706026 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3e5d6b7-e211-4f23-9167-847255d90715 tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043227 Feb 12 21:03:41.712038 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 314/598] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:41.712708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a55b656-d6ef-4042-a125-518fb58787c9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/cc3c7078-2ed9-4ed2-96a9-677bdd5ae287" status: 202 len: 0 microversion: 2.1 time: 1.036731 Feb 12 21:03:41.718774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:41.718774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:41.720295 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 285/599] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:03:40 2022] DELETE /compute/v2.1/os-floating-ips/cc3c7078-2ed9-4ed2-96a9-677bdd5ae287 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:41.724419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.725089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.725919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:41.726584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:41.727286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1631708544", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:41.791370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:41.902057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:41.910561 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d02fd190-285f-4990-9fb7-4acb507088e3 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.202142 Feb 12 21:03:41.917851 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 315/600] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:41 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:41.917851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ee87437-f8fe-4eca-bbb0-176e7f12f7e4 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ae09e6c2c5554365b70e7fe5809e5574"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:41.918431 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:41.918431 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:42.048337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2ee87437-f8fe-4eca-bbb0-176e7f12f7e4 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] HTTP exception thrown: Flavor access not found for 36 / ae09e6c2c5554365b70e7fe5809e5574 combination. Feb 12 21:03:42.049977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ee87437-f8fe-4eca-bbb0-176e7f12f7e4 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Returning 404 to user: Flavor access not found for 36 / ae09e6c2c5554365b70e7fe5809e5574 combination. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:42.051029 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2ee87437-f8fe-4eca-bbb0-176e7f12f7e4 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/384621652/action" status: 404 len: 124 microversion: 2.1 time: 0.138904 Feb 12 21:03:42.051858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 316/601] 10.222.0.31 () {60 vars in 1196 bytes} [Sat Feb 12 21:03:41 2022] POST /compute/v2.1/flavors/384621652/action => generated 124 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:42.056600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.057337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:42.064633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.065158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.066068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.066680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.092595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:03:42.209294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:42.209806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:42.210411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:42.210800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:42.211207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:42.221277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.222228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.223221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.223837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.243550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Getting quotas for project 7203bbecaaef4f3ba3ff7f46109eaff9. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:42.247519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Getting quotas for user 9b832260e76e44c6a35fa2402160d0ef and project 7203bbecaaef4f3ba3ff7f46109eaff9. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:42.260965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:42.263390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:42.403285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb2917da-a7a7-4323-833b-088ae0bf60bf tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681545 Feb 12 21:03:42.403945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 286/602] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:42.409069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.410002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:42.416949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.417436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.418250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.418692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.430840 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f8bea54c-e21e-41f0-a502-a615c86f1021 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 204 len: 0 microversion: 2.1 time: 0.377017 Feb 12 21:03:42.431484 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 317/603] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:42 2022] DELETE /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:03:42.439025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c71c65ae-7788-40d5-93c6-4e98e1573ade tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] Calling method '.version_select at 0x7fa8fef644c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.439890 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:42.439890 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:42.445719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c71c65ae-7788-40d5-93c6-4e98e1573ade tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '7eecc17f6d2f4e5ca08199964717c964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fcefccd40043a5991fba872cf7c751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:42.446123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c71c65ae-7788-40d5-93c6-4e98e1573ade tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:42.446942 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c71c65ae-7788-40d5-93c6-4e98e1573ade tempest-HypervisorAdminNegativeUnderV252Test-1691270453 tempest-HypervisorAdminNegativeUnderV252Test-1691270453-project] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013942 Feb 12 21:03:42.447462 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 318/604] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:42.453404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ca6d8e3-6074-49c9-ab49-55e87babd2f3 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:42.455389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ca6d8e3-6074-49c9-ab49-55e87babd2f3 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:42.456205 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ca6d8e3-6074-49c9-ab49-55e87babd2f3 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action" status: 400 len: 142 microversion: 2.1 time: 0.007842 Feb 12 21:03:42.460595 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 319/605] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:42 2022] POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action => generated 142 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:03:42.465249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b7f9f27e-bfda-4ed5-9b49-08d80d07076e req-c88447ba-cdcf-40ff-a34e-5f0e86c1df63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8e14fe-6904-44f4-a8bf-c1e9b349e419", "name": "network-vif-plugged", "status": "completed", "tag": "e68c6c44-abe5-4ce9-ab41-24f9c4276607"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:42.466936 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:42.466936 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:42.474450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b7f9f27e-bfda-4ed5-9b49-08d80d07076e req-c88447ba-cdcf-40ff-a34e-5f0e86c1df63 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.474988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b7f9f27e-bfda-4ed5-9b49-08d80d07076e req-c88447ba-cdcf-40ff-a34e-5f0e86c1df63 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.486680 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b7f9f27e-bfda-4ed5-9b49-08d80d07076e req-c88447ba-cdcf-40ff-a34e-5f0e86c1df63 service nova] Creating event network-vif-plugged:e68c6c44-abe5-4ce9-ab41-24f9c4276607 for instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 on nch2-master-1 Feb 12 21:03:42.492246 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b7f9f27e-bfda-4ed5-9b49-08d80d07076e req-c88447ba-cdcf-40ff-a34e-5f0e86c1df63 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034251 Feb 12 21:03:42.493236 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 320/606] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:42.499856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a89abcc3-cd70-44fb-8531-6cb5f9e086a5 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.501321 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:42.501321 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:42.591457 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a89abcc3-cd70-44fb-8531-6cb5f9e086a5 tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/384621652" status: 202 len: 0 microversion: 2.1 time: 0.096191 Feb 12 21:03:42.592095 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 321/607] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:03:42 2022] DELETE /compute/v2.1/flavors/384621652 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:42.597949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5462aaae-d957-4af4-8982-fa76bfdbb909 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.599148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5462aaae-d957-4af4-8982-fa76bfdbb909 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:42.665085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:42.673776 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fba666e8-cda8-4e47-a330-5dece7a0f797 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1312 microversion: 2.1 time: 0.268033 Feb 12 21:03:42.674603 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 287/608] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:42.683869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5462aaae-d957-4af4-8982-fa76bfdbb909 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:42.690160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.691247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:42.691742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5462aaae-d957-4af4-8982-fa76bfdbb909 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1219 microversion: 2.1 time: 0.098353 Feb 12 21:03:42.692857 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 322/609] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:42.698821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.699270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.700059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.700491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.707889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84c880f6-e3ef-4eb3-af4a-86fd0600c0df tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Calling method '.version_select at 0x7fa904164dc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.708790 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:42.708790 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:42.710493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84c880f6-e3ef-4eb3-af4a-86fd0600c0df tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.711030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84c880f6-e3ef-4eb3-af4a-86fd0600c0df tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.718156 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-84c880f6-e3ef-4eb3-af4a-86fd0600c0df tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] HTTP exception thrown: No hypervisor matching '5c6a7976-4c2d-4d86-99bb-5d744afab3fd' could be found. Feb 12 21:03:42.718835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84c880f6-e3ef-4eb3-af4a-86fd0600c0df tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] Returning 404 to user: No hypervisor matching '5c6a7976-4c2d-4d86-99bb-5d744afab3fd' could be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:42.719720 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84c880f6-e3ef-4eb3-af4a-86fd0600c0df tempest-HypervisorAdminNegativeUnderV252Test-846765010 tempest-HypervisorAdminNegativeUnderV252Test-846765010-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/5c6a7976-4c2d-4d86-99bb-5d744afab3fd/servers" status: 404 len: 123 microversion: 2.1 time: 0.025838 Feb 12 21:03:42.721679 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 323/610] 10.222.0.31 () {58 vars in 1280 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/os-hypervisors/5c6a7976-4c2d-4d86-99bb-5d744afab3fd/servers => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:42.725206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:42.726469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:42.734122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.734572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.735391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.735816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.772076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Acquired lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:03:42.891416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Releasing lock "refresh_cache-bcfc153c-f638-4c53-b728-a2b9ed7b8d37" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:03:42.892168 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] HTTP exception thrown: floating IP not found Feb 12 21:03:42.892801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Returning 404 to user: floating IP not found {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:42.893687 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a476e6fd-5cee-4ab5-a33c-a6e5935bd925 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action" status: 404 len: 67 microversion: 2.1 time: 0.172179 Feb 12 21:03:42.898580 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 324/611] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:42 2022] POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action => generated 67 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:42.900397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6af7b6f-ce22-425d-b8fc-4e8e7353c9ae tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.922494 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6af7b6f-ce22-425d-b8fc-4e8e7353c9ae tempest-FlavorsAccessNegativeTestJSON-1141986470 tempest-FlavorsAccessNegativeTestJSON-1141986470-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.025522 Feb 12 21:03:42.929958 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 325/612] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:42.929958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:42.929958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:42.934426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.934426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.934997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:42.942962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:42.971224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:42.979351 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b17bd2ff-0ff4-498a-ba6e-aa2c54167655 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1512 microversion: 2.1 time: 0.292839 Feb 12 21:03:42.989763 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 288/613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:42.989763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-124187b3-19c4-425e-a258-da6d63d8eb93 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:43.030490 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-124187b3-19c4-425e-a258-da6d63d8eb93 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Feb 12 21:03:43.031180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-124187b3-19c4-425e-a258-da6d63d8eb93 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:43.032445 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-124187b3-19c4-425e-a258-da6d63d8eb93 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action" status: 404 len: 88 microversion: 2.1 time: 0.051413 Feb 12 21:03:43.037134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 289/614] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:42 2022] POST /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37/action => generated 88 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:03:43.042122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:43.042655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:43.050290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.054814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.055726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.056370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.108705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:43.118069 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a17855f-b288-4933-8b21-9215063cf2da tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.194195 Feb 12 21:03:43.129158 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 326/615] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:42 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:43.129158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-048a35c9-c44b-448e-b094-b5cf33f9479d req-c7ada6c4-3837-46b6-a1b8-2386f42f29c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c8f616-0ac8-49ea-8569-b8e0e83a636a", "name": "network-vif-unplugged", "status": "completed", "tag": "c3effa86-57bb-42fc-8e61-cc0f745f1657"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:43.129158 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:43.129158 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:43.135938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-048a35c9-c44b-448e-b094-b5cf33f9479d req-c7ada6c4-3837-46b6-a1b8-2386f42f29c3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.136453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-048a35c9-c44b-448e-b094-b5cf33f9479d req-c7ada6c4-3837-46b6-a1b8-2386f42f29c3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.152906 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-048a35c9-c44b-448e-b094-b5cf33f9479d req-c7ada6c4-3837-46b6-a1b8-2386f42f29c3 service nova] Creating event network-vif-unplugged:c3effa86-57bb-42fc-8e61-cc0f745f1657 for instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a on nch2-master-1 Feb 12 21:03:43.159876 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-048a35c9-c44b-448e-b094-b5cf33f9479d req-c7ada6c4-3837-46b6-a1b8-2386f42f29c3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039915 Feb 12 21:03:43.160850 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 327/616] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:43.166200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:43.166789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:43.177466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.177908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.178747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.179182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.210029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:03:43.305143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:43.316543 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60e95912-3ff3-497e-8af0-2e27ab30ec77 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.278060 Feb 12 21:03:43.317462 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 290/617] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:43 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:43.649032 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ccf4808d-2ff3-4444-a93f-2a4bf22b22d6 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 204 len: 0 microversion: 2.1 time: 0.486488 Feb 12 21:03:43.650712 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 328/618] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:03:43 2022] DELETE /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:03:43.657761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:43.658780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:43.665484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.666052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.667053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.667784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.691721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:43.692514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:43.704370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.704370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.704870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.705263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.859088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:43.870963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd444cd2-f08b-4452-a91a-bb5771a8e56e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1312 microversion: 2.1 time: 0.182694 Feb 12 21:03:43.873986 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 329/619] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:43 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:43.884553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:43.884553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:43.886628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.887259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.888233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:43.889337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:43.908091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:43.917138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4e12d30a-0ce0-48ce-8e42-31f47c17e892 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1542 microversion: 2.1 time: 0.263038 Feb 12 21:03:43.927909 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 291/620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:43 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1542 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:43.956642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:43.966114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ede33ad8-a067-42ec-9f53-b030d3787b1e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1223 microversion: 2.1 time: 0.091007 Feb 12 21:03:43.967237 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 330/621] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:43 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:44.003990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:44.004822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:44.011967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.012504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.013418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.014960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.136807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:44.138101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:44.146993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.147479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.148273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.148924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.338924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:44.349391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-43ff79f4-099b-4fd6-947a-844904a3f2d3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.216350 Feb 12 21:03:44.350830 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 331/622] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:44 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:44.355885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:44.356559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:44.363906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.364391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.365190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.365662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.380267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:44.391507 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-683fa9ec-c964-45e9-ac7d-c00bed63277f tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1512 microversion: 2.1 time: 0.397891 Feb 12 21:03:44.392538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 292/623] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:43 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:44.506183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:44.508130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-52899e44-a6ea-46ee-98c3-78a6c04c8abb req-640df250-013d-4185-b640-65678814c8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63522777-b7a9-4334-8154-9970f7cb4783", "name": "network-vif-plugged", "status": "completed", "tag": "89194c07-8746-4aad-bb48-3af933bde09d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:44.510081 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:44.510081 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:44.520282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fbfb6d21-c74b-4cd8-9a25-d807171cc822 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.168633 Feb 12 21:03:44.521341 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 332/624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:44 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:44.529131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-52899e44-a6ea-46ee-98c3-78a6c04c8abb req-640df250-013d-4185-b640-65678814c8a9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.529592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-52899e44-a6ea-46ee-98c3-78a6c04c8abb req-640df250-013d-4185-b640-65678814c8a9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.559689 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-52899e44-a6ea-46ee-98c3-78a6c04c8abb req-640df250-013d-4185-b640-65678814c8a9 service nova] Creating event network-vif-plugged:89194c07-8746-4aad-bb48-3af933bde09d for instance 63522777-b7a9-4334-8154-9970f7cb4783 on nch2-master-1 Feb 12 21:03:44.570239 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-52899e44-a6ea-46ee-98c3-78a6c04c8abb req-640df250-013d-4185-b640-65678814c8a9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065814 Feb 12 21:03:44.571192 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 293/625] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Feb 12 21:03:44.891446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:44.891979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:44.898100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.898547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.899325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.899753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.936378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:44.937383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:44.946211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.946905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:44.947912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:44.948544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.055165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:45.067633 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b7432e1-e371-460b-b877-84fd22cee0b4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1462 microversion: 2.1 time: 0.178195 Feb 12 21:03:45.068620 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 333/626] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:44 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1462 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:45.089719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:45.094263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:45.101228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.101841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.102856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.104172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.218014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:45.226666 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-789360d3-9b0d-4f80-b137-fc671d2193c1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1279 microversion: 2.1 time: 0.156898 Feb 12 21:03:45.228251 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 334/627] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:45 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:45.234748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:45.236274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:45.244483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.245160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.246586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.251821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:45.255774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.261796 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-412731a6-0712-4d3c-a1be-4dac9371863e tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1542 microversion: 2.1 time: 0.330257 Feb 12 21:03:45.265125 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 294/628] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:44 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1542 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:45.270640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-55a664e1-a9f9-4bb1-9287-5cf11157a6c5 req-e80417fd-a0bc-4ba6-93d2-ac4b3c48fe59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c8f616-0ac8-49ea-8569-b8e0e83a636a", "tag": "c3effa86-57bb-42fc-8e61-cc0f745f1657"}, {"server_uuid": "2bdef2d8-833d-43c2-b10b-8ef367b63a3b", "name": "network-vif-deleted", "tag": "2c833eba-0a02-439d-bc70-890fa6352eef"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:45.273256 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:45.273256 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:45.282476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-55a664e1-a9f9-4bb1-9287-5cf11157a6c5 req-e80417fd-a0bc-4ba6-93d2-ac4b3c48fe59 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.283928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-55a664e1-a9f9-4bb1-9287-5cf11157a6c5 req-e80417fd-a0bc-4ba6-93d2-ac4b3c48fe59 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.300821 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-55a664e1-a9f9-4bb1-9287-5cf11157a6c5 req-e80417fd-a0bc-4ba6-93d2-ac4b3c48fe59 service nova] Creating event network-changed:c3effa86-57bb-42fc-8e61-cc0f745f1657 for instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a on nch2-master-1 Feb 12 21:03:45.301741 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-55a664e1-a9f9-4bb1-9287-5cf11157a6c5 req-e80417fd-a0bc-4ba6-93d2-ac4b3c48fe59 service nova] Creating event network-vif-deleted:2c833eba-0a02-439d-bc70-890fa6352eef for instance 2bdef2d8-833d-43c2-b10b-8ef367b63a3b on nch1-master-1 Feb 12 21:03:45.315299 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-55a664e1-a9f9-4bb1-9287-5cf11157a6c5 req-e80417fd-a0bc-4ba6-93d2-ac4b3c48fe59 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048595 Feb 12 21:03:45.316583 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 295/629] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:45.370106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:45.371878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:45.379441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.379891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.380831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.381265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.421378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:45.428082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Old instance type m1.heat2, new instance type m1.heat {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:03:45.437533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:45.438030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:45.438571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:45.438984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:45.439397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:45.537944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:45.550740 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f8da99c-37c7-48c0-bdf5-012ba3f354c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.186359 Feb 12 21:03:45.553529 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 296/630] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:45 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:45.557380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:45.558227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:45.568439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.569186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.570210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.570862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.610102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.610760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.611584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lazy-loading 'fault' on Instance uuid 2bdef2d8-833d-43c2-b10b-8ef367b63a3b {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:03:45.676127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b726bab201a4d8f8e69c35ae5e1b815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83d16b9025244b1af9db6745cab9163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:45.688776 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ce68707-3a24-4b37-9a0e-1489d3fd0245 tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 200 len: 1307 microversion: 2.1 time: 0.135658 Feb 12 21:03:45.699956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 297/631] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:45 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:45.707997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:45.709133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:45.718500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.720670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.721707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.722350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.755414 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a69a5c2e-5116-488d-930e-8884f26c5ce4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419/action" status: 202 len: 0 microversion: 2.1 time: 0.523577 Feb 12 21:03:45.756141 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 335/632] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:45 2022] POST /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:45.769937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:45.770908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:45.780734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.781466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:45.782800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:45.783707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.087965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:46.110202 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-11d34cf2-132b-4967-bd45-5c5e7af05cea tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1388 microversion: 2.1 time: 0.405613 Feb 12 21:03:46.124024 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 298/633] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:45 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1388 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:46.246641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:46.248585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:46.256322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.257584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.259499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.260134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.383518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:46.398663 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1e595464-2dbd-4f13-8d0f-94f027713744 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1471 microversion: 2.1 time: 0.637341 Feb 12 21:03:46.399575 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 336/634] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:45 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1471 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:46.404569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:46.408794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:46.418312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.425399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.426590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.427350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.876732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:46.887616 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d83d7c0-0bce-4391-ab67-05d29941e349 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.646670 Feb 12 21:03:46.888070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 299/635] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:46 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:46.900952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:46.903670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:46.905120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:46.912802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.913573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.914603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.915307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.918445 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9241e169-10c5-499c-b593-05ad4d23507d tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1542 microversion: 2.1 time: 0.514309 Feb 12 21:03:46.932216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 337/636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:46 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1542 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:46.944160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:46.946109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] [instance: 2bdef2d8-833d-43c2-b10b-8ef367b63a3b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:46.963308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.963971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.966081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:46.967889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:46.997276 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] HTTP exception thrown: Instance 2bdef2d8-833d-43c2-b10b-8ef367b63a3b could not be found. Feb 12 21:03:46.998667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] Returning 404 to user: Instance 2bdef2d8-833d-43c2-b10b-8ef367b63a3b could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:47.000188 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3c3737ea-1300-4707-a0d7-961bd18314cb tempest-InstanceActionsTestJSON-2014555009 tempest-InstanceActionsTestJSON-2014555009-project] 10.222.0.31 "GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b" status: 404 len: 111 microversion: 2.1 time: 0.073297 Feb 12 21:03:47.002998 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 338/637] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:46 2022] GET /compute/v2.1/servers/2bdef2d8-833d-43c2-b10b-8ef367b63a3b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:47.128080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:47.128703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:47.149642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.150097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.150891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.160738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.362260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:47.382200 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8624ceb4-8a8f-4ea6-912e-bf1375b8462f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.479585 Feb 12 21:03:47.382200 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 300/638] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:46 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:47.407919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1df544c8-1d6e-4477-97df-6e26469b119a req-f13c47cd-5738-48ad-866b-2d683b9b2e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfc153c-f638-4c53-b728-a2b9ed7b8d37", "name": "network-vif-deleted", "tag": "f3148623-80dd-4c7e-bf9b-5e8808871e70"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:47.414100 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:47.414100 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:47.431633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1df544c8-1d6e-4477-97df-6e26469b119a req-f13c47cd-5738-48ad-866b-2d683b9b2e82 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.432947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1df544c8-1d6e-4477-97df-6e26469b119a req-f13c47cd-5738-48ad-866b-2d683b9b2e82 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.448173 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1df544c8-1d6e-4477-97df-6e26469b119a req-f13c47cd-5738-48ad-866b-2d683b9b2e82 service nova] Creating event network-vif-deleted:f3148623-80dd-4c7e-bf9b-5e8808871e70 for instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 on nch2-master-1 Feb 12 21:03:47.454119 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1df544c8-1d6e-4477-97df-6e26469b119a req-f13c47cd-5738-48ad-866b-2d683b9b2e82 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072661 Feb 12 21:03:47.458348 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 301/639] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:47.463559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:47.464587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:47.472122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.472876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.474124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.479336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.642584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:47.671272 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c680c807-fc02-4c62-a8ce-29ea22d8c96a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1587 microversion: 2.1 time: 0.541852 Feb 12 21:03:47.672217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 339/640] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:47 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1587 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:47.679852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:47.689746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:47.691379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:47.715305 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7790657f-e0e2-4339-9d3c-3b7a17dddc28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1471 microversion: 2.1 time: 0.255324 Feb 12 21:03:47.728957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.730147 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 302/641] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:47 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:47.733474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.736164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.737804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.907949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:47.908817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:47.926378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.927165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:47.929297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:47.929988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.146966 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b8e3b6b-5824-46c3-bf65-2d142fc5033e tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.461596 Feb 12 21:03:48.153150 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 340/642] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:03:47 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783/os-interface => generated 284 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:48.173438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:48.176976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:48.204068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.206077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.208509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.209623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.289838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.290397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.291075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lazy-loading 'fault' on Instance uuid bcfc153c-f638-4c53-b728-a2b9ed7b8d37 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:03:48.338273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:48.348952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4cd9e0f4-f346-4142-83f7-75ad3ecb595b tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.447015 Feb 12 21:03:48.355137 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 303/643] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:47 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:48.363594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-26655ded-0b8a-4576-8f42-b16c93b813d7 req-30cdd3dd-b502-43ec-bc88-6f370157912d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fbbe5de-bac4-4103-85c9-a40a65f89b37", "tag": "ca833092-d185-4819-837d-50563f38849e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:48.366905 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:48.366905 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:48.377810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-26655ded-0b8a-4576-8f42-b16c93b813d7 req-30cdd3dd-b502-43ec-bc88-6f370157912d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.378649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-26655ded-0b8a-4576-8f42-b16c93b813d7 req-30cdd3dd-b502-43ec-bc88-6f370157912d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.394704 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-26655ded-0b8a-4576-8f42-b16c93b813d7 req-30cdd3dd-b502-43ec-bc88-6f370157912d service nova] Creating event network-changed:ca833092-d185-4819-837d-50563f38849e for instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 on nch1-master-1 Feb 12 21:03:48.403691 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-26655ded-0b8a-4576-8f42-b16c93b813d7 req-30cdd3dd-b502-43ec-bc88-6f370157912d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046726 Feb 12 21:03:48.405270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 304/644] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:48.413028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:48.414366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:48.423850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.424316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.425131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.425671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.695862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15b8a9ad9daa4969a1fd89aeb28431d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e530a89835494485cff388fdc9d69b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:48.703958 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f216c968-b0b6-41ec-9ab5-451723e900a9 tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 200 len: 1322 microversion: 2.1 time: 0.555196 Feb 12 21:03:48.705905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 341/645] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:48 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:48.735509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:48.737562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:48.745917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.747087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.748612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:48.749053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:48.778636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:48.789057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43444aed-e3d1-442e-9264-88fc1d0cad9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.382002 Feb 12 21:03:48.789931 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 305/646] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:48 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:49.349443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:49.360291 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-10158c91-2d0b-411e-b22a-047758b9174d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1471 microversion: 2.1 time: 0.630898 Feb 12 21:03:49.362285 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 342/647] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:48 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1471 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:49.367522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:49.368567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:49.376592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:49.377142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:49.378049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:49.378541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:49.721955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:49.723207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] [instance: bcfc153c-f638-4c53-b728-a2b9ed7b8d37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:49.729962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:49.730792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:49.731859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:49.733944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:49.757153 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] HTTP exception thrown: Instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 could not be found. Feb 12 21:03:49.757995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] Returning 404 to user: Instance bcfc153c-f638-4c53-b728-a2b9ed7b8d37 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:49.759021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-057e4a1b-b882-4797-8d27-93ba833b0ffa tempest-FloatingIPsAssociationNegativeTestJSON-728908500 tempest-FloatingIPsAssociationNegativeTestJSON-728908500-project] 10.222.0.31 "GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37" status: 404 len: 111 microversion: 2.1 time: 0.040901 Feb 12 21:03:49.759992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 343/648] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:49 2022] GET /compute/v2.1/servers/bcfc153c-f638-4c53-b728-a2b9ed7b8d37 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:49.809374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:49.812109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:49.818620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:49.819191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:49.820277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:49.820941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:49.920399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:49.928477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8488e08a-7822-4330-9ce2-087ba3c0c74a tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.564609 Feb 12 21:03:49.930659 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 306/649] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:49 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:50.378893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:50.379794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:50.387332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:50.387873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:50.389570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:50.390156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:50.573930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:50.588677 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf92c474-1f43-47d9-8bda-8a6304c64b19 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.785011 Feb 12 21:03:50.595270 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 344/650] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:49 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:50.878871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:50.891259 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0db9f795-b303-4c44-80b2-b5b99be8a2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1471 microversion: 2.1 time: 0.514481 Feb 12 21:03:50.902019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 307/651] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:50 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:50.949337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:50.950070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:50.961736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:50.962541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:50.964058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:50.969760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:51.552337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:51.558585 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5136c70-7540-481b-8cef-26b1e0548cda tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.614820 Feb 12 21:03:51.559154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 345/652] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:50 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:51.611421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:51.612031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:51.625042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:51.625631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:51.626715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:51.627677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:51.780924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:51.781576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:51.795616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:51.796061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:51.812822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:51.814943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:51.883728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:51.892384 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-180c67f3-1a0a-4e60-a479-53ae163af6e6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1502 microversion: 2.1 time: 0.284915 Feb 12 21:03:51.901857 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 308/653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:51 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:51.906087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-17334733-ad97-4716-8828-d24479ca8f60 req-7148fa6f-def8-4155-b704-8508fb4ef18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63522777-b7a9-4334-8154-9970f7cb4783", "tag": "89194c07-8746-4aad-bb48-3af933bde09d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:51.907678 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:51.907678 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:51.936253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-17334733-ad97-4716-8828-d24479ca8f60 req-7148fa6f-def8-4155-b704-8508fb4ef18e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:51.936803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-17334733-ad97-4716-8828-d24479ca8f60 req-7148fa6f-def8-4155-b704-8508fb4ef18e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:51.957796 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-17334733-ad97-4716-8828-d24479ca8f60 req-7148fa6f-def8-4155-b704-8508fb4ef18e service nova] Creating event network-changed:89194c07-8746-4aad-bb48-3af933bde09d for instance 63522777-b7a9-4334-8154-9970f7cb4783 on nch2-master-1 Feb 12 21:03:51.984783 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-17334733-ad97-4716-8828-d24479ca8f60 req-7148fa6f-def8-4155-b704-8508fb4ef18e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085420 Feb 12 21:03:51.985427 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 309/654] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:51.999281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:52.003792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:52.017316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:52.019065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:52.020061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:52.021742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:52.333147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:52.347891 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-288710cb-2ff5-43ed-92b8-84f48c5ce3ef tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1471 microversion: 2.1 time: 0.354499 Feb 12 21:03:52.362573 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 310/655] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:51 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:52.585894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:52.587776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:52.621422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:52.621422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:52.622057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:52.622537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:52.622718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:52.625652 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4cff5899-d007-4fb2-aae8-96ad73581752 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1587 microversion: 2.1 time: 0.849548 Feb 12 21:03:52.628169 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 346/656] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:51 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1587 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:52.911857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:52.913742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:52.928580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:52.936332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:52.936332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:52.936332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:53.005790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:53.020115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea0a7017-e2bf-48b2-b164-386ae3dda9ad tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.445970 Feb 12 21:03:53.023252 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 311/657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:52 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:53.355744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:53.364928 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-afa6a8e1-3b0f-48b8-af00-5515890d8a42 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1477 microversion: 2.1 time: 0.458588 Feb 12 21:03:53.365489 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 347/658] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:52 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1477 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:53.367372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:53.369013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:53.384875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7eb9aaf-eba7-441a-aec0-517680b85278 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '.version_select at 0x7fa8fedc2700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:53.386810 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:53.386810 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:53.387284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:53.387851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:53.389610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7eb9aaf-eba7-441a-aec0-517680b85278 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:53.390240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7eb9aaf-eba7-441a-aec0-517680b85278 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:53.392377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:53.395104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:53.411470 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b7eb9aaf-eba7-441a-aec0-517680b85278 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.030098 Feb 12 21:03:53.414882 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 348/659] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:03:53 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:53.433925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:53.434553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:53.453563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:53.454436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:53.455373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:53.455679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:53.780829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:53.792456 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cac419eb-b712-427e-b926-239225a52cb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.428757 Feb 12 21:03:53.797532 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 312/660] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:53 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:53.982552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2f1317c8-eae9-447d-bfc3-ace7004c652d tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1939444495", "ram": 512, "vcpus": 1, "disk": 10, "id": 1573333165, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:53.984880 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:53.984880 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:03:54.068280 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6b802390-80a5-4d68-be0a-86a0cbfbabcf tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1628 microversion: 2.1 time: 0.641078 Feb 12 21:03:54.069254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 349/661] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:53 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1628 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:54.075067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:54.076820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:54.097247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2f1317c8-eae9-447d-bfc3-ace7004c652d tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.297964 Feb 12 21:03:54.098459 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 313/662] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:53 2022] POST /compute/v2.1/flavors => generated 416 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:54.109466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:54.110219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:54.111076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:54.112086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:54.323207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f04c202e-a493-4a2d-a20c-091ceaeebc77 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:54.335619 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-f04c202e-a493-4a2d-a20c-091ceaeebc77 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] HTTP exception thrown: Flavor 1573333165 has no extra specs with key hw:cpu_thread_policy. Feb 12 21:03:54.336350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f04c202e-a493-4a2d-a20c-091ceaeebc77 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Returning 404 to user: Flavor 1573333165 has no extra specs with key hw:cpu_thread_policy. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:54.337394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f04c202e-a493-4a2d-a20c-091ceaeebc77 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] 10.222.0.31 "GET /compute/v2.1/flavors/1573333165/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.230589 Feb 12 21:03:54.338285 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 314/663] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:03:54 2022] GET /compute/v2.1/flavors/1573333165/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:54.346137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-93239782", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "04e4405d-ac34-418d-b812-924c095df566"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:54.406082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] validate_networks() for [('04e4405d-ac34-418d-b812-924c095df566', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:54.536839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:54.546782 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-08a1c2d8-4376-4ff1-a840-009d87227bf9 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.476024 Feb 12 21:03:54.551270 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 350/664] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:54 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:54.553493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac64e70f-58eb-4546-b4f7-72e1c67e4154 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:54.555526 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:54.555526 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:54.556884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ac64e70f-58eb-4546-b4f7-72e1c67e4154 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b3d811eae01a4e279f7487d9e8516b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129e519b5f52422596d238d88758d5c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:54.558241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac64e70f-58eb-4546-b4f7-72e1c67e4154 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:54.567155 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac64e70f-58eb-4546-b4f7-72e1c67e4154 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] 10.222.0.31 "POST /compute/v2.1/flavors/1573333165/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.009880 Feb 12 21:03:54.567155 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 351/665] 10.222.0.31 () {60 vars in 1223 bytes} [Sat Feb 12 21:03:54 2022] POST /compute/v2.1/flavors/1573333165/os-extra_specs => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:54.567155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-516a9ada-b432-4894-ba5e-345d4d926cba req-b30fa6df-0f7f-4315-90ed-a4c37b17541b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbbe5de-bac4-4103-85c9-a40a65f89b37", "name": "network-vif-plugged", "status": "completed", "tag": "ca833092-d185-4819-837d-50563f38849e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:54.567500 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:54.567500 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:54.576801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-516a9ada-b432-4894-ba5e-345d4d926cba req-b30fa6df-0f7f-4315-90ed-a4c37b17541b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:54.577236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-516a9ada-b432-4894-ba5e-345d4d926cba req-b30fa6df-0f7f-4315-90ed-a4c37b17541b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:54.591917 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-516a9ada-b432-4894-ba5e-345d4d926cba req-b30fa6df-0f7f-4315-90ed-a4c37b17541b service nova] Creating event network-vif-plugged:ca833092-d185-4819-837d-50563f38849e for instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 on nch1-master-1 Feb 12 21:03:54.603046 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-516a9ada-b432-4894-ba5e-345d4d926cba req-b30fa6df-0f7f-4315-90ed-a4c37b17541b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041369 Feb 12 21:03:54.606817 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 352/666] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:03:54.612780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a964238-05a6-4c03-a188-bcd61c08c99e tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:54.624903 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:54.624903 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:54.762462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a964238-05a6-4c03-a188-bcd61c08c99e tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1573333165/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.154039 Feb 12 21:03:54.763238 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 353/667] 10.222.0.31 () {60 vars in 1223 bytes} [Sat Feb 12 21:03:54 2022] POST /compute/v2.1/flavors/1573333165/os-extra_specs => generated 66 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:54.774169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-987e1336-a332-4874-8ef7-fa8a865ab582 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:54.775163 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:54.775163 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:54.776705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-987e1336-a332-4874-8ef7-fa8a865ab582 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b3d811eae01a4e279f7487d9e8516b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129e519b5f52422596d238d88758d5c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:54.787438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-987e1336-a332-4874-8ef7-fa8a865ab582 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:54.787438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-987e1336-a332-4874-8ef7-fa8a865ab582 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] 10.222.0.31 "DELETE /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008950 Feb 12 21:03:54.787438 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 354/668] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:03:54 2022] DELETE /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:03:54.799195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03ea7fc3-801d-4207-a3a9-c3fb535a9cdb tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:54.829270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03ea7fc3-801d-4207-a3a9-c3fb535a9cdb tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1573333165/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034501 Feb 12 21:03:54.830617 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 355/669] 10.222.0.31 () {60 vars in 1223 bytes} [Sat Feb 12 21:03:54 2022] POST /compute/v2.1/flavors/1573333165/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:03:54.837677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:54.838834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:54.846147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:54.846947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:54.848053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:54.848719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:55.104809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:55.117234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6ddc89e2-d407-4dc6-b95c-afb2476503c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.285128 Feb 12 21:03:55.118430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 356/670] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:54 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:55.145034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee233dc4-9bf8-4d87-9612-4ef18e7a67ca tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:55.145034 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:55.145034 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:55.145034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee233dc4-9bf8-4d87-9612-4ef18e7a67ca tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b3d811eae01a4e279f7487d9e8516b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129e519b5f52422596d238d88758d5c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:55.145506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee233dc4-9bf8-4d87-9612-4ef18e7a67ca tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:55.145506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee233dc4-9bf8-4d87-9612-4ef18e7a67ca tempest-FlavorsExtraSpecsNegativeTestJSON-955093815 tempest-FlavorsExtraSpecsNegativeTestJSON-955093815-project] 10.222.0.31 "PUT /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016096 Feb 12 21:03:55.145506 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 357/671] 10.222.0.31 () {60 vars in 1264 bytes} [Sat Feb 12 21:03:55 2022] PUT /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:55.151065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-365bb3ef-e0a9-42b4-954b-0216bad973b0 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:55.154931 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:55.154931 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:55.178109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-365bb3ef-e0a9-42b4-954b-0216bad973b0 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] HTTP exception thrown: Flavor 1573333165 has no extra specs with key hw:cpu_thread_policy. Feb 12 21:03:55.180872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-365bb3ef-e0a9-42b4-954b-0216bad973b0 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Returning 404 to user: Flavor 1573333165 has no extra specs with key hw:cpu_thread_policy. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:55.181783 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-365bb3ef-e0a9-42b4-954b-0216bad973b0 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1573333165/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.034310 Feb 12 21:03:55.187331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 358/672] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:03:55 2022] DELETE /compute/v2.1/flavors/1573333165/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:03:55.195227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8beb5b22-d070-467f-a735-06fb1e5b0d3d tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:55.199512 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8beb5b22-d070-467f-a735-06fb1e5b0d3d tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] HTTP exception thrown: Request body and URI mismatch Feb 12 21:03:55.200093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8beb5b22-d070-467f-a735-06fb1e5b0d3d tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:55.201571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8beb5b22-d070-467f-a735-06fb1e5b0d3d tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "PUT /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.012040 Feb 12 21:03:55.202126 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 359/673] 10.222.0.31 () {60 vars in 1264 bytes} [Sat Feb 12 21:03:55 2022] PUT /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes => generated 73 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:03:55.222725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db43cf12-529e-4895-90fa-b21149c94109 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:55.223955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db43cf12-529e-4895-90fa-b21149c94109 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:03:55.226937 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db43cf12-529e-4895-90fa-b21149c94109 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "PUT /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.014794 Feb 12 21:03:55.231261 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 360/674] 10.222.0.31 () {60 vars in 1264 bytes} [Sat Feb 12 21:03:55 2022] PUT /compute/v2.1/flavors/1573333165/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:03:55.241226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a304682-7d01-4ecf-928d-20a0e3f59fc1 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:55.242184 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:03:55.242184 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:03:55.373852 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a304682-7d01-4ecf-928d-20a0e3f59fc1 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1573333165" status: 202 len: 0 microversion: 2.1 time: 0.140923 Feb 12 21:03:55.378124 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 361/675] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:03:55 2022] DELETE /compute/v2.1/flavors/1573333165 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:03:55.382998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b143ffb-316f-43a6-bc0c-6f9af57c318e tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:55.422921 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b143ffb-316f-43a6-bc0c-6f9af57c318e tempest-FlavorsExtraSpecsNegativeTestJSON-366552305 tempest-FlavorsExtraSpecsNegativeTestJSON-366552305-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.043486 Feb 12 21:03:55.423812 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 362/676] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:03:55 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:55.553395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1484045993", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "714ff2dc-d317-4a71-9ee6-4e812e6c4f51"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:55.613683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:55.614868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:55.615626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:55.616183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:55.616743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:55.642042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:55.642042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:55.642042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:55.642042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:55.642382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] validate_networks() for [('714ff2dc-d317-4a71-9ee6-4e812e6c4f51', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:55.656018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:55.660073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for user f126f64ca5e64defb9bbcf4c6bab2fd8 and project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:55.672427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:55.675076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:55.839891 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c698a49-c53f-48ec-9661-b978d33c841f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500376 Feb 12 21:03:55.840527 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 315/677] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:03:55.845954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:55.846574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:55.853029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:55.853511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:55.858534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:55.858534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:56.108669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:56.116346 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fbddd86c-73d7-4c00-8d52-3d31e5130e9f tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1319 microversion: 2.1 time: 0.274598 Feb 12 21:03:56.123645 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 316/678] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:55 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:56.136833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f504fdd5-e120-4894-a35d-91090a2c41b3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:56.137579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f504fdd5-e120-4894-a35d-91090a2c41b3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:56.208917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f504fdd5-e120-4894-a35d-91090a2c41b3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:56.218221 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f504fdd5-e120-4894-a35d-91090a2c41b3 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1209 microversion: 2.1 time: 0.091650 Feb 12 21:03:56.230399 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 317/679] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:56 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:56.237796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:56.240736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:56.267920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:56.268443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:56.269478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:56.270126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:56.519748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:56.521454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:56.522067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:56.522541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:56.523059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:56.534015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:56.534476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:56.535468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:56.535900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:56.556952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:56.561890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for user 3cae3e35c281419b98224db3b8ea1f19 and project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:56.570142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:56.573284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:56.575649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:56.578586 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-afaae8fb-ceec-45ad-8a5f-c6647edc5edd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.346943 Feb 12 21:03:56.579190 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 318/680] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:56 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:56.789617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-968120973", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "809af00c-f029-4452-bdd8-36683da9a283"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:56.839594 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4af3e033-85ba-4134-8948-966efad994cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.363718 Feb 12 21:03:56.839594 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 363/681] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 12 21:03:56.839594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c6afce98-43ae-4f08-97d4-e754ca2d30fd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:56.839594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c6afce98-43ae-4f08-97d4-e754ca2d30fd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:56.902009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] validate_networks() for [('809af00c-f029-4452-bdd8-36683da9a283', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:03:56.938050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6afce98-43ae-4f08-97d4-e754ca2d30fd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:56.946609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6afce98-43ae-4f08-97d4-e754ca2d30fd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:56.948112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6afce98-43ae-4f08-97d4-e754ca2d30fd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:56.949199 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c6afce98-43ae-4f08-97d4-e754ca2d30fd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1262 microversion: 2.25 time: 0.118289 Feb 12 21:03:56.949967 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 364/682] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:03:56 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1262 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:03:57.134389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:57.137009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:57.154937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.154937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.154937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.154937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.378760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:03:57.379148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:03:57.379625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:03:57.380131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:03:57.380568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:03:57.396300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.396764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.398263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.398873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.420441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Getting quotas for project 7d9030a13fac41bc8e6af51b4f3328a8. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:03:57.424296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Getting quotas for user b24a260e57504ca08edec98b4e64fb90 and project 7d9030a13fac41bc8e6af51b4f3328a8. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:03:57.437029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:03:57.439361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:03:57.595968 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed4c017e-9b60-4a68-b2b1-41130d215175 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.015335 Feb 12 21:03:57.604132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 319/683] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:03:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:03:57.609348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:57.610321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:57.620528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.621280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.623343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.624825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.768114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:57.776644 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66accaa9-f5f7-4f5c-a917-1d8ec22e388f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1213 microversion: 2.1 time: 0.171053 Feb 12 21:03:57.777517 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 320/684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:57 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:57.784230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:57.784914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:57.798377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.798377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.798377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:57.798377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:57.801028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:57.810685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2de4f047-5b8f-48be-9f0d-da610c16dc2c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1469 microversion: 2.1 time: 0.680133 Feb 12 21:03:57.811988 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 365/685] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:57 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1469 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:03:57.817459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e6e8bdf-abc6-4d85-9988-bd4ae63adef9 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:57.818319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e6e8bdf-abc6-4d85-9988-bd4ae63adef9 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:57.953392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e6e8bdf-abc6-4d85-9988-bd4ae63adef9 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:57.965955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e6e8bdf-abc6-4d85-9988-bd4ae63adef9 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:57.972549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e6e8bdf-abc6-4d85-9988-bd4ae63adef9 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:57.978050 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e6e8bdf-abc6-4d85-9988-bd4ae63adef9 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1258 microversion: 2.21 time: 0.162308 Feb 12 21:03:57.978717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 366/686] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:03:57 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:03:57.980038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:57.988902 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dfcf73c9-9215-4ab1-8db1-6ce5ad335edb tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.210077 Feb 12 21:03:57.995007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 321/687] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:57 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:58.002436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:03:58.005748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:58.010795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-546c80d4-bbc6-46fa-918c-a037ca463e2d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:58.011406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-546c80d4-bbc6-46fa-918c-a037ca463e2d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:58.014203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:58.015216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:58.016441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:58.017319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:58.057996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lazy-loading 'flavor' on Instance uuid 5fbbe5de-bac4-4103-85c9-a40a65f89b37 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:03:58.113131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-546c80d4-bbc6-46fa-918c-a037ca463e2d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:58.120702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-546c80d4-bbc6-46fa-918c-a037ca463e2d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:58.122859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-546c80d4-bbc6-46fa-918c-a037ca463e2d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:58.124955 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-546c80d4-bbc6-46fa-918c-a037ca463e2d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1262 microversion: 2.25 time: 0.120782 Feb 12 21:03:58.126597 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 322/688] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:03:57 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1262 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:03:58.570362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4f3a11a-b2f5-4161-a9d7-b40ed30c3cfb tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37/action" status: 202 len: 0 microversion: 2.1 time: 0.505886 Feb 12 21:03:58.570362 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 367/689] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:03:57 2022] POST /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:03:58.577821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:58.578445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:58.586545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:58.586996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:58.588122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:58.588650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:58.726674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:58.736104 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-490218a8-3071-407a-a2f5-f650c865b7e1 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1477 microversion: 2.1 time: 0.163010 Feb 12 21:03:58.736709 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 323/690] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:58 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:58.803045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:58.805787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:58.818471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:58.818906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:58.819877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:58.820485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:58.886160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:58.893861 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-779b1c44-b225-4d3d-8d43-b2d46189e68f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1261 microversion: 2.1 time: 0.102981 Feb 12 21:03:58.894416 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 368/691] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:58 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:58.996813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-412f07b0-2d18-4d8a-9f4b-05dcce42a256 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:58.997462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-412f07b0-2d18-4d8a-9f4b-05dcce42a256 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:59.019482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:59.022473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:59.039719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.040376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.042725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.043690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.091088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-412f07b0-2d18-4d8a-9f4b-05dcce42a256 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.101002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-412f07b0-2d18-4d8a-9f4b-05dcce42a256 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.102630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-412f07b0-2d18-4d8a-9f4b-05dcce42a256 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.103742 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-412f07b0-2d18-4d8a-9f4b-05dcce42a256 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1258 microversion: 2.21 time: 0.110884 Feb 12 21:03:59.104309 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 324/692] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:03:58 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1258 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:03:59.144578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:59.145191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:59.152459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.152908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.154850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.155936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.221143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.232425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.234724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.236815 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70ee854e-1d18-4f60-86f8-26bc9e9d5024 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1266 microversion: 2.25 time: 0.096348 Feb 12 21:03:59.258451 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 325/693] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:03:59 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:03:59.418564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.430545 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a35dd30-aeb2-485d-a344-00160cdd653e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.416837 Feb 12 21:03:59.431142 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 369/694] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:59 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:59.753444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:59.754206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:59.760260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.760936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.761763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.762199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.911725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:59.912339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:59.918525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.918985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.921084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.921562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.922132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:03:59.935876 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-baa91baf-1517-49be-a3c1-5459ea4a8c20 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1460 microversion: 2.1 time: 0.186089 Feb 12 21:03:59.940167 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 326/695] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:59 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1460 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:03:59.954911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:03:59.956064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:03:59.962758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.963258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:03:59.964060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:03:59.964492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.003988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.015224 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e246ba6-c8b2-4871-8db9-b5ec2d80951a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1267 microversion: 2.1 time: 0.107485 Feb 12 21:04:00.020469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 370/696] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:59 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:00.123333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:00.124062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:00.134695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.137208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.169637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.169637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.276456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.287208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.288918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.290158 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8cc2533-2a32-429b-9256-2980a07f202a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1254 microversion: 2.21 time: 0.171489 Feb 12 21:04:00.290990 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 371/697] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:00 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1254 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:00.296630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:00.297908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:00.304877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.305494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.308254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.308701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.423081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.441320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.460627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.460627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf4e580a-fe65-4046-8fe3-d8e84dae6d13 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1322 microversion: 2.25 time: 0.166623 Feb 12 21:04:00.471813 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 372/698] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:00 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:00.477901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:00.478809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:00.485228 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a333829-495e-4599-b2fe-74de95ee82cc tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1611 microversion: 2.1 time: 0.534320 Feb 12 21:04:00.488368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.489032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.490065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.490914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.497702 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 327/699] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:03:59 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1611 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:00.503891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d3181a6-12bb-449a-8da8-f57c8843ec04 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:00.505585 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:00.505585 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:00.507701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d3181a6-12bb-449a-8da8-f57c8843ec04 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.508411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d3181a6-12bb-449a-8da8-f57c8843ec04 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.509821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d3181a6-12bb-449a-8da8-f57c8843ec04 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.510532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d3181a6-12bb-449a-8da8-f57c8843ec04 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.547304 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d3181a6-12bb-449a-8da8-f57c8843ec04 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048097 Feb 12 21:04:00.548316 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 328/700] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:04:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:00.561898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:00.564004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:00.575034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.576898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.578448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.579115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.612589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Lazy-loading 'flavor' on Instance uuid 5fbbe5de-bac4-4103-85c9-a40a65f89b37 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:00.630518 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 while it is in vm_state suspended Feb 12 21:04:00.633448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 while it is in vm_state suspended {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:00.633448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8351b34e-0d8f-4f6b-8859-8cefe9f24e52 tempest-LiveMigrationNegativeTest-1364433037 tempest-LiveMigrationNegativeTest-1364433037-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37/action" status: 409 len: 155 microversion: 2.1 time: 0.076889 Feb 12 21:04:00.640175 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 329/701] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:04:00 2022] POST /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37/action => generated 155 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:04:00.647566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:00.648842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:00.656932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.658510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.658510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:00.658885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:00.693543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:04:00.937093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:00.945922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab170b5d-becd-4ad2-867e-682d6950b2e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.472624 Feb 12 21:04:00.946691 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 373/702] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:00 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:01.039662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.039662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:01.048955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.049509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.050351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.050819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.165510 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30372ad8-64a6-4d97-aa8d-a9c14cb9dbee tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 204 len: 0 microversion: 2.1 time: 0.523366 Feb 12 21:04:01.166105 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 330/703] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:04:00 2022] DELETE /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:04:01.174423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.175691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:01.181920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.182377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.183269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.183708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.448991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.460584 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d6c8ab8-eec2-46fe-ae4e-d5136ee88c70 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.428998 Feb 12 21:04:01.471024 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 374/704] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:01.477984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.478586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:01.487096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.487834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.488911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.489615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.529185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.551300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d915103-e0e4-49d8-bd3c-7c3af5582422 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1466 microversion: 2.1 time: 0.380683 Feb 12 21:04:01.552441 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 331/705] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1466 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:01.569892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.570833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:01.584671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.585560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.591133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.591133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.652975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.663414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.669256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.670784 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf1b5136-da2f-4d7a-ab59-890bf9e7cf97 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1328 microversion: 2.21 time: 0.196687 Feb 12 21:04:01.671345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 375/706] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:01.695489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.707591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.709438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:01.711153 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c506a062-23b7-41a1-9470-3988ab182bbc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1320 microversion: 2.25 time: 0.146811 Feb 12 21:04:01.711932 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 332/707] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:01.863144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31852b60-acb7-46bc-9e19-f31785c8d879 tempest-InstanceUsageAuditLogTestJSON-1677694528 tempest-InstanceUsageAuditLogTestJSON-1677694528-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.863995 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:01.863995 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:01.885655 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31852b60-acb7-46bc-9e19-f31785c8d879 tempest-InstanceUsageAuditLogTestJSON-1677694528 tempest-InstanceUsageAuditLogTestJSON-1677694528-project-admin] 10.222.0.31 "GET /compute/v2.1/os-instance_usage_audit_log/2022-02-12 21:04:01" status: 200 len: 318 microversion: 2.1 time: 0.140699 Feb 12 21:04:01.886596 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 376/708] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-02-12%2021%3A04%3A01 => generated 318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:01.900483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-021b0dbe-71aa-49fd-986b-395be0488cee tempest-InstanceUsageAuditLogTestJSON-1677694528 tempest-InstanceUsageAuditLogTestJSON-1677694528-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.902895 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:01.902895 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:01.933761 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-021b0dbe-71aa-49fd-986b-395be0488cee tempest-InstanceUsageAuditLogTestJSON-1677694528 tempest-InstanceUsageAuditLogTestJSON-1677694528-project-admin] 10.222.0.31 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.039311 Feb 12 21:04:01.934754 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 333/709] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:01.946824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d52f68be-311a-4421-9db2-0926db7ac83f req-a735bbbe-8226-43b3-afbf-751ff2525a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831a7bdc-edf9-4121-9962-f3ae48b82047", "tag": "32360a5d-8e56-4c23-9414-36fca780d88e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:01.952647 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:01.952647 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:01.963285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d52f68be-311a-4421-9db2-0926db7ac83f req-a735bbbe-8226-43b3-afbf-751ff2525a23 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.963919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d52f68be-311a-4421-9db2-0926db7ac83f req-a735bbbe-8226-43b3-afbf-751ff2525a23 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.964981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:01.966497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:01.977756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.981313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.981472 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d52f68be-311a-4421-9db2-0926db7ac83f req-a735bbbe-8226-43b3-afbf-751ff2525a23 service nova] Creating event network-changed:32360a5d-8e56-4c23-9414-36fca780d88e for instance 831a7bdc-edf9-4121-9962-f3ae48b82047 on nch2-master-1 Feb 12 21:04:01.981587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:01.981587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:01.984816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d52f68be-311a-4421-9db2-0926db7ac83f req-a735bbbe-8226-43b3-afbf-751ff2525a23 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041172 Feb 12 21:04:01.985989 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 377/710] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:02.248557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:02.258262 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-720c5ba2-a252-4a17-ba57-35e8b79e91c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.298478 Feb 12 21:04:02.259875 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 334/711] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:01 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:02.479836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:02.480736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:02.491560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:02.493188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:02.493188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:02.493415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:02.577256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:02.577977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:02.586204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:02.586981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:02.588071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:02.588510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:02.903249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:02.912413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-618f1449-1daa-4370-ad95-b8809e9d832e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.438393 Feb 12 21:04:02.913330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 378/712] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:02 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:02.917685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:02.918435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:02.927602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:02.928056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:02.928845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:02.929704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.050895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.058441 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71f737d1-8966-4a1e-b848-d22f6487275c tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1466 microversion: 2.1 time: 0.488240 Feb 12 21:04:03.059764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 335/713] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:02 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1466 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:03.064683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:03.065560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:03.072140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:03.072916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.073743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:03.074331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.554923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.565632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.567559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.568765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d064271-8de8-42a7-abf7-5cdeb544e15d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.507699 Feb 12 21:04:03.569430 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 336/714] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:03 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:03.574292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:03.574968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:03.582134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:03.582731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.583446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:03.584099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.670457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.679420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.681124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.682299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5377c9d5-12d4-4a19-aaaa-d05b163664fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.767921 Feb 12 21:04:03.682855 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 379/715] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:02 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:03.701404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ada0fd55-a306-4e9e-b58b-a2ca756b9dbc tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fedd1d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:03.746595 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ada0fd55-a306-4e9e-b58b-a2ca756b9dbc tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/8612e5f0-91fa-4961-9276-9ae3cde9195a" status: 200 len: 661 microversion: 2.1 time: 0.062235 Feb 12 21:04:03.747165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 380/716] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:03 2022] GET /compute/v2.1/images/8612e5f0-91fa-4961-9276-9ae3cde9195a => generated 661 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:03.760919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c61c921-8117-441f-b2cd-0e51c6b255ca tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fee2d700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:03.821406 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c61c921-8117-441f-b2cd-0e51c6b255ca tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/8612e5f0-91fa-4961-9276-9ae3cde9195a" status: 200 len: 661 microversion: 2.1 time: 0.064535 Feb 12 21:04:03.821998 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 381/717] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:03 2022] GET /compute/v2.1/images/8612e5f0-91fa-4961-9276-9ae3cde9195a => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:03.930015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:03.931785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:03.941446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:03.942362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.943488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:03.944506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:03.973015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:03.986115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-983087c8-010e-4528-9317-3cee248048a1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.415116 Feb 12 21:04:03.987774 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 337/718] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:03 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:04.067308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5b2963e3-ae31-4a29-abb8-73e113f9a506 req-af585eef-f881-42cb-824f-f89176747428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac07934b-e366-4ce9-9d0b-d6f3ee7833f9", "tag": "692da1ed-6391-4b0f-95c0-4a1ac462850c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:04.069959 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:04.069959 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:04.079490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5b2963e3-ae31-4a29-abb8-73e113f9a506 req-af585eef-f881-42cb-824f-f89176747428 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.080134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5b2963e3-ae31-4a29-abb8-73e113f9a506 req-af585eef-f881-42cb-824f-f89176747428 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.104187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5b2963e3-ae31-4a29-abb8-73e113f9a506 req-af585eef-f881-42cb-824f-f89176747428 service nova] Creating event network-changed:692da1ed-6391-4b0f-95c0-4a1ac462850c for instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 on nch2-master-1 Feb 12 21:04:04.131843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5b2963e3-ae31-4a29-abb8-73e113f9a506 req-af585eef-f881-42cb-824f-f89176747428 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067928 Feb 12 21:04:04.132983 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 338/719] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:04.139528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:04.140549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:04.155481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.155863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.157049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.157664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.275418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:04.292698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10b994f9-11ea-42b9-9b86-941eccd6e2f5 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1424 microversion: 2.1 time: 0.156533 Feb 12 21:04:04.296519 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 339/720] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:04 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1424 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:04.308919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-57180612-79db-4a0f-86ce-2ee10b16c255 req-45ec8878-a5ff-41e8-a3ec-d03ae53614b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fbbe5de-bac4-4103-85c9-a40a65f89b37", "name": "network-vif-deleted", "tag": "ca833092-d185-4819-837d-50563f38849e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:04.311138 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:04.311138 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:04.322573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-57180612-79db-4a0f-86ce-2ee10b16c255 req-45ec8878-a5ff-41e8-a3ec-d03ae53614b2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.323672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-57180612-79db-4a0f-86ce-2ee10b16c255 req-45ec8878-a5ff-41e8-a3ec-d03ae53614b2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.343335 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-57180612-79db-4a0f-86ce-2ee10b16c255 req-45ec8878-a5ff-41e8-a3ec-d03ae53614b2 service nova] Creating event network-vif-deleted:ca833092-d185-4819-837d-50563f38849e for instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 on nch1-master-1 Feb 12 21:04:04.345127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:04.351673 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-57180612-79db-4a0f-86ce-2ee10b16c255 req-45ec8878-a5ff-41e8-a3ec-d03ae53614b2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053299 Feb 12 21:04:04.352837 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 340/721] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:04.358923 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b728c3e-db34-4b38-8061-9aba0826c26b tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.432503 Feb 12 21:04:04.361664 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 382/722] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:03 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:04.588549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:04.589564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:04.601211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.604021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.605239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.605933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.702201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:04.713349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:04.713349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.713349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.713349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:04.713895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:04.908369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:04.919881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:04.922454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:04.924307 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ffd7299-3731-433b-a07d-a1a3023f7b7d tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.226280 Feb 12 21:04:04.934871 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 383/723] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:04 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:04:05.005911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:05.006652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:05.014109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.015035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.016020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.016788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.193418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:05.203957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:05.205524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:05.206689 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec4f23d3-5e15-489e-834a-daca03281160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.622637 Feb 12 21:04:05.207251 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 341/724] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:04 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:05.304993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:05.313629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:05.314752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:05.315091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-350d75cc-7993-4ede-b19a-142d3e4a49e4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.313066 Feb 12 21:04:05.318185 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 384/725] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:05 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:05.340011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.340978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.345376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.345842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.378194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:05.379093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:05.399439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.400096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.401441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.409631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.615538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.616090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.616428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lazy-loading 'fault' on Instance uuid 5fbbe5de-bac4-4103-85c9-a40a65f89b37 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:05.658424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:05.665968 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e7cc3cf-1147-4e67-aa52-c28753a56db3 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 200 len: 1309 microversion: 2.1 time: 0.357948 Feb 12 21:04:05.666550 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 342/726] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:05 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:05.698424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:05.710717 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77e2a678-c9f7-4a0e-a402-171da8b58e30 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.338774 Feb 12 21:04:05.721903 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 385/727] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:05 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:05.941704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:05.942362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:05.948346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.948783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.949591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:05.950025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:05.984821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c22a9c80-8f38-42c1-9f87-a3725860f982 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fede09d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.027733 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c22a9c80-8f38-42c1-9f87-a3725860f982 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/69dbe8c0-fc71-4f1e-9254-37cfb3e68b4a" status: 200 len: 662 microversion: 2.1 time: 0.046720 Feb 12 21:04:06.028285 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 386/728] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:05 2022] GET /compute/v2.1/images/69dbe8c0-fc71-4f1e-9254-37cfb3e68b4a => generated 662 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:06.039438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19d91e20-4a63-4543-af6c-e6e85a9c31dd tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fedd74c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.081649 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19d91e20-4a63-4543-af6c-e6e85a9c31dd tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/69dbe8c0-fc71-4f1e-9254-37cfb3e68b4a" status: 200 len: 662 microversion: 2.1 time: 0.045674 Feb 12 21:04:06.082495 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 387/729] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:06 2022] GET /compute/v2.1/images/69dbe8c0-fc71-4f1e-9254-37cfb3e68b4a => generated 662 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:06.097883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.108247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.110151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.111684 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78290f69-8440-4175-aaad-eb8c196c0d74 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.173380 Feb 12 21:04:06.112345 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 343/730] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:05 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:06.225676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.226291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:06.234226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.234777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.235448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.235880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.335289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.335901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:06.341936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.342386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.343175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.343673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.376680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.384760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.386278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.389534 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-740ec635-236a-47c9-a35a-7edaa4b5bef0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.165751 Feb 12 21:04:06.389534 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 388/731] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:06 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:06.392298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e8545e81-0fbc-43f9-ace3-142a48c51bab req-2cd5bb8e-0f77-4ff8-9c66-79f7daa43a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c5a4cce-cafc-4baa-aa1b-a5284bac65ca", "tag": "793eba33-06ce-4fec-8b7c-1af8fdcaa0b3"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:06.393933 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:06.393933 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:06.402283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e8545e81-0fbc-43f9-ace3-142a48c51bab req-2cd5bb8e-0f77-4ff8-9c66-79f7daa43a9c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.402728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e8545e81-0fbc-43f9-ace3-142a48c51bab req-2cd5bb8e-0f77-4ff8-9c66-79f7daa43a9c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.414729 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e8545e81-0fbc-43f9-ace3-142a48c51bab req-2cd5bb8e-0f77-4ff8-9c66-79f7daa43a9c service nova] Creating event network-changed:793eba33-06ce-4fec-8b7c-1af8fdcaa0b3 for instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca on nch2-master-1 Feb 12 21:04:06.420401 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e8545e81-0fbc-43f9-ace3-142a48c51bab req-2cd5bb8e-0f77-4ff8-9c66-79f7daa43a9c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 Feb 12 21:04:06.421575 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 389/732] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:06.494383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.502520 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31e41cc8-c19b-4250-a6b5-d997c07428c5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.170924 Feb 12 21:04:06.503286 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 344/733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:06 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:06.688601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.689330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 5fbbe5de-bac4-4103-85c9-a40a65f89b37] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:06.696856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.697250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.698146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.698589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.714505 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] HTTP exception thrown: Instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 could not be found. Feb 12 21:04:06.715143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Returning 404 to user: Instance 5fbbe5de-bac4-4103-85c9-a40a65f89b37 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:06.715972 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dd6332db-e03c-40a9-8605-b8b0d512c1ac tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37" status: 404 len: 111 microversion: 2.1 time: 0.031869 Feb 12 21:04:06.716558 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 390/734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:06 2022] GET /compute/v2.1/servers/5fbbe5de-bac4-4103-85c9-a40a65f89b37 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:06.725206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.725809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:06.726701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:06.727318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:06.732150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.732857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.733535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.733810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.733987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.734261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.735134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:06.735738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:06.764894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:04:06.984341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:06.992739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b15e420-4339-4ef0-9af2-5af253b0a720 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.269595 Feb 12 21:04:06.993778 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 391/735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:06 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:07.097098 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-83592815-2f66-4c37-b101-6062aadb5b85 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 204 len: 0 microversion: 2.1 time: 0.375496 Feb 12 21:04:07.097948 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 345/736] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:04:06 2022] DELETE /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:04:07.105882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:07.106459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:07.113464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.113926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.114717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.115153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.131349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:07.132082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:07.139664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.140436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.141417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.141914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.256076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.263788 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73d784b2-5b9a-476b-946d-e21648b9121e tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1473 microversion: 2.1 time: 0.161626 Feb 12 21:04:07.264366 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 392/737] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:07 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1473 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:07.306037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.314762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.317540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.317801 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10322300-c5e8-4576-b208-667e13a3b9e1 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.191249 Feb 12 21:04:07.318362 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 346/738] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:07 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:07.405561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:07.406297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:07.413602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.414131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.419531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.419531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.524570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:07.525203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:07.533084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.534065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.535274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:07.535916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:07.588470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.597132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.598656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.601520 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2cf848f6-cf9a-4987-97ef-efac65768d31 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.199864 Feb 12 21:04:07.602603 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 393/739] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:07 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:07.715767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:07.758420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-765c0473-0d97-43ae-9df1-876f1691f742 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.241988 Feb 12 21:04:07.759681 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 347/740] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:07 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:07.901231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e57d75fe-fd98-4995-8d60-1b23c55ff725 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Calling method '.version_select at 0x7fa8fede00d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:07.963787 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e57d75fe-fd98-4995-8d60-1b23c55ff725 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 371 microversion: 2.1 time: 0.251467 Feb 12 21:04:07.964363 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 394/741] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:04:07 2022] GET /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:07.975429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7b9d66a-4e4c-478e-a9cb-c7670431940b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe5cd430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:07.976821 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:07.976821 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:08.014754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:08.014754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:08.018545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.019005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.019795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.020238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.048409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7b9d66a-4e4c-478e-a9cb-c7670431940b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.049202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7b9d66a-4e4c-478e-a9cb-c7670431940b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.050181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7b9d66a-4e4c-478e-a9cb-c7670431940b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.050745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7b9d66a-4e4c-478e-a9cb-c7670431940b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.171585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:08.178906 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-14a52202-4565-4ff4-a29a-55f8045fcf73 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.171368 Feb 12 21:04:08.179408 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 395/742] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:08 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:08.184300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80347708-9f72-4bdc-8aa4-6c2ed4f041f0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fef64700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:08.186961 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7b9d66a-4e4c-478e-a9cb-c7670431940b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 328 microversion: 2.1 time: 0.215490 Feb 12 21:04:08.189870 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 348/743] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:07 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:08.229467 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80347708-9f72-4bdc-8aa4-6c2ed4f041f0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/54befd77-21e0-467e-af7e-25b9136bf595" status: 200 len: 662 microversion: 2.1 time: 0.048794 Feb 12 21:04:08.230309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 396/744] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:08 2022] GET /compute/v2.1/images/54befd77-21e0-467e-af7e-25b9136bf595 => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:08.241846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a602486c-c94a-4cbc-a4ac-5033f9ddc44f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe5cd940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:08.280500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:08.284121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:08.289546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.290004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.290849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.291291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.296459 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a602486c-c94a-4cbc-a4ac-5033f9ddc44f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/54befd77-21e0-467e-af7e-25b9136bf595" status: 200 len: 662 microversion: 2.1 time: 0.058716 Feb 12 21:04:08.297072 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 349/745] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:08 2022] GET /compute/v2.1/images/54befd77-21e0-467e-af7e-25b9136bf595 => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:08.358422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1415343866", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:08.425322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:08.473509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:08.482584 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-30040aee-54b7-4bf1-ad56-d342e2819543 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1473 microversion: 2.1 time: 0.205823 Feb 12 21:04:08.483173 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 397/746] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:08 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1473 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:08.487756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:08.488531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:08.494615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.495072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.495854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.496449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.644588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:08.652628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:08.656028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:08.657150 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-141faf68-ca09-4eda-ac7d-d528a4d94e75 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.172869 Feb 12 21:04:08.657974 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 398/747] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:08 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:08.662417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-120741435", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:08.716984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:08.717641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:08.718391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:08.718812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:08.719257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:08.725269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:08.731924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.733159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.734355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.735052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.763965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Getting quotas for project 15de42462d64482fa5052897ac17b193. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:08.769615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Getting quotas for user 7406d4a03feb4f83be4ae3fcd237a0c6 and project 15de42462d64482fa5052897ac17b193. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:08.784003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.utils [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] cores quota exceeded for 15de42462d64482fa5052897ac17b193, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141726) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Feb 12 21:04:08.785700 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Feb 12 21:04:08.786675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:08.787738 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf919174-a9f1-4fa3-a3bb-1943d701f76f tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.483691 Feb 12 21:04:08.792189 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 350/748] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:08 2022] POST /compute/v2.1/servers => generated 111 bytes in 488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:08.797754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:08.798659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:08.805886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.806665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.807554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.808072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.948102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:08.948598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:08.949233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:08.949611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:08.950242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:08.960857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.961300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.962507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:08.962942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:08.980288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Getting quotas for project d8ed44c8eee2476593e75478c214644c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:08.984247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Getting quotas for user 4e42100a92414275a7218318b53388da and project d8ed44c8eee2476593e75478c214644c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:08.995042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:08.997888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:09.043819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:09.052473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:09.054233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:09.055341 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffa7d688-937d-4c58-a5c8-426fcf87bcef tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.261923 Feb 12 21:04:09.066665 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 351/749] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:08 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:09.066665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:09.066665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:09.067487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.067948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.068781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.069222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.130581 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-914590d7-9ea6-4642-b2e7-f5797ea922f6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471591 Feb 12 21:04:09.131444 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 399/750] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:04:09.136152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ec8dd3eb-7e99-4d2d-97f8-84ec18d63aa1 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fed85a60>, body: {"quota_set": {"cores": 20}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:09.138802 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:09.138802 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:09.217081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec8dd3eb-7e99-4d2d-97f8-84ec18d63aa1 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.217578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec8dd3eb-7e99-4d2d-97f8-84ec18d63aa1 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.218404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec8dd3eb-7e99-4d2d-97f8-84ec18d63aa1 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.218849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec8dd3eb-7e99-4d2d-97f8-84ec18d63aa1 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.245176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:09.272018 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6e7665a-464b-4dc5-a0ea-ab4841592581 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.215050 Feb 12 21:04:09.275984 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 352/751] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:09 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:09.286432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:09.287171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:09.295786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.297511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.297511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.297511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.462372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:09.470344 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6af4b520-ef14-45ff-a880-f4e87b2d70af tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.193154 Feb 12 21:04:09.470921 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 353/752] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:09 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:09.475509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-17428530", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:09.515249 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ec8dd3eb-7e99-4d2d-97f8-84ec18d63aa1 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 329 microversion: 2.1 time: 0.382653 Feb 12 21:04:09.522173 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 400/753] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:09 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 329 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:09.522783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-84c827c4-12b3-4f52-83f4-8bf1e2e7247a req-a211fede-7a8e-4971-84b0-30db1e72c015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7", "name": "network-vif-deleted", "tag": "3e469e4d-bd4c-43d8-966a-65aac1e95ee8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:09.524561 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:09.524561 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:09.526148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:09.533339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-84c827c4-12b3-4f52-83f4-8bf1e2e7247a req-a211fede-7a8e-4971-84b0-30db1e72c015 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.535169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-84c827c4-12b3-4f52-83f4-8bf1e2e7247a req-a211fede-7a8e-4971-84b0-30db1e72c015 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.545587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-84c827c4-12b3-4f52-83f4-8bf1e2e7247a req-a211fede-7a8e-4971-84b0-30db1e72c015 service nova] Creating event network-vif-deleted:3e469e4d-bd4c-43d8-966a-65aac1e95ee8 for instance 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 on nch1-master-1 Feb 12 21:04:09.550694 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-84c827c4-12b3-4f52-83f4-8bf1e2e7247a req-a211fede-7a8e-4971-84b0-30db1e72c015 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Feb 12 21:04:09.551274 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 401/754] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:09.556659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:09.558053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:09.566030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.566429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.567386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.567774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.642525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b832260e76e44c6a35fa2402160d0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7203bbecaaef4f3ba3ff7f46109eaff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:09.650059 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a44058c1-b4a3-4fcd-a726-26b160693178 tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 200 len: 1303 microversion: 2.1 time: 0.097595 Feb 12 21:04:09.650910 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 402/755] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:09 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:09.655606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0118a290-fb29-4201-8525-486caeda5971 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Calling method '.version_select at 0x7fa8fedd7310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:09.738687 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0118a290-fb29-4201-8525-486caeda5971 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 371 microversion: 2.1 time: 0.086878 Feb 12 21:04:09.739812 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 403/756] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:04:09 2022] GET /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:09.744400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:09.745254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:09.752893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.753725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.754690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.755286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.788259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:09.788814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:09.790212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:09.790933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:09.791653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:09.806909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.807567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.811640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:09.811640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:09.842746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Getting quotas for project d8ed44c8eee2476593e75478c214644c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:09.848132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Getting quotas for user 4e42100a92414275a7218318b53388da and project d8ed44c8eee2476593e75478c214644c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:09.871149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:09.876875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:10.020839 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b32de823-8933-4140-b70b-d9ffe1750f3e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548300 Feb 12 21:04:10.022124 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 354/757] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:04:10.027343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3bcc9730-fb82-4fd4-9c28-5818d9705fee tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe6369d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:10.030050 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:10.030050 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:10.120624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.133662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.134490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bcc9730-fb82-4fd4-9c28-5818d9705fee tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.134942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bcc9730-fb82-4fd4-9c28-5818d9705fee tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.135758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bcc9730-fb82-4fd4-9c28-5818d9705fee tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.136307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bcc9730-fb82-4fd4-9c28-5818d9705fee tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.136874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.139191 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b08dae5e-180b-4e9d-95ab-7299e432a094 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.397313 Feb 12 21:04:10.140177 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 404/758] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:09 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:10.158159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13a1d9c7-8799-4e76-a335-40df5e3e001c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:10.159119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-13a1d9c7-8799-4e76-a335-40df5e3e001c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:10.228820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-13a1d9c7-8799-4e76-a335-40df5e3e001c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.236675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13a1d9c7-8799-4e76-a335-40df5e3e001c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1216 microversion: 2.1 time: 0.092173 Feb 12 21:04:10.237496 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 405/759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:10 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:10.250161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:10.250917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:10.258435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.258888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.259682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.260141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.329681 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3bcc9730-fb82-4fd4-9c28-5818d9705fee tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 328 microversion: 2.1 time: 0.306194 Feb 12 21:04:10.330498 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 355/760] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:10 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:10.335530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-63ae6aa7-2cb0-438d-94f5-457eb30c7872 req-dccb161d-335b-4327-8a34-042c09a21b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac07934b-e366-4ce9-9d0b-d6f3ee7833f9", "name": "network-vif-plugged", "status": "completed", "tag": "692da1ed-6391-4b0f-95c0-4a1ac462850c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:10.337216 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:10.337216 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:10.346805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-63ae6aa7-2cb0-438d-94f5-457eb30c7872 req-dccb161d-335b-4327-8a34-042c09a21b3c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.347467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-63ae6aa7-2cb0-438d-94f5-457eb30c7872 req-dccb161d-335b-4327-8a34-042c09a21b3c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.359404 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-63ae6aa7-2cb0-438d-94f5-457eb30c7872 req-dccb161d-335b-4327-8a34-042c09a21b3c service nova] Creating event network-vif-plugged:692da1ed-6391-4b0f-95c0-4a1ac462850c for instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 on nch2-master-1 Feb 12 21:04:10.365016 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-63ae6aa7-2cb0-438d-94f5-457eb30c7872 req-dccb161d-335b-4327-8a34-042c09a21b3c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Feb 12 21:04:10.365884 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 356/761] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:10.371134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:10.372083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:10.380133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.380498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.381417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.381865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.528744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.542869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.544771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.546409 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc03c487-3801-43ac-9414-7b9cb4ab0b43 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.307506 Feb 12 21:04:10.547081 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 406/762] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:10 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:10.556913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-254591364", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:10.568819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.579544 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fcae998e-c595-4245-8720-70e6c175b206 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.212107 Feb 12 21:04:10.592295 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 357/763] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:10 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:10.597539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:10.598302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:10.605601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.607925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.610042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.610171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.647266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:10.831050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:10.839195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a68dd2fc-f998-4bc3-b6a9-2c370ee7b5ab tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.246241 Feb 12 21:04:10.840056 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 358/764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:10 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:10.846698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:10.847531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] [instance: 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:10.854207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.854663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.855457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.855897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.871269 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] HTTP exception thrown: Instance 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 could not be found. Feb 12 21:04:10.871871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] Returning 404 to user: Instance 3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:10.873076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b717cdb4-010d-4149-8b0c-107f813065ce tempest-LiveMigrationNegativeTest-1230802664 tempest-LiveMigrationNegativeTest-1230802664-project] 10.222.0.31 "GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7" status: 404 len: 111 microversion: 2.1 time: 0.031262 Feb 12 21:04:10.873936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 359/765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:10 2022] GET /compute/v2.1/servers/3eb8b0a7-d21b-4cc8-a2b3-d762b1a834e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:10.883436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:10.883864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:10.884517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:10.884943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:10.885435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:10.896146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.896599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.898059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:10.898526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:10.916722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Getting quotas for project 15de42462d64482fa5052897ac17b193. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:10.921558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Getting quotas for user 7406d4a03feb4f83be4ae3fcd237a0c6 and project 15de42462d64482fa5052897ac17b193. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:10.933691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.utils [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] instances quota exceeded for 15de42462d64482fa5052897ac17b193, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141727) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Feb 12 21:04:10.934481 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Feb 12 21:04:10.935603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:10.936485 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f6914a79-79bb-4a26-b789-499ba36a73d7 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.388228 Feb 12 21:04:10.940330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 407/766] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:10 2022] POST /compute/v2.1/servers => generated 119 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:10.945170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd565938-71ab-464a-b953-42d1b569bd17 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe651d30>, body: {"quota_set": {"instances": 10}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:10.947042 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:10.947042 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:11.016343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd565938-71ab-464a-b953-42d1b569bd17 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.016797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd565938-71ab-464a-b953-42d1b569bd17 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.017641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd565938-71ab-464a-b953-42d1b569bd17 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.018073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd565938-71ab-464a-b953-42d1b569bd17 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.157796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:11.158664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:11.164898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.165401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.166209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.166645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.201929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd565938-71ab-464a-b953-42d1b569bd17 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 329 microversion: 2.1 time: 0.260201 Feb 12 21:04:11.202797 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 360/767] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:10 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 329 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:11.214776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dff5add6-c839-4660-8fa3-428811a4036d tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Calling method '.version_select at 0x7fa8fe636940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:11.304907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dff5add6-c839-4660-8fa3-428811a4036d tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 371 microversion: 2.1 time: 0.094236 Feb 12 21:04:11.306360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 361/768] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:04:11 2022] GET /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:11.313738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:11.315272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:11.322318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.322973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.323770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.324203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.330196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.338768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.340420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.342467 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c6abe3d8-ebfd-491e-8c43-9db87d7b36fe tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.187990 Feb 12 21:04:11.343572 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 408/769] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:11 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:04:11.348747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8fa9d9ca-4b07-41da-8acd-2be0741c1e5b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fedd7310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:11.350578 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:11.350578 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:11.400263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.409105 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9a634c7c-8cd1-4477-b8f7-a273df31dc77 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1220 microversion: 2.1 time: 0.100353 Feb 12 21:04:11.410039 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 362/770] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:11 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:11.561331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fa9d9ca-4b07-41da-8acd-2be0741c1e5b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.561824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fa9d9ca-4b07-41da-8acd-2be0741c1e5b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.562786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fa9d9ca-4b07-41da-8acd-2be0741c1e5b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.563236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fa9d9ca-4b07-41da-8acd-2be0741c1e5b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.564787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:11.565671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:11.578171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.578625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.579426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.579861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.727010 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8fa9d9ca-4b07-41da-8acd-2be0741c1e5b tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 325 microversion: 2.1 time: 0.382189 Feb 12 21:04:11.729036 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 409/771] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:11 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:11.766938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:11.770280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:11.798178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.799130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.799871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.811734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.811734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.811999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.811999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.811999 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-304f50d2-3aeb-40fd-8d55-d2477df03397 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1362 microversion: 2.25 time: 0.249527 Feb 12 21:04:11.812318 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 363/772] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:11 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:11.855876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:11.856492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:11.875290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.875743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.876796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:11.877234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:11.978079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:11.988270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03118636-ec46-4aa1-898a-a0f28aa9afb1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.257896 Feb 12 21:04:11.988856 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 410/773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:11 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:12.004798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-226869924", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:12.083816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:12.084213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:12.093517 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5cbc9c35-fde5-4815-b653-8069cec7678a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.240752 Feb 12 21:04:12.094112 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 364/774] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:11 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:12.326310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:12.327565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:12.328221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:12.328953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:12.337281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:12.347919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.348374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.349488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.350002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.370173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Getting quotas for project 15de42462d64482fa5052897ac17b193. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:12.370976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:12.372334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:12.374389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Getting quotas for user 7406d4a03feb4f83be4ae3fcd237a0c6 and project 15de42462d64482fa5052897ac17b193. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:12.382626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.383433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.384352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.385116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.398153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.utils [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] ram quota exceeded for 15de42462d64482fa5052897ac17b193, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=141727) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Feb 12 21:04:12.398724 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Feb 12 21:04:12.399337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:12.400196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-174aec0d-29df-4369-b370-7a7028f4a41e tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.407468 Feb 12 21:04:12.400843 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 411/775] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:11 2022] POST /compute/v2.1/servers => generated 110 bytes in 409 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:12.407633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-573024de-9911-4249-8833-391877f72cc4 req-b4cee723-239f-4486-aa08-9e1adffafde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a7bdc-edf9-4121-9962-f3ae48b82047", "name": "network-vif-plugged", "status": "completed", "tag": "32360a5d-8e56-4c23-9414-36fca780d88e"}, {"server_uuid": "8c5a4cce-cafc-4baa-aa1b-a5284bac65ca", "name": "network-vif-plugged", "status": "completed", "tag": "793eba33-06ce-4fec-8b7c-1af8fdcaa0b3"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:12.409785 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:12.409785 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:12.430031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-573024de-9911-4249-8833-391877f72cc4 req-b4cee723-239f-4486-aa08-9e1adffafde1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.430486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-573024de-9911-4249-8833-391877f72cc4 req-b4cee723-239f-4486-aa08-9e1adffafde1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.446722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-573024de-9911-4249-8833-391877f72cc4 req-b4cee723-239f-4486-aa08-9e1adffafde1 service nova] Creating event network-vif-plugged:32360a5d-8e56-4c23-9414-36fca780d88e for instance 831a7bdc-edf9-4121-9962-f3ae48b82047 on nch2-master-1 Feb 12 21:04:12.447424 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-573024de-9911-4249-8833-391877f72cc4 req-b4cee723-239f-4486-aa08-9e1adffafde1 service nova] Creating event network-vif-plugged:793eba33-06ce-4fec-8b7c-1af8fdcaa0b3 for instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca on nch2-master-1 Feb 12 21:04:12.455083 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-573024de-9911-4249-8833-391877f72cc4 req-b4cee723-239f-4486-aa08-9e1adffafde1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052814 Feb 12 21:04:12.455864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 412/776] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:12.464462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b1a0443-9d90-4445-9e14-c0f6fbfdbb73 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fede0700>, body: {"quota_set": {"ram": 51200}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:12.466364 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:12.466364 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:12.599947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:12.616441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:12.622023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:12.624420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e9c96c7-7dfe-490e-8deb-1199319a3264 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.258081 Feb 12 21:04:12.628936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 365/777] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:12 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:04:12.642725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:12.642930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:12.653821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.654588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.655615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.656239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.772089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:12.783696 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-768bcde0-b856-4086-97d0-caf155381c7c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1268 microversion: 2.1 time: 0.154110 Feb 12 21:04:12.785040 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 366/778] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:12 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:12.827351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b1a0443-9d90-4445-9e14-c0f6fbfdbb73 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.827810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b1a0443-9d90-4445-9e14-c0f6fbfdbb73 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.828633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b1a0443-9d90-4445-9e14-c0f6fbfdbb73 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.829073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b1a0443-9d90-4445-9e14-c0f6fbfdbb73 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.829667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:12.830391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:12.837738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.838410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:12.840299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:12.840299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.135592 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b1a0443-9d90-4445-9e14-c0f6fbfdbb73 tempest-QuotasAdminNegativeTest-824125224 tempest-QuotasAdminNegativeTest-824125224-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 200 len: 329 microversion: 2.1 time: 0.675554 Feb 12 21:04:13.142837 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 413/779] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:12 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 329 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:13.142837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:13.142837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:13.148894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.149306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.150136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.150685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.248267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:13.261032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:13.265036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:13.270500 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c9d7ba9-b536-4f76-87f0-2eb41ef1a78f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1558 microversion: 2.25 time: 0.445796 Feb 12 21:04:13.271246 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 367/780] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:12 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1558 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:13.277322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:13.278210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:13.285411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.286194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.287223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.287725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.313216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:13.323378 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5c5db7b-16ea-4f5d-a208-c12b1dafeb61 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.185380 Feb 12 21:04:13.324088 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 414/781] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:13 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:13.329114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33ebf289-a39c-428d-beec-ebc3c60b3622 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Action: 'update', calling method: .version_select at 0x7fa8feea7040>, body: {"quota_set": {"ram": 0}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:13.330770 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:13.330770 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:13.331683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33ebf289-a39c-428d-beec-ebc3c60b3622 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7406d4a03feb4f83be4ae3fcd237a0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15de42462d64482fa5052897ac17b193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:13.332318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33ebf289-a39c-428d-beec-ebc3c60b3622 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:13.339593 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-33ebf289-a39c-428d-beec-ebc3c60b3622 tempest-QuotasAdminNegativeTest-1106696563 tempest-QuotasAdminNegativeTest-1106696563-project] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193" status: 403 len: 116 microversion: 2.1 time: 0.008099 Feb 12 21:04:13.339593 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 415/782] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:04:13 2022] PUT /compute/v2.1/os-quota-sets/15de42462d64482fa5052897ac17b193 => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:13.577603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:13.585791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14e77cf7-7bac-416f-8fe9-9f82ea14c5fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1309 microversion: 2.1 time: 0.313470 Feb 12 21:04:13.586608 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 368/783] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:13 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1309 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:13.655603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:13.656527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:13.668120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.668755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.669805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.671905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.699284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:13.700295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:13.708542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.709090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.710047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.710486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.883001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:13.959609 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e350ddf5-a348-42f7-a9eb-dd4e6a5a6acd tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 2051 microversion: 2.25 time: 0.624282 Feb 12 21:04:13.960231 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 416/784] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:13 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 2051 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:13.966799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:13.967769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:13.976561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.977021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:13.982400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:13.982400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.077149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:14.086098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f8038eee-f79f-4d3f-ba0f-05b34bc0b9ec tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1274 microversion: 2.1 time: 0.124731 Feb 12 21:04:14.087673 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 417/785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:13 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:14.092672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:14.093348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:14.095246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:14.102480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.102992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.111799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.112159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:14.112272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.112370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:14.112370 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a2a57f26-6aa5-44b6-a888-ef3b4831e5e8 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1358 microversion: 2.21 time: 0.460118 Feb 12 21:04:14.112370 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 369/786] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:13 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1358 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:04:14.341907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:14.343202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:14.354100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.355292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.356263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.362402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.371612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:14.394287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-afedf8ec-a288-480a-8a2d-a8805ac01066 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 2051 microversion: 2.25 time: 0.305312 Feb 12 21:04:14.395606 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 418/787] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:14 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 2051 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:14.413530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eae97524-f1d3-4c68-aaa4-3d212f2b6425 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:14.415390 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:14.415390 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:14.417369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eae97524-f1d3-4c68-aaa4-3d212f2b6425 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.417950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eae97524-f1d3-4c68-aaa4-3d212f2b6425 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.418932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eae97524-f1d3-4c68-aaa4-3d212f2b6425 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.420123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eae97524-f1d3-4c68-aaa4-3d212f2b6425 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.458900 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eae97524-f1d3-4c68-aaa4-3d212f2b6425 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050318 Feb 12 21:04:14.459641 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 419/788] 10.222.0.31 () {60 vars in 1216 bytes} [Sat Feb 12 21:04:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:04:14.471027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:14.472245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:14.478471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.479045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.480150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.480526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.511851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'flavor' on Instance uuid ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:14.529603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Going to try to live migrate instance to nch1-master-1 {{(pid=141727) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:04:14.804980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:14.813761 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e472aaaa-afa1-4d59-adb1-4f0f9866b0e8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.477145 Feb 12 21:04:14.814384 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 370/789] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:14 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:14.819195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:14.819807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:14.827291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.827817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:14.828859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:14.829305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:15.461681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:15.469180 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e47ac94-b3b0-4882-8663-7da1049b7094 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1491 microversion: 2.1 time: 0.653543 Feb 12 21:04:15.469958 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 371/790] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:14 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1491 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:15.479746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:15.479746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:15.487036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:15.487036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:15.487642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:15.488364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:15.891004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:15.901092 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-feec7fdd-3a9a-4165-bbaa-df5418d3070d tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.430061 Feb 12 21:04:15.902489 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 372/791] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:15 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:15.934178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:15.936720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:15.944021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:15.944677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:15.948242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:15.948242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:16.218999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:16.228196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:16.230099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:16.239589 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd91348e-408e-4ba5-846c-1876007f8541 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1550 microversion: 2.21 time: 0.335654 Feb 12 21:04:16.240272 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 373/792] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:15 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1550 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:16.268618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:16.269241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:16.276251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:16.277404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:16.278218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:16.278856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:16.603807 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b137e56-140a-4366-8d26-3aa4a20e6c15 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1642 microversion: 2.1 time: 0.361902 Feb 12 21:04:16.604460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 374/793] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:16 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1642 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:16.966525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2dac7a9f-b1c7-4270-a826-cb5d60e685af tempest-NetworksTest-2062418911 tempest-NetworksTest-2062418911-project-admin] Calling method '.version_select at 0x7fa8fe651820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.279509 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2dac7a9f-b1c7-4270-a826-cb5d60e685af tempest-NetworksTest-2062418911 tempest-NetworksTest-2062418911-project-admin] 10.222.0.31 "GET /compute/v2.1/os-networks" status: 200 len: 6756 microversion: 2.1 time: 0.673401 Feb 12 21:04:17.284058 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 375/794] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:04:16 2022] GET /compute/v2.1/os-networks => generated 6756 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:17.288977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.289667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:17.297334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.297811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.299093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.299533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.358376 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-474e69f5-8648-4629-9f11-90cdde860f0f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9/action" status: 202 len: 0 microversion: 2.25 time: 2.890865 Feb 12 21:04:17.359376 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 420/795] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:04:14 2022] POST /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9/action => generated 0 bytes in 2893 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:04:17.365161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.365930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:17.373217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.373712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.374512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.374949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.400904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:04:17.515263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:17.522869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-416e265d-bf0b-4a14-a483-0006b6b760c1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.237542 Feb 12 21:04:17.523626 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 376/796] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:17 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:17.528392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8fd464f7-1f69-405d-83ca-9e1a50696f0e req-e29a5c15-7872-4b4f-a04c-67acc2c04dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:17.530836 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:17.530836 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:17.537972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8fd464f7-1f69-405d-83ca-9e1a50696f0e req-e29a5c15-7872-4b4f-a04c-67acc2c04dc8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.538439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8fd464f7-1f69-405d-83ca-9e1a50696f0e req-e29a5c15-7872-4b4f-a04c-67acc2c04dc8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.549690 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8fd464f7-1f69-405d-83ca-9e1a50696f0e req-e29a5c15-7872-4b4f-a04c-67acc2c04dc8 service nova] Creating event network-changed:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:04:17.555109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8fd464f7-1f69-405d-83ca-9e1a50696f0e req-e29a5c15-7872-4b4f-a04c-67acc2c04dc8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030196 Feb 12 21:04:17.556399 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 377/797] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:17.570467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a1b8571-8e00-48a2-8ac7-991ade7d66aa tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.572188 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:17.572188 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:17.573728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a1b8571-8e00-48a2-8ac7-991ade7d66aa tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.578116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a1b8571-8e00-48a2-8ac7-991ade7d66aa tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.579158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a1b8571-8e00-48a2-8ac7-991ade7d66aa tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.579531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a1b8571-8e00-48a2-8ac7-991ade7d66aa tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.616643 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a1b8571-8e00-48a2-8ac7-991ade7d66aa tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059023 Feb 12 21:04:17.618097 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 378/798] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:04:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:17.632922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.634608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:17.645319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.645797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.646684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.651386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.674624 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ecb4360-eea0-4d31-8cbd-c55dafdd2178 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 204 len: 0 microversion: 2.21 time: 0.313466 Feb 12 21:04:17.681404 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 421/799] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:04:17 2022] DELETE /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:04:17.681550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9cf198bf-7fec-4792-b485-5f99cc5650bc tempest-NetworksTest-2062418911 tempest-NetworksTest-2062418911-project-admin] Calling method '.version_select at 0x7fa8fedd1d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.851963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9cf198bf-7fec-4792-b485-5f99cc5650bc tempest-NetworksTest-2062418911 tempest-NetworksTest-2062418911-project-admin] 10.222.0.31 "GET /compute/v2.1/os-networks/7cc7114b-c087-413f-bd63-e2248ab8f781" status: 200 len: 652 microversion: 2.1 time: 0.175037 Feb 12 21:04:17.856498 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 422/800] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:04:17 2022] GET /compute/v2.1/os-networks/7cc7114b-c087-413f-bd63-e2248ab8f781 => generated 652 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:17.859846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.860583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:17.886079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.887270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.892728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.892728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.956164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:17.965090 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e721c547-cc25-438a-92b4-44b985ec424f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.345642 Feb 12 21:04:17.965731 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 379/801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:17 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:17.971419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:17.973192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:17.982399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.983140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:17.984023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:17.984493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:18.045171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.054459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.056031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.057009 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-caa0b0f4-cd07-46bc-b472-16eeeb1dcdf0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.202502 Feb 12 21:04:18.057638 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 423/802] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:17 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:18.062505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-632e1b9b-3eda-4c58-bb9a-315bfba1d33b tempest-NetworksTest-2062418911 tempest-NetworksTest-2062418911-project-admin] Calling method '.version_select at 0x7fa8fedd11f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:18.197023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-632e1b9b-3eda-4c58-bb9a-315bfba1d33b tempest-NetworksTest-2062418911 tempest-NetworksTest-2062418911-project-admin] 10.222.0.31 "GET /compute/v2.1/os-networks" status: 200 len: 6756 microversion: 2.1 time: 0.138334 Feb 12 21:04:18.197649 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 424/803] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:04:18 2022] GET /compute/v2.1/os-networks => generated 6756 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:18.370323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.384662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.387055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.388545 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86a82449-0574-41e6-b94f-755b4db0eecd tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1556 microversion: 2.21 time: 0.420859 Feb 12 21:04:18.399134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 380/804] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:17 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1556 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:18.541157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:18.541861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:18.549441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:18.549896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:18.551144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:18.551845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:18.731268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:18.773963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c309e14-c8bf-477a-baf8-2d07904d15d7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.229889 Feb 12 21:04:18.773963 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 425/805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:18 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:18.983613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:18.984288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:18.990961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:18.991404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:18.992100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:18.992499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.074815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:19.075677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:19.081764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.082220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.083235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.083671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.345255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.354559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.356463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.358286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b4c0c78f-674d-4304-a3a0-6a00866f412a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.287157 Feb 12 21:04:19.358869 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 426/806] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:19 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:04:19.408711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:19.409626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:19.416329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.416848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.417722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.418172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.589121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.601827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.605884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.608070 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a9541a9-6b19-4cc0-b186-0d48fdaa36af tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1556 microversion: 2.21 time: 0.204260 Feb 12 21:04:19.608776 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 427/807] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:19 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:19.612082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:19.620588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82b8ab76-c61f-460b-8228-5e13a9dcb5b1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.641329 Feb 12 21:04:19.628960 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 381/808] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:18 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:19.629282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a3f60b44-a5f4-437d-8412-a24d1efd1546 req-9f8382fc-8cce-4c44-a6e4-58e297460b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3267b0c7-25e2-44b9-afd1-21270d2d53bb", "tag": "31030585-0e0e-44d7-bd66-e3136d668ce8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:19.629282 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:19.629282 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:19.648947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a3f60b44-a5f4-437d-8412-a24d1efd1546 req-9f8382fc-8cce-4c44-a6e4-58e297460b53 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.649750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a3f60b44-a5f4-437d-8412-a24d1efd1546 req-9f8382fc-8cce-4c44-a6e4-58e297460b53 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.674116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a3f60b44-a5f4-437d-8412-a24d1efd1546 req-9f8382fc-8cce-4c44-a6e4-58e297460b53 service nova] Creating event network-changed:31030585-0e0e-44d7-bd66-e3136d668ce8 for instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb on nch1-master-1 Feb 12 21:04:19.680743 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a3f60b44-a5f4-437d-8412-a24d1efd1546 req-9f8382fc-8cce-4c44-a6e4-58e297460b53 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070092 Feb 12 21:04:19.681939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 428/809] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:19.788247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:19.789081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:19.796364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.797773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:19.798214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:19.798862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.329793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:20.353472 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3583b8f5-2bd1-480a-b1be-e71c08f030cc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.558434 Feb 12 21:04:20.353472 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 382/810] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:19 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:20.377777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:20.378477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:20.385923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:20.386372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.387316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:20.388626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.605960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:20.614844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:20.620202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:20.620202 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5489fbce-c965-4bab-86d6-2d4d62d0f852 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.245761 Feb 12 21:04:20.620202 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 429/811] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:20 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:20.629576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:20.631103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:20.646725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:20.648690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.649653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:20.651053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:20.651485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:20.652205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.665553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:20.668395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.672277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:20.673131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:20.940007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:20.949382 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-608e43f6-8901-451a-b4ae-c38792a3f544 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.311433 Feb 12 21:04:20.950183 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 430/812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:20 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:20.992542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ffffeab-c309-41f1-ac60-d0dc8f4b322e", "device": "/dev/xvdb"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:20.999456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:21.005954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.006771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.007609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.008295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.238392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.249266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.252612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.254006 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c92e7fb-9c0f-4493-befe-61b8f77ee19a tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1556 microversion: 2.21 time: 0.631524 Feb 12 21:04:21.254797 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 383/813] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:20 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1556 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:21.365618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:21.366307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:21.382446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.382905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.384515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.384953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.589950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.598059 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9596ef76-674b-4534-a13a-fd6dd7cbecf5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.241368 Feb 12 21:04:21.598861 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 384/814] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:21 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:21.637797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:21.639442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:21.647140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.647899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.649119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.649760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.824836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.834692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.836336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:21.837540 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a2ee1997-dcf8-4212-8845-e80aae259fb1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.205234 Feb 12 21:04:21.848730 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 385/815] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:21 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:21.848730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac07934b-e366-4ce9-9d0b-d6f3ee7833f9", "name": "network-vif-unplugged", "status": "completed", "tag": "692da1ed-6391-4b0f-95c0-4a1ac462850c"}, {"server_uuid": "8c5a4cce-cafc-4baa-aa1b-a5284bac65ca", "name": "network-vif-deleted", "tag": "793eba33-06ce-4fec-8b7c-1af8fdcaa0b3"}, {"name": "network-changed", "server_uuid": "ac07934b-e366-4ce9-9d0b-d6f3ee7833f9", "tag": "692da1ed-6391-4b0f-95c0-4a1ac462850c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:21.848730 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:21.848730 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:21.857769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.857769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.868648 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] Creating event network-vif-unplugged:692da1ed-6391-4b0f-95c0-4a1ac462850c for instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 on nch2-master-1 Feb 12 21:04:21.869175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] Creating event network-vif-deleted:793eba33-06ce-4fec-8b7c-1af8fdcaa0b3 for instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca on nch2-master-1 Feb 12 21:04:21.870116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] Creating event network-changed:692da1ed-6391-4b0f-95c0-4a1ac462850c for instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 on nch2-master-1 Feb 12 21:04:21.878119 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a49f2a54-b926-4bfb-8296-f181f942f5a4 req-c5179844-4cbe-411f-87fa-42206627fa93 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.038262 Feb 12 21:04:21.878741 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 386/816] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:21.968299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:21.969082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:21.975628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.976156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:21.976956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:21.977403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.225617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:22.234131 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-74acf5a5-5aab-456e-becc-44948d0ec7b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.270052 Feb 12 21:04:22.235990 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 387/817] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:21 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:22.274160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:22.274770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:22.281462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.281917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.282718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.283229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.319867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.320340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.320787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lazy-loading 'fault' on Instance uuid 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:22.375138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:22.383691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:22.385233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b24a260e57504ca08edec98b4e64fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9030a13fac41bc8e6af51b4f3328a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:22.386414 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78c7d8af-5da9-443e-9dba-586fd1310351 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 200 len: 1348 microversion: 2.21 time: 0.116163 Feb 12 21:04:22.386983 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 388/818] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:22 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 1348 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:22.411213 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0c2f7cfe-57e2-4591-b62b-da5604c7e391 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "POST /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.415257 Feb 12 21:04:22.411213 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 431/819] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:04:20 2022] POST /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments => generated 194 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:22.615941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:22.616665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:22.623571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.624634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.625829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.626726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.836369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:22.847145 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2bcba8c-05a5-4ce5-83d4-8e2b79ad2bbf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.235500 Feb 12 21:04:22.848945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 389/820] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:22 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:22.861068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:22.861929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:22.872417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.872876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:22.876161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:22.876161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.072220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:23.081604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:23.083412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:23.084617 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f6abf06-f63f-468a-b598-c6409c85c5f7 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.228195 Feb 12 21:04:23.085526 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 432/821] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:22 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:23.255626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:23.256312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:23.264923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.265392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.266373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.266974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.405329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:23.406030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:23.415102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.415832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.419794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.420291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.451201 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] HTTP exception thrown: Instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca could not be found. Feb 12 21:04:23.452949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Returning 404 to user: Instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:23.456098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f118a241-eedb-45b0-a35a-2b572be84fde tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 404 len: 111 microversion: 2.21 time: 0.053127 Feb 12 21:04:23.457345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 433/822] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:23 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:04:23.468818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '.version_select at 0x7fa8fed508b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:23.469169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:23.476495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:23.477920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.478550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.479597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.480189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.492084 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-295131ad-13b3-4c83-8fcf-d3a067e27247 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.239952 Feb 12 21:04:23.492084 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 390/823] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:23 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:23.589528 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ffe76350-5434-46fa-acbb-c416f67f413b tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.125600 Feb 12 21:04:23.589528 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 434/824] 10.222.0.31 () {60 vars in 1336 bytes} [Sat Feb 12 21:04:23 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca/os-instance-actions => generated 611 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:04:23.600968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:23.601711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:23.611264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.612438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.613488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.614513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.633597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] HTTP exception thrown: Instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca could not be found. Feb 12 21:04:23.634487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Returning 404 to user: Instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:23.635709 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8ee9a77-7861-4256-ac27-46023f18aab6 tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 404 len: 111 microversion: 2.21 time: 0.038663 Feb 12 21:04:23.644622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:23.645686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] [instance: 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:23.648765 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 391/825] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:04:23 2022] DELETE /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:04:23.652649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.654020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.654992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.655768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.672894 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] HTTP exception thrown: Instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca could not be found. Feb 12 21:04:23.673914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] Returning 404 to user: Instance 8c5a4cce-cafc-4baa-aa1b-a5284bac65ca could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:23.675200 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9b154c0-e609-4d7a-8e95-dcfb029267de tempest-InstanceActionsV221TestJSON-215540132 tempest-InstanceActionsV221TestJSON-215540132-project] 10.222.0.31 "GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca" status: 404 len: 111 microversion: 2.21 time: 0.034132 Feb 12 21:04:23.679565 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 435/826] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:23 2022] GET /compute/v2.1/servers/8c5a4cce-cafc-4baa-aa1b-a5284bac65ca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:04:23.865323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:23.866219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:23.874844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.875553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:23.876878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:23.877650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:24.031729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:24.043396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36838467-e8fc-45b6-904d-5f1513b957a0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1476 microversion: 2.1 time: 0.181685 Feb 12 21:04:24.045194 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 392/827] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:23 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:24.110940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:24.112087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:24.119591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:24.124024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:24.124024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:24.124309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:24.363734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:24.376674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:24.378528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:24.382889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f96916ee-9ff8-4ac2-b88a-47431ae2b63d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.279796 Feb 12 21:04:24.384773 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 436/828] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:24 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:24.507818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:24.510817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:24.521130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:24.522061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:24.523410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:24.524197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:24.695012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-62f38e1b-8ac2-4740-9af7-8231dc8ff690 tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] Calling method '.version_select at 0x7fa8fe5a1700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:24.697427 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:24.697427 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:24.712683 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-62f38e1b-8ac2-4740-9af7-8231dc8ff690 tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.340817 Feb 12 21:04:24.713271 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 393/829] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:04:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:24.725497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4fe7e505-a42c-43f1-a340-c4029886394e tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe754dc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:24.728202 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:24.728202 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:24.760676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:24.769169 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62e1db52-b923-45a2-9260-55d48f4767c2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.265729 Feb 12 21:04:24.770069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 437/830] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:24 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:24.774808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-21328a9e-8036-421b-8a63-dff42bb12887 req-fcda39f4-2088-4b4b-9ca9-c795c296c722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3267b0c7-25e2-44b9-afd1-21270d2d53bb", "name": "network-vif-plugged", "status": "completed", "tag": "31030585-0e0e-44d7-bd66-e3136d668ce8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:24.776576 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:24.776576 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:24.783688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-21328a9e-8036-421b-8a63-dff42bb12887 req-fcda39f4-2088-4b4b-9ca9-c795c296c722 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:24.784224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-21328a9e-8036-421b-8a63-dff42bb12887 req-fcda39f4-2088-4b4b-9ca9-c795c296c722 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:24.797459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-21328a9e-8036-421b-8a63-dff42bb12887 req-fcda39f4-2088-4b4b-9ca9-c795c296c722 service nova] Creating event network-vif-plugged:31030585-0e0e-44d7-bd66-e3136d668ce8 for instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb on nch1-master-1 Feb 12 21:04:24.803253 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-21328a9e-8036-421b-8a63-dff42bb12887 req-fcda39f4-2088-4b4b-9ca9-c795c296c722 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031888 Feb 12 21:04:24.803848 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 438/831] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:25.074367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:25.075551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:25.088685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.091480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:25.092866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.094163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:25.266876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:25.274856 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-298d277d-6dfa-4826-8e51-0e38d9eb864c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1475 microversion: 2.1 time: 0.207870 Feb 12 21:04:25.275701 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 439/832] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:25 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1475 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:25.407014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:25.408095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:25.418470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.419804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:25.422150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.423507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:25.708644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:25.729057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:25.730914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:25.732244 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77137029-5c20-4d88-b0e3-8f1e7203a160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.329508 Feb 12 21:04:25.733800 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 440/833] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:25 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:04:25.745621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1646e318-6df2-4aa4-a1f3-7cd18d532383 req-2c1d81fd-65bf-4e01-be36-5ee0abfa9006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8e14fe-6904-44f4-a8bf-c1e9b349e419", "name": "network-vif-unplugged", "status": "completed", "tag": "e68c6c44-abe5-4ce9-ab41-24f9c4276607"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:25.749005 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:25.749005 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:25.757078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1646e318-6df2-4aa4-a1f3-7cd18d532383 req-2c1d81fd-65bf-4e01-be36-5ee0abfa9006 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.757078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1646e318-6df2-4aa4-a1f3-7cd18d532383 req-2c1d81fd-65bf-4e01-be36-5ee0abfa9006 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:25.774156 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1646e318-6df2-4aa4-a1f3-7cd18d532383 req-2c1d81fd-65bf-4e01-be36-5ee0abfa9006 service nova] Creating event network-vif-unplugged:e68c6c44-abe5-4ce9-ab41-24f9c4276607 for instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 on nch1-master-1 Feb 12 21:04:25.782601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-1646e318-6df2-4aa4-a1f3-7cd18d532383 req-2c1d81fd-65bf-4e01-be36-5ee0abfa9006 service nova] Instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:04:25.809093 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1646e318-6df2-4aa4-a1f3-7cd18d532383 req-2c1d81fd-65bf-4e01-be36-5ee0abfa9006 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074823 Feb 12 21:04:25.813794 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 441/834] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:25.824000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:25.826234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:25.849974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.850280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:25.851957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:25.852630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:26.095650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:26.103829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fb55bbc-a850-4886-83e1-bc79aac30142 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1316 microversion: 2.1 time: 0.287271 Feb 12 21:04:26.104330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 442/835] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:25 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:26.267223 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4fe7e505-a42c-43f1-a340-c4029886394e tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.546651 Feb 12 21:04:26.267832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 394/836] 10.222.0.31 () {60 vars in 1205 bytes} [Sat Feb 12 21:04:24 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:26.279281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a1f063a6-ab24-408c-9be7-8d99823bb8ab tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] Calling method '.version_select at 0x7fa8fed50e50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:26.280463 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:26.280463 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:26.292121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:26.293311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:26.306538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:26.308774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:26.313123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:26.313685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:26.318215 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a1f063a6-ab24-408c-9be7-8d99823bb8ab tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.043868 Feb 12 21:04:26.327372 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 443/837] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:04:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:26.345087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ac328ec-1d56-4f75-af8f-df5fd6a7e11e tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fed56670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:26.347074 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:26.347074 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:26.917508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:26.932216 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-11ccacde-934f-4741-bd15-8194fe1b8edf tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1475 microversion: 2.1 time: 0.643123 Feb 12 21:04:26.934287 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 395/838] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:26 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1475 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:26.941515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:26.945911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:26.954645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:26.955099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:26.955894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:26.956328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.309735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:27.318943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:27.320854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:27.322170 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6daa9a2b-ef0e-4f19-8d92-accb2b355dcd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.386284 Feb 12 21:04:27.323067 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 396/839] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:26 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:27.328484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d094771d-59ac-4377-bf27-2abea3c218c7 req-d3ce8596-5f73-4917-a4f2-c173fda9f09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "name": "network-vif-plugged", "status": "completed", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:27.330105 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:27.330105 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:27.339571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d094771d-59ac-4377-bf27-2abea3c218c7 req-d3ce8596-5f73-4917-a4f2-c173fda9f09d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:27.342031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d094771d-59ac-4377-bf27-2abea3c218c7 req-d3ce8596-5f73-4917-a4f2-c173fda9f09d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.354189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d094771d-59ac-4377-bf27-2abea3c218c7 req-d3ce8596-5f73-4917-a4f2-c173fda9f09d service nova] Creating event network-vif-plugged:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:04:27.371394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d094771d-59ac-4377-bf27-2abea3c218c7 req-d3ce8596-5f73-4917-a4f2-c173fda9f09d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035134 Feb 12 21:04:27.373957 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 397/840] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:27.388664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:27.390385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:27.402119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:27.402852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.405174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:27.405903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.756902 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ac328ec-1d56-4f75-af8f-df5fd6a7e11e tempest-QuotaClassesAdminTestJSON-1440249903 tempest-QuotaClassesAdminTestJSON-1440249903-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.425211 Feb 12 21:04:27.758891 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 444/841] 10.222.0.31 () {60 vars in 1205 bytes} [Sat Feb 12 21:04:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:27.858874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-329bed50-5e60-46cc-bfff-8ad1ad891c6b req-a2124c7d-4c0e-46d8-aa0f-ecccbbb5deb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8e14fe-6904-44f4-a8bf-c1e9b349e419", "tag": "e68c6c44-abe5-4ce9-ab41-24f9c4276607"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:27.862325 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:27.862325 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:27.898797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-329bed50-5e60-46cc-bfff-8ad1ad891c6b req-a2124c7d-4c0e-46d8-aa0f-ecccbbb5deb4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:27.902392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-329bed50-5e60-46cc-bfff-8ad1ad891c6b req-a2124c7d-4c0e-46d8-aa0f-ecccbbb5deb4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.940412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-329bed50-5e60-46cc-bfff-8ad1ad891c6b req-a2124c7d-4c0e-46d8-aa0f-ecccbbb5deb4 service nova] Creating event network-changed:e68c6c44-abe5-4ce9-ab41-24f9c4276607 for instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 on nch1-master-1 Feb 12 21:04:27.949895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:27.957477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-329bed50-5e60-46cc-bfff-8ad1ad891c6b req-a2124c7d-4c0e-46d8-aa0f-ecccbbb5deb4 service nova] Instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:04:27.962685 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b045a6e5-f3e8-4b35-9abe-050a05fa4a70 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1466 microversion: 2.1 time: 0.586971 Feb 12 21:04:27.963290 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 398/842] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:27 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1466 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:27.968460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:27.968961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:27.976489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:27.977183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.978635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:27.979245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:27.986697 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-329bed50-5e60-46cc-bfff-8ad1ad891c6b req-a2124c7d-4c0e-46d8-aa0f-ecccbbb5deb4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130522 Feb 12 21:04:27.987980 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 445/843] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:27.995682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:27.996809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:28.005078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:28.005965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:28.007154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:28.008420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:28.025494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:04:28.486039 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-213e541c-8e93-4d5b-9228-d0262d2d3c14 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 204 len: 0 microversion: 2.1 time: 0.521182 Feb 12 21:04:28.488465 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 399/844] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:04:27 2022] DELETE /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:04:28.498290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:28.499385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:28.510363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:28.511299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:28.512375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:28.513820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:28.539004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:28.550652 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dbcb814c-7627-4aac-af7a-16f3a8ed3da5 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1475 microversion: 2.1 time: 0.559313 Feb 12 21:04:28.553043 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 446/845] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:27 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1475 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:28.563096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:28.564754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:28.591556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:28.591556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:28.591556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:28.591556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:29.023908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:29.031866 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72e27099-a9d7-4ac3-8c7b-8876d1ff30ee tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1317 microversion: 2.1 time: 0.541753 Feb 12 21:04:29.035183 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 400/846] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:28 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:29.058618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:29.064972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:29.074017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:29.074541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:29.076065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:29.077620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:29.185121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:29.194769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:29.204062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:29.218542 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-306a3834-7bc0-40c5-933c-88453a3d7bfb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.663925 Feb 12 21:04:29.229430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 447/847] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:28 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:29.229430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:29.229430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:29.231038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:29.231566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:29.232368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:29.232812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:29.775367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:29.775367 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8f36c8a7-9b60-4ba3-a188-2c3baf31fd72 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1711 microversion: 2.1 time: 0.636690 Feb 12 21:04:29.775367 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 401/848] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:29 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1711 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:29.775367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:29.776507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:29.776507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:29.776507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:29.776507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:29.777537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.114003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:30.131835 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f1015ae5-6884-4a32-ade9-6220080bf181 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1473 microversion: 2.1 time: 0.436576 Feb 12 21:04:30.149107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 402/849] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:29 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:30.161138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:30.162021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:30.175675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.176167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.176999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.177483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.218079 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddb5c401-4aaa-4266-bf07-4b13aa5b0564 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1688 microversion: 2.1 time: 0.997028 Feb 12 21:04:30.233477 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 448/850] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:29 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1688 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:30.238870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:30.240234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:30.246576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.247152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.248910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.250630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.282759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lazy-loading 'flavor' on Instance uuid 831a7bdc-edf9-4121-9962-f3ae48b82047 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:30.300829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Going to try to live migrate instance to nch1-master-1 {{(pid=141727) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:04:30.334680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:30.341033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90d8fee4-b348-4605-aed0-5f1b324d9586 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1467 microversion: 2.1 time: 0.190536 Feb 12 21:04:30.341912 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 403/851] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:30 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1467 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:30.346234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:30.346833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:30.352661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.353120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.353952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.354394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.536981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:30.547403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:30.549048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:30.550642 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf59781f-89ff-485f-927b-4a797119df91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1568 microversion: 2.25 time: 0.207925 Feb 12 21:04:30.565702 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 404/852] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:30 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:30.570611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1359208185"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:30.572750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:30.581060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.585910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:30.587502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:30.588205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:31.371869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68127572-3e33-4493-a803-06e23849fd25 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "POST /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77/action" status: 202 len: 0 microversion: 2.1 time: 0.803529 Feb 12 21:04:31.376812 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 405/853] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:04:30 2022] POST /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:04:31.391434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:31.394042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:31.409633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:31.410473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:31.411445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:31.412074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:31.512306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daeed6cf1bbe4a8995815673f0866266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c59817262e9431fa88f725ab4b5f7a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:31.524456 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81830d91-78b9-49b2-b18b-6298e3d7c472 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 200 len: 1643 microversion: 2.1 time: 0.144484 Feb 12 21:04:31.526030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 406/854] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:31 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 1643 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:31.855771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737864267", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:31.985119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] validate_networks() for [('b37f44d3-46f5-4895-8fa7-7d479d4b0ff2', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:33.496888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:33.497689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:33.497824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:33.499168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:33.499592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:33.518570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:33.519023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:33.521895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:33.521895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:33.560614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Getting quotas for project 02d862cc48f14c42ba73c75e882e9c87. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:33.577680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Getting quotas for user 10910ab3eb3c4b40af57679da421dbb9 and project 02d862cc48f14c42ba73c75e882e9c87. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:33.591970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:33.594397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:33.785896 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10e45137-a4b6-4966-adad-c29f3231434b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.255080 Feb 12 21:04:33.792052 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 407/855] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:04:33.798403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:33.799452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:33.807218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:33.808043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:33.810980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:33.810980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.084142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:34.093073 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec507d60-2c19-4be4-846d-4583c1628872 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1470 microversion: 2.1 time: 0.299194 Feb 12 21:04:34.093810 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 408/856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:33 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1470 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:34.100598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e9a6fdc-b963-43ad-8dcb-db5e46e681cf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa90428e1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:34.148094 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e9a6fdc-b963-43ad-8dcb-db5e46e681cf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.052998 Feb 12 21:04:34.148988 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 409/857] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:34 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:34.154784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:34.155484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:34.163053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.163579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.164502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.169565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.471412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89329bee-40c7-420f-bed0-48199bff30ff tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/action" status: 202 len: 0 microversion: 2.1 time: 4.236405 Feb 12 21:04:34.473489 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 449/858] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:04:30 2022] POST /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/action => generated 0 bytes in 4239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:04:34.478943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-57bd93c3-c43a-45a6-a4de-8e24b26ef517 req-19e8aa17-0a79-41c1-aeb2-a4ec051b385c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63522777-b7a9-4334-8154-9970f7cb4783", "name": "network-vif-deleted", "tag": "89194c07-8746-4aad-bb48-3af933bde09d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:34.481983 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:34.481983 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:34.499096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-57bd93c3-c43a-45a6-a4de-8e24b26ef517 req-19e8aa17-0a79-41c1-aeb2-a4ec051b385c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.499592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-57bd93c3-c43a-45a6-a4de-8e24b26ef517 req-19e8aa17-0a79-41c1-aeb2-a4ec051b385c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.538301 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-57bd93c3-c43a-45a6-a4de-8e24b26ef517 req-19e8aa17-0a79-41c1-aeb2-a4ec051b385c service nova] Creating event network-vif-deleted:89194c07-8746-4aad-bb48-3af933bde09d for instance 63522777-b7a9-4334-8154-9970f7cb4783 on nch2-master-1 Feb 12 21:04:34.553176 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-57bd93c3-c43a-45a6-a4de-8e24b26ef517 req-19e8aa17-0a79-41c1-aeb2-a4ec051b385c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078140 Feb 12 21:04:34.553973 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 450/859] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:34.561377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:34.561377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:34.590152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.595706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.595706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.595706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.629547 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance 63522777-b7a9-4334-8154-9970f7cb4783 could not be found. Feb 12 21:04:34.630438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance 63522777-b7a9-4334-8154-9970f7cb4783 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:34.631711 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b49e69b-9e0e-4863-9dd0-aae22d361140 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 404 len: 111 microversion: 2.1 time: 0.076639 Feb 12 21:04:34.632450 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 451/860] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:34 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:34.644930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d65c3a2-1676-4a6f-8475-ba2e2b9c8296 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:34.645769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d65c3a2-1676-4a6f-8475-ba2e2b9c8296 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:34.706653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:34.722445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:34.724286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:34.727240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99f3233d-b955-4ddf-a2d3-5b3c35602df4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1558 microversion: 2.25 time: 0.577157 Feb 12 21:04:34.728434 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 410/861] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:34 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1558 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:34.743054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:34.745873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:34.763325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.763555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d65c3a2-1676-4a6f-8475-ba2e2b9c8296 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:34.764387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.766169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.767207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.782796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d65c3a2-1676-4a6f-8475-ba2e2b9c8296 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1217 microversion: 2.1 time: 0.133432 Feb 12 21:04:34.782796 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 452/862] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:34 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:34.782796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:34.782796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:34.788591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.789053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:34.790061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:34.790490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.041647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:35.051399 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-617f3272-0d30-4c78-b667-18a8bb110a55 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.276990 Feb 12 21:04:35.058739 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 453/863] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:34 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:35.072008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.079411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:35.083511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.084259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.086895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.087560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.105794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. Feb 12 21:04:35.108246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:35.114883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf1d5c91-d756-4aa4-81bf-ffc268421d0a tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 404 len: 111 microversion: 2.1 time: 0.048736 Feb 12 21:04:35.116642 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 454/864] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:04:35 2022] DELETE /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:35.124638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-76bad874-68bc-4a95-964d-72953d7681ec tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '.version_select at 0x7fa8fed358b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.127134 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:35.127134 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:35.129182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76bad874-68bc-4a95-964d-72953d7681ec tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.129878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76bad874-68bc-4a95-964d-72953d7681ec tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.142328 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-76bad874-68bc-4a95-964d-72953d7681ec tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 2788 microversion: 2.25 time: 0.024131 Feb 12 21:04:35.148235 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 455/865] 10.222.0.31 () {60 vars in 1183 bytes} [Sat Feb 12 21:04:35 2022] GET /compute/v2.1/os-migrations => generated 2788 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:35.152795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.153758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:35.158079 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c8c6567-9e1d-44e9-993b-849052193d68 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419/action" status: 204 len: 0 microversion: 2.1 time: 0.426603 Feb 12 21:04:35.158738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 411/866] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:04:34 2022] POST /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419/action => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:04:35.162907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.163590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.164405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.165014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.182882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.182882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:35.183071 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. Feb 12 21:04:35.183568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:35.185235 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e488f8ee-1dc1-43ab-899c-5f682a921508 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 404 len: 111 microversion: 2.1 time: 0.038574 Feb 12 21:04:35.186384 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 456/867] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:35 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:35.191327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0dd227ed-b418-40fa-b445-8dd2cdaf5c4f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed413a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.192996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.193497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.194603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.195146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.260791 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0dd227ed-b418-40fa-b445-8dd2cdaf5c4f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.073125 Feb 12 21:04:35.266929 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 457/868] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:35 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:35.267337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.268182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:35.275103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.275567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.276378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.276823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.546143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:35.560270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4633ba41-02e1-4901-8561-97092d0def0e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1470 microversion: 2.1 time: 0.295949 Feb 12 21:04:35.562041 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 458/869] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:35 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:35.571203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7d60280-9b02-43ad-905e-218253a3ec2c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '.version_select at 0x7fa8fed35790>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.719122 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7d60280-9b02-43ad-905e-218253a3ec2c tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862670838" status: 202 len: 0 microversion: 2.1 time: 0.154415 Feb 12 21:04:35.719766 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 459/870] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862670838 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:04:35.791488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:35.791707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:35.821048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.831875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:35.835243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:35.836124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:36.026233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:04:36.148352 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-353bed8d-ff47-4bff-bb6c-8a761b59120e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 2051 microversion: 2.25 time: 0.981532 Feb 12 21:04:36.165979 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 412/871] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:35 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 2051 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:36.190838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:36.206264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:36.207459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:36.211085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0459577c-17f1-452d-ae27-98fadf0eab13 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1221 microversion: 2.1 time: 0.422913 Feb 12 21:04:36.213430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 460/872] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:35 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1221 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:36.252997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:36.253895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:36.258623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:36.260680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:36.276939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-634ed9d3-54cf-49e9-9890-5587adbb2a5a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed1f430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:36.380274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-634ed9d3-54cf-49e9-9890-5587adbb2a5a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.102124 Feb 12 21:04:36.384010 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 461/873] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:36 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:36.724396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1944486557", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:36.892203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:37.272490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:37.291262 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc21b1be-6de2-473d-9145-48ffec98a22f tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 1.119281 Feb 12 21:04:37.292347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 413/874] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:36 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:37.298440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1002041812", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "714ff2dc-d317-4a71-9ee6-4e812e6c4f51"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:37.451497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] validate_networks() for [('714ff2dc-d317-4a71-9ee6-4e812e6c4f51', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:37.464745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:37.465165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:37.466262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:37.466680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:37.467261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:37.480988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:37.484344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:37.486494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:37.486949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:37.530434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:37.539211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:37.586912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:37.589283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:37.789424 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9942245f-a2ec-4e85-b54c-b6fed9c0322b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403927 Feb 12 21:04:37.795828 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 462/875] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:04:37.802630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:37.803432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:37.837936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:37.838593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:37.839417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:37.839864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:38.199195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:38.210430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dee769d9-1bb9-4392-a089-809a7df4120c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1470 microversion: 2.1 time: 0.413440 Feb 12 21:04:38.211261 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 463/876] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:37 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1470 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:38.221290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a5e98b8c-70e7-44aa-b324-b868ca2e8f59 req-a2d9d8fc-d488-4b3b-9bfc-65f23e3debb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8e14fe-6904-44f4-a8bf-c1e9b349e419", "name": "network-vif-plugged", "status": "completed", "tag": "e68c6c44-abe5-4ce9-ab41-24f9c4276607"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:38.227504 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:38.227504 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:38.240396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a5e98b8c-70e7-44aa-b324-b868ca2e8f59 req-a2d9d8fc-d488-4b3b-9bfc-65f23e3debb8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:38.241049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a5e98b8c-70e7-44aa-b324-b868ca2e8f59 req-a2d9d8fc-d488-4b3b-9bfc-65f23e3debb8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:38.254807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a5e98b8c-70e7-44aa-b324-b868ca2e8f59 req-a2d9d8fc-d488-4b3b-9bfc-65f23e3debb8 service nova] Creating event network-vif-plugged:e68c6c44-abe5-4ce9-ab41-24f9c4276607 for instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 on nch1-master-1 Feb 12 21:04:38.261941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-a5e98b8c-70e7-44aa-b324-b868ca2e8f59 req-a2d9d8fc-d488-4b3b-9bfc-65f23e3debb8 service nova] Instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:04:38.278007 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a5e98b8c-70e7-44aa-b324-b868ca2e8f59 req-a2d9d8fc-d488-4b3b-9bfc-65f23e3debb8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061046 Feb 12 21:04:38.287122 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 464/877] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:38.290550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:38.292017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:38.301556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:38.303922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:38.304773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:38.305613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:38.418563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:38.429667 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49bec64a-46d0-48ef-98bd-77e09fffa2f0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1275 microversion: 2.1 time: 0.144220 Feb 12 21:04:38.432721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 465/878] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:38 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:38.440712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fdb028d4-aa28-4a0b-9a57-83a124e448dd tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fef141f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:38.522721 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fdb028d4-aa28-4a0b-9a57-83a124e448dd tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.087014 Feb 12 21:04:38.527456 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 466/879] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:38 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:38.531545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7702a281-7404-4e96-b92e-d894baad6f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:38.532543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7702a281-7404-4e96-b92e-d894baad6f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:38.600261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7702a281-7404-4e96-b92e-d894baad6f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:38.611921 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7702a281-7404-4e96-b92e-d894baad6f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1217 microversion: 2.1 time: 0.084223 Feb 12 21:04:38.611921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 467/880] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:38 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:38.615419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a0d45fc-784d-4f44-9323-eb23ab1ce0b3 tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:38.616477 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:38.616477 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:38.710901 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a0d45fc-784d-4f44-9323-eb23ab1ce0b3 tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1966012558" status: 202 len: 0 microversion: 2.1 time: 0.099727 Feb 12 21:04:38.714579 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 468/881] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:04:38 2022] DELETE /compute/v2.1/flavors/1966012558 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:04:38.718087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:38.720901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:38.757155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:38.759696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:38.762129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:38.764153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:39.039309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:39.058659 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6898751c-1a02-4c67-ab86-59ed07b56894 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.343861 Feb 12 21:04:39.061164 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 469/882] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:38 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:39.081202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da711c63-784f-4ef8-b5ac-9e07438ede7d tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:39.113279 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da711c63-784f-4ef8-b5ac-9e07438ede7d tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.042203 Feb 12 21:04:39.126624 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 470/883] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:04:39 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:39.264615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3f02b0d-dc02-48ec-9a64-918133530ab1 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] Calling method '.version_select at 0x7fa8fed35b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:39.334173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:39.338349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:39.338349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:39.338349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:39.338349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:39.376501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:39.377704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:39.378789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:39.380874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:39.422391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:39.428633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for user 3cae3e35c281419b98224db3b8ea1f19 and project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:39.443313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:39.446538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:39.788565 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7ae372c-0a91-4d04-b347-3e0be2a178b3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.494829 Feb 12 21:04:39.789431 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 414/884] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:04:39.814852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f2f24653-044a-4698-8eca-0f76c6524cad tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:39.818118 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:39.818118 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:40.010619 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f2f24653-044a-4698-8eca-0f76c6524cad tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/772016053" status: 202 len: 0 microversion: 2.1 time: 0.218813 Feb 12 21:04:40.014521 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 415/885] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:04:39 2022] DELETE /compute/v2.1/flavors/772016053 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:04:40.027288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3f02b0d-dc02-48ec-9a64-918133530ab1 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.898819 Feb 12 21:04:40.029061 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 471/886] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:04:39 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:04:40.033850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.034807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:40.035291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.036148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:40.047272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.049188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.050760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.051671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.056762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.061180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.076542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.078948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.394712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:40.401987 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cfafb630-6d7d-450b-b78f-fd33b28967bc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.371481 Feb 12 21:04:40.407219 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 472/887] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:40.412180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58971cca-39de-4887-9685-5c53b97a7520 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed3bc10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.519676 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58971cca-39de-4887-9685-5c53b97a7520 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.110991 Feb 12 21:04:40.520569 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 473/888] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:40.530780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.534886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:40.548497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.549264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.551847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.553039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.587996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:40.612699 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5f8df5bb-972f-454d-b41b-d6ab094c8b39 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1462 microversion: 2.1 time: 0.599504 Feb 12 21:04:40.615253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 416/889] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1462 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:40.627989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-436de102-5f35-40bd-bf8a-beca1155576d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.632525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-436de102-5f35-40bd-bf8a-beca1155576d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:40.771944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:40.782391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-436de102-5f35-40bd-bf8a-beca1155576d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:40.786448 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-35ac6067-e12f-49ed-b0fe-18299fd8e4f9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1269 microversion: 2.1 time: 0.264665 Feb 12 21:04:40.793534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-436de102-5f35-40bd-bf8a-beca1155576d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:40.796653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-436de102-5f35-40bd-bf8a-beca1155576d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:40.798026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-436de102-5f35-40bd-bf8a-beca1155576d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1262 microversion: 2.25 time: 0.181541 Feb 12 21:04:40.798736 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 417/890] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1262 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:40.808756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 474/891] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1269 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:40.824437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-63c62846-20b5-455c-a18b-4828f3af318a tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] Action: 'create', calling method: .version_select at 0x7fa8fe636820>, body: {"pool": "non_exist_pool"} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:40.829641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0889f37a-4575-4354-84c1-7f4048bdf956 tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.860788 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0889f37a-4575-4354-84c1-7f4048bdf956 tempest-ServersWithSpecificFlavorTestJSON-1779776064 tempest-ServersWithSpecificFlavorTestJSON-1779776064-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058180 Feb 12 21:04:40.863104 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 475/892] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:40.868257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.869188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:40.877620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.878427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.879465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.880117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.913868 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-63c62846-20b5-455c-a18b-4828f3af318a tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] HTTP exception thrown: Floating IP pool not found. Feb 12 21:04:40.913980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-63c62846-20b5-455c-a18b-4828f3af318a tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] Returning 404 to user: Floating IP pool not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:40.914742 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-63c62846-20b5-455c-a18b-4828f3af318a tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.101069 Feb 12 21:04:40.920264 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 418/893] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:04:40 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:04:40.925679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6e8b0a12-a55b-48e5-9e1e-26fc2a5dc64c req-2c2c8166-4180-43b7-8c38-b56cac70ca29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "name": "network-vif-plugged", "status": "completed", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:40.927346 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:40.927346 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:40.939128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e8b0a12-a55b-48e5-9e1e-26fc2a5dc64c req-2c2c8166-4180-43b7-8c38-b56cac70ca29 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.939765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e8b0a12-a55b-48e5-9e1e-26fc2a5dc64c req-2c2c8166-4180-43b7-8c38-b56cac70ca29 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.952360 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6e8b0a12-a55b-48e5-9e1e-26fc2a5dc64c req-2c2c8166-4180-43b7-8c38-b56cac70ca29 service nova] Creating event network-vif-plugged:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:04:40.960362 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6e8b0a12-a55b-48e5-9e1e-26fc2a5dc64c req-2c2c8166-4180-43b7-8c38-b56cac70ca29 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038807 Feb 12 21:04:40.964490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 419/894] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:40.971090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:40.972029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:40.988851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.988851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:40.988851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:40.988851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.198109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:41.217271 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9eeeed27-1fba-4905-b005-cedb6ed307d0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.352475 Feb 12 21:04:41.244791 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 476/895] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:41.270267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.278332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:41.292730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.297471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.298962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.302664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.345600 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance 63522777-b7a9-4334-8154-9970f7cb4783 could not be found. Feb 12 21:04:41.347207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance 63522777-b7a9-4334-8154-9970f7cb4783 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:41.351470 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be0c515c-9484-40d1-afe4-a949af2c56d9 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 404 len: 111 microversion: 2.1 time: 0.105023 Feb 12 21:04:41.352972 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 477/896] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:04:41 2022] DELETE /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:41.360785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fb90b35-a86a-4b1a-b0ae-3ca37323c930 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] Calling method '.version_select at 0x7fa8fed35f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.514978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-3fb90b35-a86a-4b1a-b0ae-3ca37323c930 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP de80cab3-c4a9-4440-a750-57d1b2b747be could not be found", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:04:41.516354 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3fb90b35-a86a-4b1a-b0ae-3ca37323c930 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] HTTP exception thrown: Floating IP not found for ID de80cab3-c4a9-4440-a750-57d1b2b747be Feb 12 21:04:41.517702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fb90b35-a86a-4b1a-b0ae-3ca37323c930 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] Returning 404 to user: Floating IP not found for ID de80cab3-c4a9-4440-a750-57d1b2b747be {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:41.518907 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fb90b35-a86a-4b1a-b0ae-3ca37323c930 tempest-FloatingIPsNegativeTestJSON-1146010153 tempest-FloatingIPsNegativeTestJSON-1146010153-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/de80cab3-c4a9-4440-a750-57d1b2b747be" status: 404 len: 111 microversion: 2.1 time: 0.164389 Feb 12 21:04:41.521744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 478/897] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:04:41 2022] DELETE /compute/v2.1/os-floating-ips/de80cab3-c4a9-4440-a750-57d1b2b747be => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:41.532357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.536488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: 63522777-b7a9-4334-8154-9970f7cb4783] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:41.573246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.579533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.583056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.583652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.608803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:41.617771 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5890bf4-4eea-4eef-81f4-f33ca49e07a3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1462 microversion: 2.1 time: 0.651496 Feb 12 21:04:41.623486 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 420/898] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:40 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1462 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:41.650614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.654073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:41.655826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance 63522777-b7a9-4334-8154-9970f7cb4783 could not be found. Feb 12 21:04:41.659386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance 63522777-b7a9-4334-8154-9970f7cb4783 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:41.662384 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d87211cf-06c2-4538-8841-b99278498534 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783" status: 404 len: 111 microversion: 2.1 time: 0.139412 Feb 12 21:04:41.663191 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 479/899] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:41 2022] GET /compute/v2.1/servers/63522777-b7a9-4334-8154-9970f7cb4783 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:41.681677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.682098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-607c4130-a2d0-4dd2-b309-4463013797f3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed85550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.682727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.683826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.685027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.831444 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-607c4130-a2d0-4dd2-b309-4463013797f3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.158543 Feb 12 21:04:41.852161 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 480/900] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:41 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:41.861291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa54620b-4dcd-4f40-9494-59c24bd7a803 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '.version_select at 0x7fa8fed419d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.865662 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:41.865662 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:41.869101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa54620b-4dcd-4f40-9494-59c24bd7a803 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.872623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa54620b-4dcd-4f40-9494-59c24bd7a803 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.886441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa54620b-4dcd-4f40-9494-59c24bd7a803 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.032794 Feb 12 21:04:41.887620 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 481/901] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:04:41 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:41.894754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.895662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:41.912846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.913616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.914666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.915484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.942574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. Feb 12 21:04:41.949582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:41.949582 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad657ecf-4cb4-4073-a744-fc696f59a2b0 tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 404 len: 111 microversion: 2.1 time: 0.055983 Feb 12 21:04:41.952228 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 482/902] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:04:41 2022] DELETE /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:41.965304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:41.966309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:41.977307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.980561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:41.980561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:41.980561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.079111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:42.094211 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b882aab2-2791-49e4-8ef0-38b85c6dd18f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1275 microversion: 2.1 time: 0.136359 Feb 12 21:04:42.096658 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 483/903] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:41 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:42.100748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:42.101667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:42.108998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:42.111110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.112658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:42.113878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.236070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:42.251690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:42.259750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:42.260965 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6b9c2108-6ecf-4369-9f3b-4f7be20ae1b0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1258 microversion: 2.25 time: 0.164455 Feb 12 21:04:42.261571 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 484/904] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:42 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:42.276578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82dbadcf-f5aa-47f2-b247-fceca229bd1e tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:42.288104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82dbadcf-f5aa-47f2-b247-fceca229bd1e tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021195 Feb 12 21:04:42.292964 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 485/905] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:04:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:42.300137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:42.304285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] [instance: a69d5d6c-82ee-44e8-930e-270484371efe] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:42.337452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:42.338308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.339707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:42.340276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.377587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] HTTP exception thrown: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. Feb 12 21:04:42.378933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] Returning 404 to user: Instance a69d5d6c-82ee-44e8-930e-270484371efe could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:04:42.379948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d8c32d7-c98d-4fc7-b3c0-e99ddb8c58bc tempest-ServersWithSpecificFlavorTestJSON-1063298862 tempest-ServersWithSpecificFlavorTestJSON-1063298862-project] 10.222.0.31 "GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe" status: 404 len: 111 microversion: 2.1 time: 0.089864 Feb 12 21:04:42.380816 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 486/906] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:42 2022] GET /compute/v2.1/servers/a69d5d6c-82ee-44e8-930e-270484371efe => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:04:42.391620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:42.392455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:42.402099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:42.402780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.405262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:42.406030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:42.556772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:42.566153 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0676de10-7d5e-4a2b-995c-930380a398be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.941136 Feb 12 21:04:42.571073 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 421/907] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:41 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:42.582880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4ed78e48-8227-45ad-acab-1d4269dc8da9 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1026732008", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:42.584568 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:42.584568 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:42.665397 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4ed78e48-8227-45ad-acab-1d4269dc8da9 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.092799 Feb 12 21:04:42.671899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 422/908] 10.222.0.31 () {60 vars in 1145 bytes} [Sat Feb 12 21:04:42 2022] POST /compute/v2.1/flavors => generated 499 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:42.687878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9f53bcf9-3805-44e5-9588-4652947953f1 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:42.712697 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9f53bcf9-3805-44e5-9588-4652947953f1 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036411 Feb 12 21:04:42.725429 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 423/909] 10.222.0.31 () {58 vars in 1181 bytes} [Sat Feb 12 21:04:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:04:42.869543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3ad219c-26c5-40f8-8ff8-f55157448c57 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa9040543a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:42.965952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3ad219c-26c5-40f8-8ff8-f55157448c57 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.101515 Feb 12 21:04:42.967232 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 424/910] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:42 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:42.976463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-87968681", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "edf5ec40-0389-4b3f-b769-d647ab34aefe"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:43.015827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:43.036273 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3f17299a-9b79-495b-85e3-7312ee557002 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.650745 Feb 12 21:04:43.048247 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 487/911] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:42 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:43.109495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:43.111646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:43.112611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:43.131097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.131888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:43.136223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.137291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:43.275983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:43.285953 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0ea8ddaa-c448-45ce-b724-d8fbd0b4d62f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1275 microversion: 2.1 time: 0.178057 Feb 12 21:04:43.290278 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 488/912] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:43 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:43.294450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-105fa72e-bfd4-497a-9f72-7b20416f0904 req-09405e0c-0032-4f6d-8cc5-6aaf2dbe16bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb565b3e-86a6-4ab9-b812-5901d747f049", "tag": "ec357ac8-2d34-44cb-8ba8-0821decd9e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:43.296004 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:43.296004 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:43.310211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-105fa72e-bfd4-497a-9f72-7b20416f0904 req-09405e0c-0032-4f6d-8cc5-6aaf2dbe16bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.310847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-105fa72e-bfd4-497a-9f72-7b20416f0904 req-09405e0c-0032-4f6d-8cc5-6aaf2dbe16bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:43.351588 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-105fa72e-bfd4-497a-9f72-7b20416f0904 req-09405e0c-0032-4f6d-8cc5-6aaf2dbe16bb service nova] Creating event network-changed:ec357ac8-2d34-44cb-8ba8-0821decd9e9a for instance bb565b3e-86a6-4ab9-b812-5901d747f049 on nch2-master-1 Feb 12 21:04:43.357116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-105fa72e-bfd4-497a-9f72-7b20416f0904 req-09405e0c-0032-4f6d-8cc5-6aaf2dbe16bb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068090 Feb 12 21:04:43.358127 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 489/913] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:43.386482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:43.387199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:43.413802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.416488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:43.420411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.421080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:43.551771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:43.564147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:43.569484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:43.573761 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f17b0255-eee9-4311-a7ea-c9a2ff54c591 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1322 microversion: 2.25 time: 0.197062 Feb 12 21:04:43.595571 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 490/914] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:43 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:43.604168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:43.610100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:43.632899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.633382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:43.635607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:43.636263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:44.153747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:44.162542 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3bbf9f8a-6a6f-4539-9db0-d4428e36448d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.565102 Feb 12 21:04:44.163309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 491/915] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:43 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:44.168757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72b6c392-45d2-4c98-87f4-197574540c51 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed3bf70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:44.276599 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72b6c392-45d2-4c98-87f4-197574540c51 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.111828 Feb 12 21:04:44.277306 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 492/916] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:44 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:44.291294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:44.291982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:44.306769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:44.307499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:44.308380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:44.311066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:44.601312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:44.611226 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c69cdb03-07a4-41f7-8612-40972773e811 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.332917 Feb 12 21:04:44.611965 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 493/917] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:44 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:44.619223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:44.619991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:44.630045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:44.630764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:44.631571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:44.632162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.014573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:45.026902 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d1c7891-d164-48cb-beb4-aa3a40e2ca5d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1317 microversion: 2.1 time: 0.413459 Feb 12 21:04:45.029329 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 494/918] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:44 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:45.036504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:45.042244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:45.056026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:45.057137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:45.058160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:45.060460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:45.061145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:45.071419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.074733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.079040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.081806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.089557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.093178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.095647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.099879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.165214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:45.185165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for user 424f5011a4ef40c48465523369eab808 and project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:45.209444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:45.212861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:45.276577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:45.298874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:45.302072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:45.304277 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38aed90f-f441-458f-8c3f-55dbd9168a99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1320 microversion: 2.25 time: 0.272993 Feb 12 21:04:45.315445 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 495/919] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:45 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:45.323576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:45.325584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:45.332786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.333573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.334651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.336142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.398535 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f08c2d24-a506-45a2-89ed-d0251c91ab28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.427849 Feb 12 21:04:45.399184 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 425/920] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:04:45.407678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-657a6404-bd4f-4b70-ba41-d6256f7e8cb4 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa9045ecb80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:45.456723 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-657a6404-bd4f-4b70-ba41-d6256f7e8cb4 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.056146 Feb 12 21:04:45.463000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 426/921] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:45 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:45.468006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e954be06-7c40-4e9a-ac4f-d139697e78c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:45.468867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e954be06-7c40-4e9a-ac4f-d139697e78c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:45.588205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e954be06-7c40-4e9a-ac4f-d139697e78c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:45.597533 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e954be06-7c40-4e9a-ac4f-d139697e78c7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1277 microversion: 2.1 time: 0.133179 Feb 12 21:04:45.604785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 427/922] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:45 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:45.629159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:45.630022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:45.640074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.640871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:45.641913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:45.642605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:46.093229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:46.103579 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-412a81ae-ff22-4352-a1ee-1e459d30e040 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.783935 Feb 12 21:04:46.112077 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 496/923] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:45 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:46.118125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:46.118125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:46.131934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:46.134131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:46.139710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:46.139710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:46.472736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:46.481682 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28807fec-24dd-4a91-a7d3-e4cceca74d5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.856262 Feb 12 21:04:46.495403 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 428/924] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:45 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:46.508759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:46.509695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:46.526895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:46.527603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:46.528638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:46.531426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:46.829605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:46.850906 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00f3a60c-a764-4022-8e1b-32f01392c8e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1317 microversion: 2.1 time: 0.735884 Feb 12 21:04:46.859244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 497/925] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:46 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:46.864492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f01672a4-c935-4925-8717-0b31cf7532de tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed3bf70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:46.925678 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f01672a4-c935-4925-8717-0b31cf7532de tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.064961 Feb 12 21:04:46.932280 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 498/926] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:46 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:46.938633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:46.940191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:46.947314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:46.948018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:46.949054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:46.949806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.099946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:47.113125 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0f451f6-8c46-4286-b465-70f5110b0539 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1281 microversion: 2.1 time: 0.179395 Feb 12 21:04:47.124227 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 499/927] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:46 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:47.137906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:47.138562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:47.149730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.150182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.151001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.152088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.410056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:47.421550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:47.434097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:47.446535 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68efe623-d544-4872-8b85-899cdde1bf29 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.939415 Feb 12 21:04:47.446535 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 429/928] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:46 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:47.472683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f381dc7c-33d5-4488-8b40-d83cb0eb72a4 req-a88957dd-f338-4b17-b032-2b5f11fe8fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579b174f-d572-49b2-8f60-9e0d62cc450e", "tag": "d06b235b-99a9-4368-972a-9fb7e1fd2de3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:47.474570 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:47.474570 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:47.503180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f381dc7c-33d5-4488-8b40-d83cb0eb72a4 req-a88957dd-f338-4b17-b032-2b5f11fe8fd2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.503916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f381dc7c-33d5-4488-8b40-d83cb0eb72a4 req-a88957dd-f338-4b17-b032-2b5f11fe8fd2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.524151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f381dc7c-33d5-4488-8b40-d83cb0eb72a4 req-a88957dd-f338-4b17-b032-2b5f11fe8fd2 service nova] Creating event network-changed:d06b235b-99a9-4368-972a-9fb7e1fd2de3 for instance 579b174f-d572-49b2-8f60-9e0d62cc450e on nch2-master-1 Feb 12 21:04:47.531698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f381dc7c-33d5-4488-8b40-d83cb0eb72a4 req-a88957dd-f338-4b17-b032-2b5f11fe8fd2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068412 Feb 12 21:04:47.533501 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 430/929] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:47.539444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:47.541002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:47.548505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.549227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.550264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.550886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.632750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:47.641929 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4b83af32-f95c-4f0f-b2c5-6a7452be7a06 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.514161 Feb 12 21:04:47.643259 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 500/930] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:47 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:47.866813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:47.868155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:47.890662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.893766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:47.895056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:47.898137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:48.614722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:48.624773 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-119a5b8c-7558-4f2f-8bba-e987e1f50774 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 1.089827 Feb 12 21:04:48.647738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 431/931] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:47 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:48.654402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b48ea6d0-d002-4ad1-bcdf-87791fdf96fc tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa9042fd3a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:48.723418 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b48ea6d0-d002-4ad1-bcdf-87791fdf96fc tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.074177 Feb 12 21:04:48.724440 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 432/932] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:48 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:48.737639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:48.738465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:48.755730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:48.761114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:48.762268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:48.763615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:48.959754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:48.979916 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5f8520d5-9dbb-4cf5-8b8d-7bf7f960efb4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1335 microversion: 2.1 time: 0.243155 Feb 12 21:04:48.990029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 433/933] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:48 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1335 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:49.000434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:49.001313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:49.019762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.021091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:49.023970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.030165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:49.339916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:49.359165 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3eaf5468-230c-4c4a-bd5a-bad6231f1ed2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1317 microversion: 2.1 time: 1.493707 Feb 12 21:04:49.359827 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 501/934] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:47 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1317 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:04:49.366680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:49.374954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:49.393008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.394793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:49.395844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.399003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:49.551508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:49.566128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:49.567821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:49.568973 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2517e83-1135-41ab-a04f-dcc76fd0f956 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.577386 Feb 12 21:04:49.580775 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 434/935] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:48 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:49.585889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4e2cbba4-a346-4608-ac0b-71c4172f7893 req-ea1d486b-13a4-47d2-91c2-c46410a5b431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a7bdc-edf9-4121-9962-f3ae48b82047", "name": "network-vif-unplugged", "status": "completed", "tag": "32360a5d-8e56-4c23-9414-36fca780d88e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:49.589261 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:49.589261 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:49.596842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4e2cbba4-a346-4608-ac0b-71c4172f7893 req-ea1d486b-13a4-47d2-91c2-c46410a5b431 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.597295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4e2cbba4-a346-4608-ac0b-71c4172f7893 req-ea1d486b-13a4-47d2-91c2-c46410a5b431 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:49.611608 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4e2cbba4-a346-4608-ac0b-71c4172f7893 req-ea1d486b-13a4-47d2-91c2-c46410a5b431 service nova] Creating event network-vif-unplugged:32360a5d-8e56-4c23-9414-36fca780d88e for instance 831a7bdc-edf9-4121-9962-f3ae48b82047 on nch2-master-1 Feb 12 21:04:49.616814 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4e2cbba4-a346-4608-ac0b-71c4172f7893 req-ea1d486b-13a4-47d2-91c2-c46410a5b431 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034734 Feb 12 21:04:49.617746 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 435/936] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:49.656427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:49.657440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:49.677728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.677728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:49.678785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:49.679092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:50.292504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:50.305098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36fc383b-db2c-4af4-85c9-df69392b8ec8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.943887 Feb 12 21:04:50.305728 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 502/937] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:49 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:50.314207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9af5d4a-31fc-4ae0-920f-0274e4d81f72 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed419d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:50.317548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:50.332396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-94b06764-8ce5-4af4-999c-ebaf223750a1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.680970 Feb 12 21:04:50.335814 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 436/938] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:49 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:50.352452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:50.353225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:50.364842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:50.365855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:50.377578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:50.378494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:50.403845 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9af5d4a-31fc-4ae0-920f-0274e4d81f72 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.093708 Feb 12 21:04:50.408814 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 503/939] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:50 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:50.432336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:50.432962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:50.461343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:50.461844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:50.463860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:50.464303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:50.757841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:50.788665 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d5b826e7-1929-456c-ae77-1a0d456029b8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.432275 Feb 12 21:04:50.811179 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 437/940] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:50 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:50.817624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:50.818531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:50.846244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:50.849999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:50.853513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:50.854216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:51.197823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:51.197823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:51.198102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:51.198102 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-380a2633-9047-4d39-88ec-013e0a3ad5c2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.377876 Feb 12 21:04:51.198102 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 438/941] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:50 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:51.322894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:51.323530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:51.333940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:51.342936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:51.343861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:51.344333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:51.709208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:51.723830 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7e8a2df-e3af-4dd3-843f-e50bd69c2348 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.403148 Feb 12 21:04:51.726070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 439/942] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:51 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:51.732615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:51.733447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:51.766786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:51.773228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:51.773228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:51.773228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:51.937460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:51.952851 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e6acb91-3054-482c-b37c-8eb0f77d107a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1317 microversion: 2.1 time: 1.534737 Feb 12 21:04:51.954221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 504/943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:50 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1317 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:51.961718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f24ae66a-1b35-43b0-84c3-142e44377956 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed35b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:52.053455 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f24ae66a-1b35-43b0-84c3-142e44377956 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.097834 Feb 12 21:04:52.057162 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 505/944] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:51 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:52.058925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bbfcef52-b698-4d39-bf5f-e612b5af3b8e req-b6f95181-fb1b-433f-ae73-997dc084311f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831a7bdc-edf9-4121-9962-f3ae48b82047", "tag": "32360a5d-8e56-4c23-9414-36fca780d88e"}, {"name": "network-changed", "server_uuid": "6adffe64-7deb-47c3-b073-0fc6b684979f", "tag": "6ab99884-aa16-42e5-9cde-aea1aba07ad2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:52.072103 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:52.072103 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:52.087892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bbfcef52-b698-4d39-bf5f-e612b5af3b8e req-b6f95181-fb1b-433f-ae73-997dc084311f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.091342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bbfcef52-b698-4d39-bf5f-e612b5af3b8e req-b6f95181-fb1b-433f-ae73-997dc084311f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.119690 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bbfcef52-b698-4d39-bf5f-e612b5af3b8e req-b6f95181-fb1b-433f-ae73-997dc084311f service nova] Creating event network-changed:32360a5d-8e56-4c23-9414-36fca780d88e for instance 831a7bdc-edf9-4121-9962-f3ae48b82047 on nch2-master-1 Feb 12 21:04:52.120204 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bbfcef52-b698-4d39-bf5f-e612b5af3b8e req-b6f95181-fb1b-433f-ae73-997dc084311f service nova] Creating event network-changed:6ab99884-aa16-42e5-9cde-aea1aba07ad2 for instance 6adffe64-7deb-47c3-b073-0fc6b684979f on nch1-master-1 Feb 12 21:04:52.125463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:52.143189 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bbfcef52-b698-4d39-bf5f-e612b5af3b8e req-b6f95181-fb1b-433f-ae73-997dc084311f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.087726 Feb 12 21:04:52.144256 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 506/945] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:52.148267 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a1b97b7-005b-4245-a1ff-4d50131dd07e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.420669 Feb 12 21:04:52.149442 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 440/946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:51 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:52.165263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:52.166024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:52.178892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.190148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.191398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.192007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.212067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:52.214073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:52.254742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.255201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.256209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.256642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.678265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:52.690491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:52.694923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:52.697200 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14bf3bfd-793c-4181-b27b-b99837d50847 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.488938 Feb 12 21:04:52.713056 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 441/947] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:52 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:52.721989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-09a686db-090e-4914-a4ae-2bfe6e3bc127 req-ce885162-57be-4d28-8197-afc4194ba044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb565b3e-86a6-4ab9-b812-5901d747f049", "name": "network-vif-plugged", "status": "completed", "tag": "ec357ac8-2d34-44cb-8ba8-0821decd9e9a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:52.725761 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:52.725761 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:52.743944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-09a686db-090e-4914-a4ae-2bfe6e3bc127 req-ce885162-57be-4d28-8197-afc4194ba044 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.744621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-09a686db-090e-4914-a4ae-2bfe6e3bc127 req-ce885162-57be-4d28-8197-afc4194ba044 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.775615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-09a686db-090e-4914-a4ae-2bfe6e3bc127 req-ce885162-57be-4d28-8197-afc4194ba044 service nova] Creating event network-vif-plugged:ec357ac8-2d34-44cb-8ba8-0821decd9e9a for instance bb565b3e-86a6-4ab9-b812-5901d747f049 on nch2-master-1 Feb 12 21:04:52.802300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-09a686db-090e-4914-a4ae-2bfe6e3bc127 req-ce885162-57be-4d28-8197-afc4194ba044 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087660 Feb 12 21:04:52.808077 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 442/948] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:52.818523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:52.824691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:52.850345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.851176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:52.852219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:52.867630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:53.208588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:53.220681 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d4936990-35ed-479a-ba69-ebf049f76e8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 1.075068 Feb 12 21:04:53.225788 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 507/949] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:52 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:53.249403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:53.250373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:53.257805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:53.258588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:53.259631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:53.260285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:53.914580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:53.919155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:53.930117 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb5d88fd-77a9-4fd9-8065-09a8e56a178e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 1.118824 Feb 12 21:04:53.935345 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-510d3844-df00-4233-a428-4b38fe50631c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1317 microversion: 2.1 time: 0.689996 Feb 12 21:04:53.945318 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 508/950] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:53 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:53.945846 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 443/951] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:52 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:53.953419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92313aa4-47e7-4ed8-bf85-b46d46fd19dd tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa90406c3a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:53.956118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:53.974308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:53.988746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:53.989483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:53.990454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:53.991118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.015910 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92313aa4-47e7-4ed8-bf85-b46d46fd19dd tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.068582 Feb 12 21:04:54.029843 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 444/952] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:53 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:54.037823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:54.038485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:54.051548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.052000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.052817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.053257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.305231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:54.317455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:54.320616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:54.322400 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4d779be-dc5a-42b8-aaac-e38d382cd960 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.291278 Feb 12 21:04:54.334536 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 445/953] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:54 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:54.347333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a9875878-8955-4d29-9f7b-ffb2db607a1e req-46a3dec7-341c-4479-88ce-c0976d561f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:54.348752 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:54.348752 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:54.359840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a9875878-8955-4d29-9f7b-ffb2db607a1e req-46a3dec7-341c-4479-88ce-c0976d561f4b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.360592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a9875878-8955-4d29-9f7b-ffb2db607a1e req-46a3dec7-341c-4479-88ce-c0976d561f4b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.375855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a9875878-8955-4d29-9f7b-ffb2db607a1e req-46a3dec7-341c-4479-88ce-c0976d561f4b service nova] Creating event network-changed:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:04:54.383351 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a9875878-8955-4d29-9f7b-ffb2db607a1e req-46a3dec7-341c-4479-88ce-c0976d561f4b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044204 Feb 12 21:04:54.385184 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 446/954] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:54.392515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:54.394074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:54.422189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.429150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.430303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.430963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.693184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:54.708199 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b143394-5830-47b3-98fc-13408017a8a8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.320718 Feb 12 21:04:54.712377 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 447/955] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:54 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:54.844398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c528e3d6-3e3f-4fb8-9a7f-0783f006c57a req-afac8f24-fee8-48a9-a79f-32273e3d097a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579b174f-d572-49b2-8f60-9e0d62cc450e", "name": "network-vif-plugged", "status": "completed", "tag": "d06b235b-99a9-4368-972a-9fb7e1fd2de3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:54.846046 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:54.846046 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:04:54.875648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c528e3d6-3e3f-4fb8-9a7f-0783f006c57a req-afac8f24-fee8-48a9-a79f-32273e3d097a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.876030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c528e3d6-3e3f-4fb8-9a7f-0783f006c57a req-afac8f24-fee8-48a9-a79f-32273e3d097a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.892850 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c528e3d6-3e3f-4fb8-9a7f-0783f006c57a req-afac8f24-fee8-48a9-a79f-32273e3d097a service nova] Creating event network-vif-plugged:d06b235b-99a9-4368-972a-9fb7e1fd2de3 for instance 579b174f-d572-49b2-8f60-9e0d62cc450e on nch2-master-1 Feb 12 21:04:54.899528 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c528e3d6-3e3f-4fb8-9a7f-0783f006c57a req-afac8f24-fee8-48a9-a79f-32273e3d097a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059767 Feb 12 21:04:54.900777 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 448/956] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:04:54.951430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:54.961279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:54.964759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:54.971898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a1fd1805-b322-424d-9037-7d84acc1f239 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 1.023467 Feb 12 21:04:54.972510 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 509/957] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:53 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:54.986192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.991482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.991482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:54.992040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:54.998818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:54.999484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:55.040850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:55.041316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:55.042152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:55.052593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:55.244614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:55.264694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f1fff1e-e282-465b-b87c-0830138a249a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1317 microversion: 2.1 time: 0.309226 Feb 12 21:04:55.266661 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 449/958] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:54 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:55.272738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b5b062c-5b7d-41f3-a24d-e2caa31a988f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa904f3ca60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:55.343698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b5b062c-5b7d-41f3-a24d-e2caa31a988f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.075255 Feb 12 21:04:55.345603 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 450/959] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:55 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:55.359161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:55.360179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:55.367625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:55.368578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:55.370045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:55.370768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:55.589644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:55.602702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:55.604799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:55.609416 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2688039b-a37b-40a9-b7da-af2ca44add18 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.261973 Feb 12 21:04:55.611639 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 451/960] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:55 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:55.730081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:55.730896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:55.758285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:55.758922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:55.765784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:55.765784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.056255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:56.063978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2a606bd-45b5-4fb9-857a-f01a871cc7e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1317 microversion: 2.1 time: 1.074531 Feb 12 21:04:56.064805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 510/961] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:54 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1317 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:56.086485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:56.087414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:56.105247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:56.106006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.107730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:56.108332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.187044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:56.195990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13f73fd1-cc90-4710-9b9a-30ce75f1809f tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.471312 Feb 12 21:04:56.206041 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 452/962] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:55 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:56.285065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:56.285065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:56.294719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:56.295173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.308617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:56.309237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.681171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:56.691458 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bdc0d201-5cac-420a-9a64-81b5db39d0b0 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.411741 Feb 12 21:04:56.721614 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 453/963] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:56 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:56.732716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21580048-7942-44dc-bae1-69b32c14164a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe579670>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:56.789644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:56.797080 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ab5eb6d-a1d4-4deb-bdc1-4db46c72c446 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.717782 Feb 12 21:04:56.805933 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 511/964] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:56 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:56.821735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:56.833429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:56.855291 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21580048-7942-44dc-bae1-69b32c14164a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.132359 Feb 12 21:04:56.856889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 454/965] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:56 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:56.861859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:56.868600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.872933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:56.878677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:56.959078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865498037", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:57.029321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] validate_networks() for [('b37f44d3-46f5-4895-8fa7-7d479d4b0ff2', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:04:57.682451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:57.709501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:57.713242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:57.715507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52d22240-4caa-44da-a33e-21349f114129 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.906762 Feb 12 21:04:57.716282 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 512/966] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:56 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:57.720913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:57.721984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:57.756671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:57.757750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:57.758697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:57.759148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:57.907552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:04:57.909985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:04:57.911430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:04:57.911430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:04:57.911430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:04:57.921472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:57.922366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:57.923755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:57.924282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:57.949188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Getting quotas for project 02d862cc48f14c42ba73c75e882e9c87. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:57.955238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Getting quotas for user 10910ab3eb3c4b40af57679da421dbb9 and project 02d862cc48f14c42ba73c75e882e9c87. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:57.973138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:04:57.976217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:04:58.084756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:58.092651 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c43595c5-abb0-4c42-a919-a7fcbea2db3c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1467 microversion: 2.1 time: 0.375014 Feb 12 21:04:58.093202 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 513/967] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:57 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1467 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:58.097562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:58.098162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:58.104014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.104462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.105248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.105767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.338967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:58.347924 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d7fb220-eff6-451d-8659-c15b47e593f2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.253709 Feb 12 21:04:58.348505 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 514/968] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:58 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:58.353080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:58.353699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:58.360378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.360830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.361654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.362098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.559578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-162947dd-4109-4211-a5d0-ca9434a61cad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604295 Feb 12 21:04:58.560562 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 455/969] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:04:58.565007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8682ab3f-b7a0-4f2a-8dcb-babde37d0280 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa9042b75e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:58.648510 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8682ab3f-b7a0-4f2a-8dcb-babde37d0280 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.086865 Feb 12 21:04:58.649387 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 456/970] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:58 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:58.661237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:58.670549 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3e9fb6c-d765-4ad4-b396-d99a2e1b158e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.321004 Feb 12 21:04:58.675374 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 515/971] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:58 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:58.693451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcb24775-f921-4c08-97b3-930ffaa87be5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:58.694788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bcb24775-f921-4c08-97b3-930ffaa87be5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:58.773715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:58.774637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:58.784198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.784657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.785662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.786036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.839025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bcb24775-f921-4c08-97b3-930ffaa87be5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:58.850768 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcb24775-f921-4c08-97b3-930ffaa87be5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1217 microversion: 2.1 time: 0.161700 Feb 12 21:04:58.851655 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 516/972] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:58 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:58.858008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:58.860708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:58.878398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.879363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:58.881863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:58.882585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:59.151545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:59.162604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:59.165531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:59.167639 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f8c466d-cd5f-43ce-be2e-d647a64bc30e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.314495 Feb 12 21:04:59.169398 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 517/973] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:04:58 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:04:59.173859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5890ea7b-75a0-4848-bf51-d2fef5ad75b8 req-da830188-4a3d-48b4-a430-355f043ba802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6adffe64-7deb-47c3-b073-0fc6b684979f", "name": "network-vif-plugged", "status": "completed", "tag": "6ab99884-aa16-42e5-9cde-aea1aba07ad2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:59.176260 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:04:59.176260 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:04:59.193253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5890ea7b-75a0-4848-bf51-d2fef5ad75b8 req-da830188-4a3d-48b4-a430-355f043ba802 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:59.194018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5890ea7b-75a0-4848-bf51-d2fef5ad75b8 req-da830188-4a3d-48b4-a430-355f043ba802 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:59.208531 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5890ea7b-75a0-4848-bf51-d2fef5ad75b8 req-da830188-4a3d-48b4-a430-355f043ba802 service nova] Creating event network-vif-plugged:6ab99884-aa16-42e5-9cde-aea1aba07ad2 for instance 6adffe64-7deb-47c3-b073-0fc6b684979f on nch1-master-1 Feb 12 21:04:59.214185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5890ea7b-75a0-4848-bf51-d2fef5ad75b8 req-da830188-4a3d-48b4-a430-355f043ba802 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043526 Feb 12 21:04:59.214965 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 518/974] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:59.341220 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3953b948-8200-459c-b387-ee62c95a5e6b tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1618 microversion: 2.1 time: 0.677084 Feb 12 21:04:59.362706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa3a9215-ceed-443f-8130-1ff4ac21513c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: .version_select at 0x7fa8fecf09d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-918230048", "policies": ["affinity"]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:59.366626 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 457/975] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:58 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1618 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:59.374108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:59.374744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:59.390108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:59.390615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:59.391745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:59.391993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:59.398228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fa3a9215-ceed-443f-8130-1ff4ac21513c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:59.406949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fa3a9215-ceed-443f-8130-1ff4ac21513c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:59.599081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:04:59.610406 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82a6fe58-dbc7-4100-97d6-88f5b2926906 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.240166 Feb 12 21:04:59.610406 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 458/976] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:59 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:59.662300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e53623e-6f82-4a9a-a1c6-948b55274c5a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe737ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:59.678363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fa3a9215-ceed-443f-8130-1ff4ac21513c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:04:59.687705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fa3a9215-ceed-443f-8130-1ff4ac21513c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:04:59.703889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa3a9215-ceed-443f-8130-1ff4ac21513c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.349212 Feb 12 21:04:59.705484 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 519/977] 10.222.0.31 () {60 vars in 1173 bytes} [Sat Feb 12 21:04:59 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:04:59.710493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:04:59.711943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:04:59.722174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:59.723001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:59.724100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:04:59.724591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:04:59.740216 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e53623e-6f82-4a9a-a1c6-948b55274c5a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1453 microversion: 2.1 time: 0.081898 Feb 12 21:04:59.761158 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 459/978] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:04:59 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:04:59.844722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-742732219", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a4c5058a-b9f6-4e1c-93ce-b85566e53690"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:04:59.912051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:05:00.128190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:00.137690 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e4be27a-1b44-4910-af75-d7b7df25a851 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.430578 Feb 12 21:05:00.138377 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 520/979] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:04:59 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:00.143037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:00.143723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:00.150206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.150731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.152538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.152538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.201276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:05:00.201911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:05:00.202401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:05:00.202818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:05:00.203419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:05:00.234188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.234842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.235862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.235992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:00.236585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.248222 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a317f9e7-3068-4869-9533-196593fd46fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1221 microversion: 2.1 time: 0.108566 Feb 12 21:05:00.248802 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 521/980] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:00 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:00.266023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:00.266023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:00.274344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:00.275972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.276631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.277633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.278648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.282687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:00.301800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Going to run 2 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:05:00.304067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:05:00.423630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141726) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Feb 12 21:05:00.464569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:00.476178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:00.685200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:00.689052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:00.700941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:00.702750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:00.702885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:00.714825 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a2f60d71-865f-48dc-9567-2684a7d88846 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1362 microversion: 2.25 time: 0.463096 Feb 12 21:05:00.726208 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 522/981] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:00 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:00.731134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:00.732093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:00.740527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=b0ea6f0a-e322-4f50-8683-2511dce11a6b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:05:00.751545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.752408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.753388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:00.753964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:00.987111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:00.993623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:01.058005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:01.071914 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ecd2581-6686-4a4a-a237-daf473ae9e57 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.341169 Feb 12 21:05:01.072747 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 523/982] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:00 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:01.096617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d9de5caa-ea60-45ed-bcda-b206194dca31 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fec898b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:01.147741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:01.172686 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d9de5caa-ea60-45ed-bcda-b206194dca31 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1462 microversion: 2.1 time: 0.097259 Feb 12 21:05:01.180905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 524/983] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:01 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:01.196983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:01.200339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:01.200695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:01.208523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:01.209282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:01.217594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:01.218469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:01.357804 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a01fa37-4adc-495e-b5af-ab3e242a823a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.517709 Feb 12 21:05:01.363345 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 460/984] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:04:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 1527 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Feb 12 21:05:01.401114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5938ea36-adb0-49ff-96da-7f7283f4b3e1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa9040551f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:01.495892 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5938ea36-adb0-49ff-96da-7f7283f4b3e1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 200 len: 1462 microversion: 2.1 time: 0.131095 Feb 12 21:05:01.504302 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 461/985] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:01 2022] GET /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 1462 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:01.515802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:01.522841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:01.526553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:01.527424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:01.529196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:01.529842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:01.656588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:01.671952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-664e6871-e359-4c99-8159-d1c24b1c7f87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1269 microversion: 2.1 time: 0.164831 Feb 12 21:05:01.680185 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 462/986] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:01 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:01.684932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:01.692719 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:01.692719 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:01.693862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:01.694629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Searching by: {'deleted': False, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:05:01.744168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:01.753897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:01.755190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:01.755794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:01.903961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:05:02.050877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36cbfdcc-8f19-4024-9118-b6729dbf3181 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.374972 Feb 12 21:05:02.051942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 463/987] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:05:01 2022] GET /compute/v2.1/servers => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:02.057878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:02.059680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:02.077117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.078618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.080431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.081214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.152287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.163704 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d9f0e6f8-7318-4735-8e45-46a92556b8e8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.981308 Feb 12 21:05:02.166541 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 525/988] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:01 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:02.173318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:02.174983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:02.188099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.189592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.193730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.194201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.378000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.388044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.389859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.391155 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-51f64c77-d6da-4969-886a-97568ade16bb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1559 microversion: 2.25 time: 0.223087 Feb 12 21:05:02.401529 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 526/989] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:02 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:02.426621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.437841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f51740af-ee47-4d9b-87db-cb51831a0ee5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1467 microversion: 2.1 time: 0.384572 Feb 12 21:05:02.438921 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 464/990] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:02 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1467 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:02.443891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b5e4f7a1-9f35-477b-8d76-6f6ad96c3fe2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:02.444660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b5e4f7a1-9f35-477b-8d76-6f6ad96c3fe2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:02.540612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b5e4f7a1-9f35-477b-8d76-6f6ad96c3fe2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.552515 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b5e4f7a1-9f35-477b-8d76-6f6ad96c3fe2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1218 microversion: 2.1 time: 0.109738 Feb 12 21:05:02.553023 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 465/991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:02 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:02.564689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:02.566146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:02.582762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.583701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.588322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.588965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.635691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1459765452", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:02.711399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:05:02.879292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:02.891627 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d3994cb-c3de-4b28-8194-47d5ead3f061 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.337245 Feb 12 21:05:02.892217 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 466/992] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:02 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:02.897083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:02.897801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:02.904494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.904949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:02.905777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:02.906676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.108910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:05:03.109346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:05:03.109962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:05:03.110565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:05:03.111043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:05:03.119359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:03.121041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.121583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.124112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.124112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.134133 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-931f69ab-ce20-406e-8a90-59a0ba2b89a7 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 2052 microversion: 2.25 time: 0.240591 Feb 12 21:05:03.134749 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 467/993] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:02 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 2052 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:03.142232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Getting quotas for project fadab1c622d04b36be08c573468cd5be. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:03.143782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-879665608"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:03.145106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:03.153091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Getting quotas for user 34dcf9eabda74da6a6e26ad039bd9258 and project fadab1c622d04b36be08c573468cd5be. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:03.153842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.154301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.155104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.155538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.167278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:05:03.170941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:05:03.388339 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e7271e12-972a-4aed-bf24-715ea6e6c342 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991941 Feb 12 21:05:03.394009 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 527/994] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:05:03.415141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:03.415769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:03.428605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.428979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.432333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.432953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.933282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:03.946260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9aa958d4-e52a-4e81-bd4d-21faa29e9a98 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1317 microversion: 2.1 time: 0.551055 Feb 12 21:05:03.946847 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 528/995] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:03 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:03.952109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6fdc4852-d94a-429b-994e-3f8c70a406b6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "POST /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb/action" status: 202 len: 0 microversion: 2.1 time: 0.815645 Feb 12 21:05:03.956758 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 468/996] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:05:03 2022] POST /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb/action => generated 0 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:05:03.968157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:03.968157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:03.978536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:03.982882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.985315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:03.986340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:03.988394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:03.991354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.004930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.007136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.008295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.009220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.367457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:04.392503 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-690b9e3c-0b9b-4ddc-a916-289650c08a80 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 2052 microversion: 2.25 time: 0.441359 Feb 12 21:05:04.393921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 529/997] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:03 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 2052 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:04.410023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5af3f515-6eda-4c0c-9b5f-6cf8d70b76f7 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:04.411130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5af3f515-6eda-4c0c-9b5f-6cf8d70b76f7 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:04.450260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:04.476868 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d5a007e-5924-471d-be15-c1c0235a799a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1547 microversion: 2.1 time: 0.513766 Feb 12 21:05:04.480538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 469/998] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:03 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1547 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:04.494409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:04.495161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:04.504507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.504966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.505708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5af3f515-6eda-4c0c-9b5f-6cf8d70b76f7 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:04.505856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.506291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.517336 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5af3f515-6eda-4c0c-9b5f-6cf8d70b76f7 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1217 microversion: 2.1 time: 0.120621 Feb 12 21:05:04.517336 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 530/999] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:04 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:04.522377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:04.523444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:04.531407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.532451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.534274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.534940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.639998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:04.648640 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bba2d47a-3703-403e-b423-51f86d2657f7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1270 microversion: 2.1 time: 0.165843 Feb 12 21:05:04.651038 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 470/1000] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:04 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:04.658802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04beba92-8e61-467e-b5a9-b4edf49ed02b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe27ff70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:04.721588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04beba92-8e61-467e-b5a9-b4edf49ed02b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1452 microversion: 2.1 time: 0.068689 Feb 12 21:05:04.722832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 471/1001] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:04 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:04.727898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8052e7e6-9193-4e33-ac67-dc15b4ef70a2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:04.730472 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:04.730472 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:04.732440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8052e7e6-9193-4e33-ac67-dc15b4ef70a2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.733163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8052e7e6-9193-4e33-ac67-dc15b4ef70a2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.734044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8052e7e6-9193-4e33-ac67-dc15b4ef70a2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.734483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8052e7e6-9193-4e33-ac67-dc15b4ef70a2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.779026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8052e7e6-9193-4e33-ac67-dc15b4ef70a2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054935 Feb 12 21:05:04.779844 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 472/1002] 10.222.0.31 () {60 vars in 1216 bytes} [Sat Feb 12 21:05:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:05:04.792590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:04.794077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:04.801395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.802074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.803220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.804093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.875483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:04.884091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e9b7989-9a9d-4616-ae27-50c0d4678f8a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.365215 Feb 12 21:05:04.884884 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 531/1003] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:04 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:04.916820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-608a8294-d998-4db3-84a2-13722fbd5bef req-075152ff-0059-4a95-8860-7f846a6aa3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "name": "network-vif-plugged", "status": "completed", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:04.918919 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:04.918919 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:04.927218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-608a8294-d998-4db3-84a2-13722fbd5bef req-075152ff-0059-4a95-8860-7f846a6aa3f8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.927662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-608a8294-d998-4db3-84a2-13722fbd5bef req-075152ff-0059-4a95-8860-7f846a6aa3f8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.938892 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-608a8294-d998-4db3-84a2-13722fbd5bef req-075152ff-0059-4a95-8860-7f846a6aa3f8 service nova] Creating event network-vif-plugged:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:05:04.943816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-608a8294-d998-4db3-84a2-13722fbd5bef req-075152ff-0059-4a95-8860-7f846a6aa3f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Feb 12 21:05:04.944396 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 532/1004] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:05:04.969157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:04.970667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:04.979009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.979712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:04.980983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:04.981653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.166913 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-47080fd9-206d-4886-8235-d1e2018c447f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f/action" status: 202 len: 0 microversion: 2.25 time: 0.378055 Feb 12 21:05:05.168292 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 473/1005] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:05:04 2022] POST /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:05:05.187356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:05.190245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:05.229005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.234406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.235533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.243773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.471087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:05.486955 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27e4443f-4222-4ac8-b940-1848191882d1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1317 microversion: 2.1 time: 0.523332 Feb 12 21:05:05.504430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 533/1006] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:04 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:05.511238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:05.516083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:05.518247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:05.536700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.537709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.539965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.541452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.553290 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0835f387-7f66-4d0e-919a-2a03bcf392d6 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 2057 microversion: 2.25 time: 0.378765 Feb 12 21:05:05.553909 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 474/1007] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:05 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 2057 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:05.570465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:05.571097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:05.578146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.578601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.579450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.579888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.677252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:05.689216 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0eed9373-999b-40fc-bfe0-27a0251ed593 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1221 microversion: 2.1 time: 0.134265 Feb 12 21:05:05.706854 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 475/1008] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:05 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:05.719831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4dbefd1d-00ae-4aed-9d39-39ae44511b45 req-74750cf4-e7cc-4ae0-a689-a68d4e42d40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b389ae6-debb-4a3d-9fbb-648307b779ed", "tag": "10c43251-210a-44eb-abb2-bdfbd842fd4d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:05.722102 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:05.722102 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:05.732418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4dbefd1d-00ae-4aed-9d39-39ae44511b45 req-74750cf4-e7cc-4ae0-a689-a68d4e42d40f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.733336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4dbefd1d-00ae-4aed-9d39-39ae44511b45 req-74750cf4-e7cc-4ae0-a689-a68d4e42d40f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.750396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4dbefd1d-00ae-4aed-9d39-39ae44511b45 req-74750cf4-e7cc-4ae0-a689-a68d4e42d40f service nova] Creating event network-changed:10c43251-210a-44eb-abb2-bdfbd842fd4d for instance 2b389ae6-debb-4a3d-9fbb-648307b779ed on nch2-master-1 Feb 12 21:05:05.761336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4dbefd1d-00ae-4aed-9d39-39ae44511b45 req-74750cf4-e7cc-4ae0-a689-a68d4e42d40f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045660 Feb 12 21:05:05.763563 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 476/1009] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:05.773888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:05.775114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:05.783469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.784486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.785560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.786310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.874517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:05.898070 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2466f434-8527-4bb6-890b-89b506a5f0c6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1288 microversion: 2.1 time: 0.133092 Feb 12 21:05:05.909190 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 477/1010] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:05 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1288 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:05.914652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-215a7f62-faaf-4373-8578-443e30e26b95 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa904529040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:05.967053 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-215a7f62-faaf-4373-8578-443e30e26b95 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1452 microversion: 2.1 time: 0.056059 Feb 12 21:05:05.968240 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 478/1011] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:05 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1452 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:05.973794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:05.974586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:05.981648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.982569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:05.983568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:05.984158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.092656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:06.102027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f0d9f7f1-1ac7-4e22-bb9f-16a667b20b43 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1537 microversion: 2.1 time: 0.595631 Feb 12 21:05:06.103538 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 534/1012] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:05 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1537 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:06.118134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fc9e939-cc02-4167-a38d-6d4c66347b44 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '.version_select at 0x7fa8fed3b9d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:06.122279 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:06.122279 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:06.122279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fc9e939-cc02-4167-a38d-6d4c66347b44 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.122279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fc9e939-cc02-4167-a38d-6d4c66347b44 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.132601 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fc9e939-cc02-4167-a38d-6d4c66347b44 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.017993 Feb 12 21:05:06.133213 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 535/1013] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:05:06 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:06.148025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:06.149004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:06.158170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.159064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.160317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.160968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.261693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:06.273004 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0b21caf4-2bc6-4c45-a6f6-b8d3af4ca8a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1377 microversion: 2.1 time: 0.302656 Feb 12 21:05:06.273821 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 479/1014] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:05 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1377 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:06.452969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a80b8615-06d9-45d7-94cb-44dbefcb6bd3 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1688 microversion: 2.1 time: 0.309719 Feb 12 21:05:06.453590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 536/1015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:06 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1688 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:06.469200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:06.469858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:06.475973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.476423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.477205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.477666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.518993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:06.519616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:06.530737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.531328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.532169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.532626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.691960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ee64f94-8a8c-4c39-b078-dabc9b47337a tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1688 microversion: 2.1 time: 0.226672 Feb 12 21:05:06.692928 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 480/1016] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:06 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:06.697738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:06.698350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:06.705736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.706187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:06.707327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:06.707931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.144930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:07.164768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d8d5e2b-beb7-4d26-9374-e22669ffe254 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 2037 microversion: 2.25 time: 0.470556 Feb 12 21:05:07.176872 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 481/1017] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:06 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 2037 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:07.187698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:07.188610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:07.209026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.209560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.210549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.211140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.360775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:07.375198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc59142e-38a9-4f34-822c-0299e430f874 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1287 microversion: 2.1 time: 0.196179 Feb 12 21:05:07.376548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 482/1018] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:07 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:07.394638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:07.395611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:07.404463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.405275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.410850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.410850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.606568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lazy-loading 'services' on Instance uuid 831a7bdc-edf9-4121-9962-f3ae48b82047 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:07.674767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:07.682261 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0a10c111-95ca-4e81-aebf-545bd2ba6c03 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1317 microversion: 2.1 time: 1.166995 Feb 12 21:05:07.682831 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 537/1019] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:06 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1317 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:07.687767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:07.688298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:07.694115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.694565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.695360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.695828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.797537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:07.805146 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-268c9cbf-4d24-418b-8014-9b6419db9361 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1276 microversion: 2.1 time: 0.121365 Feb 12 21:05:07.805752 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 538/1020] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:07 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:07.811449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4ad61d70-6f66-461d-93a2-355adec0c276 req-58ed2cfe-01fe-4312-ac46-4b406d2e29a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "name": "network-vif-unplugged", "status": "completed", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:07.812995 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:07.812995 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:07.819857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4ad61d70-6f66-461d-93a2-355adec0c276 req-58ed2cfe-01fe-4312-ac46-4b406d2e29a2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.820489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4ad61d70-6f66-461d-93a2-355adec0c276 req-58ed2cfe-01fe-4312-ac46-4b406d2e29a2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.831156 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4ad61d70-6f66-461d-93a2-355adec0c276 req-58ed2cfe-01fe-4312-ac46-4b406d2e29a2 service nova] Creating event network-vif-unplugged:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:05:07.835917 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4ad61d70-6f66-461d-93a2-355adec0c276 req-58ed2cfe-01fe-4312-ac46-4b406d2e29a2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029055 Feb 12 21:05:07.836491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 539/1021] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:07.841454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1d1ea548-0dba-462c-b6f1-979a8060676e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fed35f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:07.849681 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc718a9a-46ba-4333-8386-5386859bde5c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "DELETE /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments/3ffffeab-c309-41f1-ac60-d0dc8f4b322e" status: 202 len: 0 microversion: 2.1 time: 0.470696 Feb 12 21:05:07.849860 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 483/1022] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:05:07 2022] DELETE /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments/3ffffeab-c309-41f1-ac60-d0dc8f4b322e => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:05:07.855214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:07.857255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:07.864601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.865072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.866179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.866612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.894996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1d1ea548-0dba-462c-b6f1-979a8060676e tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1452 microversion: 2.1 time: 0.057257 Feb 12 21:05:07.895567 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 540/1023] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:07 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:07.896188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'flavor' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:07.900036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:07.900978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:07.908128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.908581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:07.909387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:07.909706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Going to try to live migrate instance to nch2-master-1 {{(pid=141726) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:05:07.909836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.206677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:08.214694 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7846977f-b0c3-463c-a28d-d4b966e75122 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1526 microversion: 2.1 time: 0.317925 Feb 12 21:05:08.216464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 541/1024] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:07 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1526 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:08.221765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:08.236028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:08.243928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.244310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.245122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.245793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.296743 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b578f3e9-a4a9-423f-a9c9-cf984bd3c7e2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078320 Feb 12 21:05:08.300959 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 542/1025] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:05:08 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:08.308734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:08.309873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:08.317096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.318274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.319261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.320311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.723577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:08.732783 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73623d22-fc3f-4673-92c1-1571869a7bc8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1526 microversion: 2.1 time: 0.430471 Feb 12 21:05:08.736592 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 543/1026] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:08 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1526 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:08.739011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:08.739684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:08.754627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.755201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.756126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.756634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.885551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:08.903927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b771e3fe-1ac8-439a-ad80-00ad79d30267 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1275 microversion: 2.1 time: 0.166620 Feb 12 21:05:08.904717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 544/1027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:08 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:08.924520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:08.926062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:08.953462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.956289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:08.958619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:08.959524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:09.504357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:09.512569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0425da4d-df26-4b0c-b2a7-b2757df9d978 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1317 microversion: 2.1 time: 0.603846 Feb 12 21:05:09.537793 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 545/1028] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:08 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:09.548971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63c71597-bafd-485f-b11d-187e1c1bb72b tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:09.550019 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:09.550019 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:09.672885 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63c71597-bafd-485f-b11d-187e1c1bb72b tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/edf5ec40-0389-4b3f-b769-d647ab34aefe" status: 202 len: 0 microversion: 2.1 time: 0.133713 Feb 12 21:05:09.677839 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 546/1029] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:05:09 2022] DELETE /compute/v2.1/flavors/edf5ec40-0389-4b3f-b769-d647ab34aefe => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:05:09.682836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:09.683455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:09.697194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:09.702686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:09.703758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:09.704356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:10.325946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:10.361116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32f957f3-08f3-4aeb-93b0-2377bd661656 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.682125 Feb 12 21:05:10.379214 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 547/1030] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:09 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:10.389752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0612c325-dbb2-498a-944f-963c93130370 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fece14c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:10.447563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0612c325-dbb2-498a-944f-963c93130370 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1452 microversion: 2.1 time: 0.066325 Feb 12 21:05:10.448514 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 548/1031] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:10 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:10.454662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:10.456449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:10.463850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:10.536792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:10.536792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:10.536792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:10.536792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f43ab27d-8f3c-47cb-9f05-d0eb9b106285 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061209 Feb 12 21:05:10.538174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 549/1032] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:05:10 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:10.538174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f75d21e-e519-44ab-be97-d994653ade86 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:10.549321 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f75d21e-e519-44ab-be97-d994653ade86 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033317 Feb 12 21:05:10.565085 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 550/1033] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:05:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:10.582619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0b7e2aca-a59f-4722-baaf-586a3ae71f9b req-1cb3426f-61de-4cd8-9304-abe060bc927c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3267b0c7-25e2-44b9-afd1-21270d2d53bb", "name": "network-vif-plugged", "status": "completed", "tag": "31030585-0e0e-44d7-bd66-e3136d668ce8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:10.588673 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:10.588673 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:10.612517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0b7e2aca-a59f-4722-baaf-586a3ae71f9b req-1cb3426f-61de-4cd8-9304-abe060bc927c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:10.613959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0b7e2aca-a59f-4722-baaf-586a3ae71f9b req-1cb3426f-61de-4cd8-9304-abe060bc927c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:10.663709 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0b7e2aca-a59f-4722-baaf-586a3ae71f9b req-1cb3426f-61de-4cd8-9304-abe060bc927c service nova] Creating event network-vif-plugged:31030585-0e0e-44d7-bd66-e3136d668ce8 for instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb on nch1-master-1 Feb 12 21:05:10.670638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0b7e2aca-a59f-4722-baaf-586a3ae71f9b req-1cb3426f-61de-4cd8-9304-abe060bc927c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101488 Feb 12 21:05:10.672323 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 551/1034] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:10.680211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:10.681282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:10.695459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:10.696858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:10.697579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:10.698140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:11.543844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:11.554628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fbe39dbe-d63d-44bf-92a4-1a744cbc003f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.878055 Feb 12 21:05:11.564908 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 552/1035] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:10 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:11.579607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fbd64395-6e25-4500-bd7c-d7d5fa2b3245 req-c8488003-ac67-4f73-b5ca-a772d295d37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0ea6f0a-e322-4f50-8683-2511dce11a6b", "tag": "1dcd7742-1914-4434-a268-34bdc3f688d2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:11.582561 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:11.582561 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:11.612787 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b52fe3de-1388-41b8-8a73-91b8fd1161bf tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f/action" status: 202 len: 0 microversion: 2.25 time: 3.761544 Feb 12 21:05:11.621415 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 484/1036] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:05:07 2022] POST /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f/action => generated 0 bytes in 3771 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:05:11.645340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:11.662705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:11.677846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fbd64395-6e25-4500-bd7c-d7d5fa2b3245 req-c8488003-ac67-4f73-b5ca-a772d295d37d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:11.677846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fbd64395-6e25-4500-bd7c-d7d5fa2b3245 req-c8488003-ac67-4f73-b5ca-a772d295d37d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:11.710477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:11.713234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:11.713234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:11.713234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:11.713539 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fbd64395-6e25-4500-bd7c-d7d5fa2b3245 req-c8488003-ac67-4f73-b5ca-a772d295d37d service nova] Creating event network-changed:1dcd7742-1914-4434-a268-34bdc3f688d2 for instance b0ea6f0a-e322-4f50-8683-2511dce11a6b on nch2-master-1 Feb 12 21:05:11.729623 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fbd64395-6e25-4500-bd7c-d7d5fa2b3245 req-c8488003-ac67-4f73-b5ca-a772d295d37d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163212 Feb 12 21:05:11.738423 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 553/1037] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:11.749887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:11.756636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:11.786650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:11.790927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:11.790927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:11.790927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:11.847671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:11.855101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Old instance type tempest-test_resize_flavor_-1026732008, new instance type m1.heat {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:05:11.872208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:05:11.872208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:05:11.872208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:05:11.872208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:05:11.872208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:05:12.166558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:12.190449 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-629e934f-f3d4-4221-8a04-7679243af798 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1317 microversion: 2.1 time: 0.566599 Feb 12 21:05:12.192962 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 485/1038] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:11 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:12.196880 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25c9a421-63ac-4028-b39d-15f11cd6188e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.457100 Feb 12 21:05:12.205192 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 554/1039] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:05:11 2022] POST /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:05:12.208925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:12.209581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:12.221174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc54288e-216f-4559-b4d1-e4f953dfd87c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fec91af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:12.238959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:12.239417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:12.240231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:12.240667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:12.328196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc54288e-216f-4559-b4d1-e4f953dfd87c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1452 microversion: 2.1 time: 0.121710 Feb 12 21:05:12.328829 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 555/1040] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:12 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:12.345485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:12.348983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:12.363817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:12.366614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:12.370892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:12.371659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:12.821897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:12.831803 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef9b25d6-6120-4728-9270-5d4e1f9a673d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.635953 Feb 12 21:05:12.839172 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 486/1041] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:12 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:13.048374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:13.059192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:13.060682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:13.062185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-71bb5214-32cd-44e1-ab5c-8c5d3bd1a7fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.731351 Feb 12 21:05:13.065615 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 556/1042] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:12 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:13.077766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f3b2ffaa-8aa7-4aba-8e2c-a836546b2c92 req-bc30f3b5-9cc0-49ee-82a5-e95cfa739959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:13.085789 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:13.085789 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:13.097280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64deec3b-4fe5-486c-b100-46e57f2b7fa9 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1415806821", "ram": 512, "vcpus": 1, "disk": 10, "id": 1854093739, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:13.099613 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:13.099613 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:13.104478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f3b2ffaa-8aa7-4aba-8e2c-a836546b2c92 req-bc30f3b5-9cc0-49ee-82a5-e95cfa739959 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.112040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f3b2ffaa-8aa7-4aba-8e2c-a836546b2c92 req-bc30f3b5-9cc0-49ee-82a5-e95cfa739959 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.139541 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f3b2ffaa-8aa7-4aba-8e2c-a836546b2c92 req-bc30f3b5-9cc0-49ee-82a5-e95cfa739959 service nova] Creating event network-changed:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:05:13.155502 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f3b2ffaa-8aa7-4aba-8e2c-a836546b2c92 req-bc30f3b5-9cc0-49ee-82a5-e95cfa739959 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088207 Feb 12 21:05:13.157048 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 557/1043] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:13.163991 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64deec3b-4fe5-486c-b100-46e57f2b7fa9 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.323147 Feb 12 21:05:13.164297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:13.164602 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 487/1044] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:12 2022] POST /compute/v2.1/flavors => generated 416 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:13.173162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:13.180830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:13.181107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.184925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:13.188901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.189767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.190215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.208347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.208817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.209691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.210131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.573067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:13.589568 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77c1ef02-b612-4833-8e1a-af95c5f8d312 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1535 microversion: 2.1 time: 0.426440 Feb 12 21:05:13.591022 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 558/1045] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:13 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1535 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:13.601488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-44d605e5-2f9a-4365-8cf9-adbfe6b46444 req-64a46947-7691-440b-a2c4-79d0dd4d9355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b389ae6-debb-4a3d-9fbb-648307b779ed", "name": "network-vif-plugged", "status": "completed", "tag": "10c43251-210a-44eb-abb2-bdfbd842fd4d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:13.603399 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:13.603399 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:13.623249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-44d605e5-2f9a-4365-8cf9-adbfe6b46444 req-64a46947-7691-440b-a2c4-79d0dd4d9355 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.624472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-44d605e5-2f9a-4365-8cf9-adbfe6b46444 req-64a46947-7691-440b-a2c4-79d0dd4d9355 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.677571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-44d605e5-2f9a-4365-8cf9-adbfe6b46444 req-64a46947-7691-440b-a2c4-79d0dd4d9355 service nova] Creating event network-vif-plugged:10c43251-210a-44eb-abb2-bdfbd842fd4d for instance 2b389ae6-debb-4a3d-9fbb-648307b779ed on nch2-master-1 Feb 12 21:05:13.709669 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-44d605e5-2f9a-4365-8cf9-adbfe6b46444 req-64a46947-7691-440b-a2c4-79d0dd4d9355 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116702 Feb 12 21:05:13.710973 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 559/1046] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:13.725737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3bf7c7c-d07d-4e79-922e-089155fce3b3 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:13.725737 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:13.725737 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:13.921193 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3bf7c7c-d07d-4e79-922e-089155fce3b3 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.208673 Feb 12 21:05:13.922564 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 560/1047] 10.222.0.31 () {60 vars in 1223 bytes} [Sat Feb 12 21:05:13 2022] POST /compute/v2.1/flavors/1854093739/os-extra_specs => generated 66 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:13.927728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:13.936009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:13.955265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.958719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:13.964273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:13.973778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:14.394326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:14.404615 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-defa0c4a-108c-43e0-8cd5-b60e2a2956fe tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1317 microversion: 2.1 time: 0.480781 Feb 12 21:05:14.417898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 561/1048] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:13 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:14.424554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cadce216-e48b-4f92-8f36-79b004a09da9 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fecc0160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:14.597819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:14.609969 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5306e0f4-d84e-4ffa-9386-c203f4f58b5a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 1.442866 Feb 12 21:05:14.622437 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 488/1049] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:13 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:14.628613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e90a09af-4a22-442f-a790-6e22885c8ae0 req-6b0a0221-ab10-4724-bbbf-fba57f62ad67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11cb772b-44b0-4edd-8aa7-c510b2a7211a", "tag": "00fe00bc-2807-4800-866f-306a75719cca"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:14.630576 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:14.630576 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:14.642640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e90a09af-4a22-442f-a790-6e22885c8ae0 req-6b0a0221-ab10-4724-bbbf-fba57f62ad67 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:14.643465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e90a09af-4a22-442f-a790-6e22885c8ae0 req-6b0a0221-ab10-4724-bbbf-fba57f62ad67 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:14.656954 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e90a09af-4a22-442f-a790-6e22885c8ae0 req-6b0a0221-ab10-4724-bbbf-fba57f62ad67 service nova] Creating event network-changed:00fe00bc-2807-4800-866f-306a75719cca for instance 11cb772b-44b0-4edd-8aa7-c510b2a7211a on nch2-master-1 Feb 12 21:05:14.663103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e90a09af-4a22-442f-a790-6e22885c8ae0 req-6b0a0221-ab10-4724-bbbf-fba57f62ad67 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038870 Feb 12 21:05:14.666502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 489/1050] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:14.679899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:14.681734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:14.715456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:14.717873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:14.721562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:14.721562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:15.169154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:15.179324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f0d78c3-0814-45ff-a5b0-d172a00688bd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.512898 Feb 12 21:05:15.180165 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 490/1051] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:14 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:15.399600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff1ca333-4af0-4366-a827-351e018372a6 tempest-FlavorsExtraSpecsTestJSON-1381518227 tempest-FlavorsExtraSpecsTestJSON-1381518227-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:15.422747 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff1ca333-4af0-4366-a827-351e018372a6 tempest-FlavorsExtraSpecsTestJSON-1381518227 tempest-FlavorsExtraSpecsTestJSON-1381518227-project] 10.222.0.31 "GET /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.232127 Feb 12 21:05:15.434792 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 491/1052] 10.222.0.31 () {58 vars in 1202 bytes} [Sat Feb 12 21:05:15 2022] GET /compute/v2.1/flavors/1854093739/os-extra_specs => generated 66 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:15.442876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:15.447036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:15.458345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:15.465620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:15.466848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:15.467454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:15.945386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:15.955690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:15.957249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:15.958422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a2c477b-90f8-4f4c-bf11-f79a062f8ac5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.521543 Feb 12 21:05:15.979597 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 492/1053] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:15 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:15.984278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:15.990924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:15.999768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:16.020610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:16.021526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:16.021967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:16.333087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:16.344594 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb87347f-d573-44dc-9f0f-a780175a61f7 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1535 microversion: 2.1 time: 0.371194 Feb 12 21:05:16.346193 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 493/1054] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:15 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1535 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:16.359654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:16.360818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:16.369565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:16.370427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:16.372183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:16.372871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:16.659114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:16.672992 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb6bbca8-6953-4c0b-bacb-e09911146b3f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1507 microversion: 2.1 time: 0.323706 Feb 12 21:05:16.674753 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 494/1055] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:16 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:16.689251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-be1e33bb-c01d-4401-8395-c0ee344a6827 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:16.690776 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:16.690776 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:16.722574 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-be1e33bb-c01d-4401-8395-c0ee344a6827 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046669 Feb 12 21:05:16.727709 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 495/1056] 10.222.0.31 () {60 vars in 1223 bytes} [Sat Feb 12 21:05:16 2022] POST /compute/v2.1/flavors/1854093739/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:16.728280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:16.728899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:16.737553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:16.738026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:16.738835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:16.739275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.024767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:17.039829 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd7bfed1-93a3-41fe-9a86-3fb69911116c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.315145 Feb 12 21:05:17.041180 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 496/1057] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:16 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:17.048344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:17.049135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:17.055845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.059205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.060163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.060711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.328558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:17.339453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60058147-5c04-4619-bc0a-993f307500ca tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.297045 Feb 12 21:05:17.342561 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 497/1058] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:17 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:17.349006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:17.359284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:17.373451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.373451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.373451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.375100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.407035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:05:17.778613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0f211ebc-528f-429d-887b-93af3684f389 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 204 len: 0 microversion: 2.1 time: 0.432738 Feb 12 21:05:17.781849 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 498/1059] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:05:17 2022] DELETE /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:05:17.786579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b42d25b5-64b4-414b-b68b-7cd1fa8512ad req-2fcff610-79fb-4487-bd12-b8d446265957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6adffe64-7deb-47c3-b073-0fc6b684979f", "name": "network-vif-unplugged", "status": "completed", "tag": "6ab99884-aa16-42e5-9cde-aea1aba07ad2"}, {"name": "network-changed", "server_uuid": "6adffe64-7deb-47c3-b073-0fc6b684979f", "tag": "6ab99884-aa16-42e5-9cde-aea1aba07ad2"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:17.794729 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:17.794729 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:17.813107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b42d25b5-64b4-414b-b68b-7cd1fa8512ad req-2fcff610-79fb-4487-bd12-b8d446265957 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.813666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b42d25b5-64b4-414b-b68b-7cd1fa8512ad req-2fcff610-79fb-4487-bd12-b8d446265957 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.831198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b42d25b5-64b4-414b-b68b-7cd1fa8512ad req-2fcff610-79fb-4487-bd12-b8d446265957 service nova] Creating event network-vif-unplugged:6ab99884-aa16-42e5-9cde-aea1aba07ad2 for instance 6adffe64-7deb-47c3-b073-0fc6b684979f on nch1-master-1 Feb 12 21:05:17.831737 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b42d25b5-64b4-414b-b68b-7cd1fa8512ad req-2fcff610-79fb-4487-bd12-b8d446265957 service nova] Creating event network-changed:6ab99884-aa16-42e5-9cde-aea1aba07ad2 for instance 6adffe64-7deb-47c3-b073-0fc6b684979f on nch1-master-1 Feb 12 21:05:17.837933 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b42d25b5-64b4-414b-b68b-7cd1fa8512ad req-2fcff610-79fb-4487-bd12-b8d446265957 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.057168 Feb 12 21:05:17.842740 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 499/1060] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:17.851098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23e337c0-09a3-4573-a6b2-330713a1a289 tempest-FlavorsExtraSpecsTestJSON-1381518227 tempest-FlavorsExtraSpecsTestJSON-1381518227-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:17.873615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23e337c0-09a3-4573-a6b2-330713a1a289 tempest-FlavorsExtraSpecsTestJSON-1381518227 tempest-FlavorsExtraSpecsTestJSON-1381518227-project] 10.222.0.31 "GET /compute/v2.1/flavors/1854093739/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024748 Feb 12 21:05:17.877616 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 500/1061] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:05:17 2022] GET /compute/v2.1/flavors/1854093739/os-extra_specs/hw:numa_nodes => generated 22 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:17.887271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:17.890390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:17.900384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.900838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:17.901669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:17.902103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:18.297291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:18.316625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:18.322278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:18.323504 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f796e3a2-2b70-484a-959f-620b7df89e3e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.448060 Feb 12 21:05:18.324417 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 501/1062] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:17 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:18.333157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:18.333813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:18.349485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:18.349938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:18.350742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:18.351183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:18.659555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:18.668943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-94af0ab8-6e60-408c-8989-ac2178070a83 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.342951 Feb 12 21:05:18.676434 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 502/1063] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:18 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:18.690663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:18.691986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:18.712206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:18.715988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:18.715988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:18.715988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.015700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:19.030694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8736dbb6-9ae7-4fe0-a113-2d4485c1dbe9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1513 microversion: 2.1 time: 0.352385 Feb 12 21:05:19.031607 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 503/1064] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:18 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:19.038123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f59f44a-7368-4326-bf35-e1f97a2e9e8f tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:19.039516 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:19.039516 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:19.065686 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f59f44a-7368-4326-bf35-e1f97a2e9e8f tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033041 Feb 12 21:05:19.066760 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 504/1065] 10.222.0.31 () {60 vars in 1223 bytes} [Sat Feb 12 21:05:19 2022] POST /compute/v2.1/flavors/1854093739/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:19.071410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:19.072114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:19.079899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.079899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.080293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.080700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.330902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:19.349339 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-19219f5f-5381-4112-ab6d-ad517eac29be tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.281407 Feb 12 21:05:19.358924 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 505/1066] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:19 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:19.362612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:19.365903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:19.377287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.378963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.379874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.380321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.638837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:19.654660 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bebc9441-e963-4261-ba45-8f06c8b24320 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.301278 Feb 12 21:05:19.655263 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 506/1067] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:19 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:19.686757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5294e70e-06a2-49d0-8c82-b73294485d0d req-919e2353-4355-4db0-bd12-e82384746835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ea6f0a-e322-4f50-8683-2511dce11a6b", "name": "network-vif-plugged", "status": "completed", "tag": "1dcd7742-1914-4434-a268-34bdc3f688d2"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:19.686757 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:19.686757 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:19.686757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5294e70e-06a2-49d0-8c82-b73294485d0d req-919e2353-4355-4db0-bd12-e82384746835 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.686757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5294e70e-06a2-49d0-8c82-b73294485d0d req-919e2353-4355-4db0-bd12-e82384746835 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.708405 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5294e70e-06a2-49d0-8c82-b73294485d0d req-919e2353-4355-4db0-bd12-e82384746835 service nova] Creating event network-vif-plugged:1dcd7742-1914-4434-a268-34bdc3f688d2 for instance b0ea6f0a-e322-4f50-8683-2511dce11a6b on nch2-master-1 Feb 12 21:05:19.715813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5294e70e-06a2-49d0-8c82-b73294485d0d req-919e2353-4355-4db0-bd12-e82384746835 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050132 Feb 12 21:05:19.724123 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 507/1068] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:19.737031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c53f201a-4df8-40c4-b182-e7d1df311264 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:19.757459 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c53f201a-4df8-40c4-b182-e7d1df311264 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035347 Feb 12 21:05:19.763569 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 508/1069] 10.222.0.31 () {58 vars in 1202 bytes} [Sat Feb 12 21:05:19 2022] GET /compute/v2.1/flavors/1854093739/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:19.781187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:19.782325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:19.791079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.791802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:19.792842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:19.794449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.205932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:20.234741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:20.236691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:20.250380 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14967d7f-2d6a-4997-8a51-8390d9d73fdd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.474890 Feb 12 21:05:20.261273 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 509/1070] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:19 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:20.285855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:20.306112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:20.313008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.327895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.329024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.331556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.603458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:20.614228 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6bc794bc-4fd0-4cf8-a0f3-7c18597d9bfd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.357204 Feb 12 21:05:20.616341 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 510/1071] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:20 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:20.628191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b49fd71-887e-49dd-b2e1-cf0821864a8b tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:20.633953 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:20.633953 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:20.772976 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b49fd71-887e-49dd-b2e1-cf0821864a8b tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "PUT /compute/v2.1/flavors/1854093739/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.155274 Feb 12 21:05:20.774246 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 511/1072] 10.222.0.31 () {60 vars in 1264 bytes} [Sat Feb 12 21:05:20 2022] PUT /compute/v2.1/flavors/1854093739/os-extra_specs/hw:numa_nodes => generated 22 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:20.779180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:20.779840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:20.786704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.787272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.787987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.788432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.825191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.825693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.826258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'fault' on Instance uuid 2b389ae6-debb-4a3d-9fbb-648307b779ed {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:20.885120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:20.894292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4a17c1ac-c7ec-40ec-a744-9d75778f260a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1307 microversion: 2.1 time: 0.118890 Feb 12 21:05:20.896100 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 512/1073] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:20 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:20.901234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ab1cd459-935e-4054-9199-66fd319c2063 req-de460cef-bb67-4e75-8a36-d121e427d917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b389ae6-debb-4a3d-9fbb-648307b779ed", "name": "network-vif-deleted", "tag": "10c43251-210a-44eb-abb2-bdfbd842fd4d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:20.903682 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:20.903682 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:20.919366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ab1cd459-935e-4054-9199-66fd319c2063 req-de460cef-bb67-4e75-8a36-d121e427d917 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.919626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ab1cd459-935e-4054-9199-66fd319c2063 req-de460cef-bb67-4e75-8a36-d121e427d917 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.936324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ab1cd459-935e-4054-9199-66fd319c2063 req-de460cef-bb67-4e75-8a36-d121e427d917 service nova] Creating event network-vif-deleted:10c43251-210a-44eb-abb2-bdfbd842fd4d for instance 2b389ae6-debb-4a3d-9fbb-648307b779ed on nch2-master-1 Feb 12 21:05:20.941626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ab1cd459-935e-4054-9199-66fd319c2063 req-de460cef-bb67-4e75-8a36-d121e427d917 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043671 Feb 12 21:05:20.942518 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 513/1074] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:20.960344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:20.961136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:20.968241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.970811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:20.970811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:20.970811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:21.245931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:21.254187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a59d38bc-e331-476c-97d2-fb65a220f89d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.310523 Feb 12 21:05:21.267019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 514/1075] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:20 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:21.273840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:21.274558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:21.285422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:21.286004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:21.286905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:21.287424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:21.543144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:21.549826 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f40bf5cf-af97-415e-bc6d-b45fc290e781 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.279357 Feb 12 21:05:21.551335 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 515/1076] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:21 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:21.556907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-73f007b0-cc3e-4373-99de-fd58376ab0cf tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:21.567040 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-73f007b0-cc3e-4373-99de-fd58376ab0cf tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013888 Feb 12 21:05:21.570317 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 516/1077] 10.222.0.31 () {58 vars in 1202 bytes} [Sat Feb 12 21:05:21 2022] GET /compute/v2.1/flavors/1854093739/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:21.576782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:21.577728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:21.585493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:21.586145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:21.587066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:21.587672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:21.816470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:21.824512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:21.826269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:21.827420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70ff40c2-f911-46a0-a1ba-8f362a1205a2 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.258868 Feb 12 21:05:21.827993 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 517/1078] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:21 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:21.832285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96cde648-7501-4426-bf78-0f53921f0826 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:21.833128 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:21.833128 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:22.263046 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96cde648-7501-4426-bf78-0f53921f0826 tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1854093739/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.433399 Feb 12 21:05:22.264903 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 518/1079] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:05:21 2022] DELETE /compute/v2.1/flavors/1854093739/os-extra_specs/hw:numa_nodes => generated 0 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:05:22.276140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:22.276140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:22.297854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.299918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:22.305718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.306406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:22.581141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:22.589734 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30d2ab7d-956c-4df4-82ff-5ebe57878a0b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.323313 Feb 12 21:05:22.590272 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 519/1080] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:22 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:22.606875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:22.607480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:22.620524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.626230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:22.627636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.628104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:22.696341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.697039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:22.697754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'fault' on Instance uuid 2b389ae6-debb-4a3d-9fbb-648307b779ed {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:22.778772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:22.788503 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7fa524d5-cddd-4de0-b780-88a59366adbb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1307 microversion: 2.1 time: 0.186672 Feb 12 21:05:22.799042 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 520/1081] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:22 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:22.804640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c5cce1a-6976-4a85-88b4-979c316f5a3a tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:22.808353 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:22.808353 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:22.948388 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c5cce1a-6976-4a85-88b4-979c316f5a3a tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1854093739/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.147653 Feb 12 21:05:22.950640 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 521/1082] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:05:22 2022] DELETE /compute/v2.1/flavors/1854093739/os-extra_specs/hw:cpu_policy => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Feb 12 21:05:22.957474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:22.958478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:22.965752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.968387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:22.968387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:22.968387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.150660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:23.167630 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b3ac2d35-a82a-47d8-aceb-92bdd1079dff tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.215546 Feb 12 21:05:23.172627 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 522/1083] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:22 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:23.181645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-02d20539-baa2-42e9-a357-09bc7230d366 req-48d7ae46-78a6-4a54-8e71-87ef7d768824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "name": "network-vif-plugged", "status": "completed", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:23.183157 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:23.183157 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:23.207068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-02d20539-baa2-42e9-a357-09bc7230d366 req-48d7ae46-78a6-4a54-8e71-87ef7d768824 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.209713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-02d20539-baa2-42e9-a357-09bc7230d366 req-48d7ae46-78a6-4a54-8e71-87ef7d768824 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.237396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-02d20539-baa2-42e9-a357-09bc7230d366 req-48d7ae46-78a6-4a54-8e71-87ef7d768824 service nova] Creating event network-vif-plugged:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:05:23.242443 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-02d20539-baa2-42e9-a357-09bc7230d366 req-48d7ae46-78a6-4a54-8e71-87ef7d768824 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068568 Feb 12 21:05:23.243647 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 523/1084] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:23.249866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:23.250794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:23.258160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.258852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.260057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.260655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.516205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:23.524624 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe8cf35a-6a52-4604-89ea-9f2ee6b30b30 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.279631 Feb 12 21:05:23.526028 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 524/1085] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:23 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:23.540389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:23.541068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:23.560439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.560439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.560439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.560439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.831079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:23.841608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:23.843146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:23.844373 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b204579-e8da-4436-b7ab-de9d74704a61 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.307695 Feb 12 21:05:23.855091 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 525/1086] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:23 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:23.860647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d720b306-67b4-4a65-b6dc-00e9d9dcd7bf tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:23.877312 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d720b306-67b4-4a65-b6dc-00e9d9dcd7bf tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/1854093739/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031103 Feb 12 21:05:23.878886 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 526/1087] 10.222.0.31 () {58 vars in 1202 bytes} [Sat Feb 12 21:05:23 2022] GET /compute/v2.1/flavors/1854093739/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:05:23.884315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:23.884985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:23.891975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.892427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:23.895397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:23.895890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.087181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:24.106376 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f7a703a2-3701-4873-bbbf-00c3cfa985ea tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.225677 Feb 12 21:05:24.117662 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 527/1088] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:23 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:24.117662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:24.117662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:24.131304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.131767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.132589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.134886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.208456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.209223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.210161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'fault' on Instance uuid 2b389ae6-debb-4a3d-9fbb-648307b779ed {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:24.267430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:24.300294 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a48efde5-3d6d-4fb2-9ee0-377b86577cfc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 200 len: 1307 microversion: 2.1 time: 0.191374 Feb 12 21:05:24.314486 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 528/1089] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:24 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:24.319759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7d7d4a0-1a37-4613-b099-dbeb0d79af8c tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:24.328703 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:24.328703 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:24.554920 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7d7d4a0-1a37-4613-b099-dbeb0d79af8c tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1854093739" status: 202 len: 0 microversion: 2.1 time: 0.239051 Feb 12 21:05:24.555600 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 529/1090] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:05:24 2022] DELETE /compute/v2.1/flavors/1854093739 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:05:24.561955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:24.562540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:24.576231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.576681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.577529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.577977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.780151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:24.788042 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a01ece44-ae06-4794-bfd8-a857182eb1d6 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.230905 Feb 12 21:05:24.788840 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 530/1091] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:24 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:24.803263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:24.803881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:24.811916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.812301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:24.813102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:24.813843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.042525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:25.067095 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1aa143ff-3f32-47c0-b817-7bb9e44edb44 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.267416 Feb 12 21:05:25.067809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 531/1092] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:24 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:25.072037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a840aef6-a7e4-417e-abc6-31fda2db7aae tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:25.102524 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a840aef6-a7e4-417e-abc6-31fda2db7aae tempest-FlavorsExtraSpecsTestJSON-1749578071 tempest-FlavorsExtraSpecsTestJSON-1749578071-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033813 Feb 12 21:05:25.113304 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 532/1093] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:05:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:25.113304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:25.113304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:25.119048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.119496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.122775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.123230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.301652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:25.311414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:25.312992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:25.315664 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5b377aa-71e7-4d36-bdd9-9fe6df889c07 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1569 microversion: 2.25 time: 0.211563 Feb 12 21:05:25.324428 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 533/1094] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:25 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:25.331978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:25.333945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:25.355042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.355042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.357557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.358249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.551797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:25.562320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d499aa4-1abd-4d99-b24d-e697f59bbef4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.236288 Feb 12 21:05:25.564151 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 534/1095] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:25 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:25.569093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6a0e1d7a-c1b4-4a28-9cf7-8532e90fce87 req-41a6d4de-99dd-4333-8f68-6c277ef951e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cb772b-44b0-4edd-8aa7-c510b2a7211a", "name": "network-vif-plugged", "status": "completed", "tag": "00fe00bc-2807-4800-866f-306a75719cca"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:25.570788 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:25.570788 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:25.585118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6a0e1d7a-c1b4-4a28-9cf7-8532e90fce87 req-41a6d4de-99dd-4333-8f68-6c277ef951e2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.590888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6a0e1d7a-c1b4-4a28-9cf7-8532e90fce87 req-41a6d4de-99dd-4333-8f68-6c277ef951e2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.621790 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6a0e1d7a-c1b4-4a28-9cf7-8532e90fce87 req-41a6d4de-99dd-4333-8f68-6c277ef951e2 service nova] Creating event network-vif-plugged:00fe00bc-2807-4800-866f-306a75719cca for instance 11cb772b-44b0-4edd-8aa7-c510b2a7211a on nch2-master-1 Feb 12 21:05:25.628615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6a0e1d7a-c1b4-4a28-9cf7-8532e90fce87 req-41a6d4de-99dd-4333-8f68-6c277ef951e2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063077 Feb 12 21:05:25.629942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 535/1096] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:25.639548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:25.640298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:25.654739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.655558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.656803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.657476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.676244 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. Feb 12 21:05:25.677144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:25.678389 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b83930f9-583e-4d24-a0d9-1d90ce2dda8f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 404 len: 111 microversion: 2.1 time: 0.046773 Feb 12 21:05:25.679163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 536/1097] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:25 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:05:25.697333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:25.702578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:25.711801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.712352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:25.713256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:25.713798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.029824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:26.048627 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e179cf6c-de9b-4830-ad2c-98602902fcbd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.362615 Feb 12 21:05:26.054756 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 537/1098] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:25 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:26.061414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:26.068906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:26.088109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.093629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.093629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.093629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.316141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:26.325000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6b3c123-ee71-410f-9bbc-ae017b58c127 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1317 microversion: 2.1 time: 0.267188 Feb 12 21:05:26.328848 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 538/1099] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:26 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:26.332713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:26.333322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:26.346658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.347100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.347931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.348378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.607816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:26.607816 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e85bacd-e4d6-433a-b5df-787ee1b49309 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1318 microversion: 2.1 time: 0.259053 Feb 12 21:05:26.607816 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 539/1100] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:26 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:26.608576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-345a91f2-5b4d-4b7d-b89c-02ddd5bab986 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:26.608576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-345a91f2-5b4d-4b7d-b89c-02ddd5bab986 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:26.608576 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-345a91f2-5b4d-4b7d-b89c-02ddd5bab986 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.006845 Feb 12 21:05:26.608576 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 540/1101] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:26 2022] POST /compute/v2.1/servers => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:26.609512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:26.609512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:26.615529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.616105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.617184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.617852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.819862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:26.828752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:26.830517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:26.832347 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e3f55c46-8494-4235-88d5-6d4c56e4e6c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1544 microversion: 2.25 time: 0.233790 Feb 12 21:05:26.846102 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 541/1102] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:26 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1544 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:26.852177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:26.853061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:26.862060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.862615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:26.863797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:26.864380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:27.419710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:27.436445 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-decfb795-b3c2-4908-bfc7-7ec38003c17d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.588636 Feb 12 21:05:27.438062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 542/1103] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:26 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:27.449577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:27.450502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:27.469621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:27.469621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:27.470420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:27.470871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:27.749778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:27.761520 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-486d7e16-dfd6-4136-b9d7-af0a842bdbdb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.322004 Feb 12 21:05:27.765123 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 543/1104] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:27 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:27.779365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad3d86b6-f2d6-4382-bde9-1dfc4eeb2031 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '.version_select at 0x7fa8fe159ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:27.781229 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:27.781229 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:27.783121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad3d86b6-f2d6-4382-bde9-1dfc4eeb2031 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:27.789148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad3d86b6-f2d6-4382-bde9-1dfc4eeb2031 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:27.827232 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad3d86b6-f2d6-4382-bde9-1dfc4eeb2031 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 3626 microversion: 2.25 time: 0.062267 Feb 12 21:05:27.831101 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 544/1105] 10.222.0.31 () {60 vars in 1183 bytes} [Sat Feb 12 21:05:27 2022] GET /compute/v2.1/os-migrations => generated 3626 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:27.843248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:27.846290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:27.855084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:27.857427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:27.860701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:27.862848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.061849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:28.070863 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59ee1162-fcec-4ed7-94c2-6d802e88f2fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1467 microversion: 2.1 time: 0.238030 Feb 12 21:05:28.071452 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 545/1106] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:27 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:28.076851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:28.077506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:28.084599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.086048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.086048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.086340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.240453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:28.249303 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0351862a-447d-45ce-bd88-ea093456e371 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1468 microversion: 2.1 time: 0.176809 Feb 12 21:05:28.250227 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 546/1107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:28 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1468 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:28.254752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:28.255362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:28.261613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.262034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.263014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.263451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.432131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:28.432131 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccb5c669-de88-4ae1-acce-b3d67abc726d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.179373 Feb 12 21:05:28.432131 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 547/1108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:28 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:28.436167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:28.437054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:28.451771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.452299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.453388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.453759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.620047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:28.635422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a7a1b5b-73b7-46a4-862f-3ba39c551f23 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 2037 microversion: 2.25 time: 0.203264 Feb 12 21:05:28.636286 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 548/1109] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:28 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 2037 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:28.652241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-475343057", "metadata": {"image_type": "test"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:28.655734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:28.665442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.665442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.666068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.666634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.732863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Getting quotas for project fadab1c622d04b36be08c573468cd5be. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:28.740023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Getting quotas for user 34dcf9eabda74da6a6e26ad039bd9258 and project fadab1c622d04b36be08c573468cd5be. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:28.799558 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cadce216-e48b-4f92-8f36-79b004a09da9 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1461 microversion: 2.1 time: 14.378511 Feb 12 21:05:28.800887 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 562/1110] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:14 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1461 bytes in 14381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:28.811813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:28.812420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:28.821134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.821933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.822854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:28.823366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:28.994889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:29.006447 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e750f6e0-861e-4d87-8473-1f4ef9f3e607 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1468 microversion: 2.1 time: 0.198438 Feb 12 21:05:29.007336 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 563/1111] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:28 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:29.012446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:29.013302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:29.026402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.026402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.026402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.026402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.216025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:29.225724 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa2a134a-dcf7-4d10-9ff6-330f9bbe4784 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.216633 Feb 12 21:05:29.227147 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 564/1112] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:29 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:29.234071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-267204599", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "714ff2dc-d317-4a71-9ee6-4e812e6c4f51"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:29.303986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] validate_networks() for [('714ff2dc-d317-4a71-9ee6-4e812e6c4f51', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:05:29.404334 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5b887e3e-4f4e-40d2-8224-28ded341730d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "POST /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99/action" status: 202 len: 0 microversion: 2.1 time: 0.764134 Feb 12 21:05:29.404334 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 549/1113] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:05:28 2022] POST /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:05:29.414754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-20500295-b346-47a9-a92f-aec05227bb02 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa904f07670>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:29.485833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-20500295-b346-47a9-a92f-aec05227bb02 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 200 len: 1461 microversion: 2.1 time: 0.079475 Feb 12 21:05:29.486988 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 550/1114] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:29 2022] GET /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:29.491688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:29.495731 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:29.495731 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:29.498082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:29.498962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Searching by: {'reservation_id': 'r-x10vbanv', 'deleted': False, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:05:29.505948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.506415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.508398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.508398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.692596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:05:29.792276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:29.801011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.801492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.811184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:05:29.811689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:05:29.812096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:05:29.812508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:05:29.812953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:05:29.828263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.829211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.830338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:29.831003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:29.850712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:29.857218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for user 3cae3e35c281419b98224db3b8ea1f19 and project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:29.870914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:05:29.873707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:05:29.967000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c047431e-fe75-44a3-8e2a-d7885c7f32c5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/detail?reservation_id=r-x10vbanv" status: 200 len: 2929 microversion: 2.1 time: 0.478945 Feb 12 21:05:29.967669 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 551/1115] 10.222.0.31 () {58 vars in 1196 bytes} [Sat Feb 12 21:05:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-x10vbanv => generated 2929 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:29.972032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00b1da7e-674a-4c0e-afc7-3850247b5f20 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fe167670>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.023571 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00b1da7e-674a-4c0e-afc7-3850247b5f20 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1421 microversion: 2.1 time: 0.054667 Feb 12 21:05:30.024130 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 552/1116] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:29 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1421 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:30.029223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.029976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:30.037592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.037813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.038829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.039335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.084217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c3d1bdc-7dfa-42f1-b2d4-7bc8de92caae tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.855364 Feb 12 21:05:30.086216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 565/1117] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:05:30.094763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cad7bcab-96bd-4148-a937-b5af2a4680cd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.126208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.server_groups [None req-cad7bcab-96bd-4148-a937-b5af2a4680cd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Querying cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) for 2 instances {{(pid=141727) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 12 21:05:30.127267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cad7bcab-96bd-4148-a937-b5af2a4680cd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.128057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cad7bcab-96bd-4148-a937-b5af2a4680cd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.167971 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cad7bcab-96bd-4148-a937-b5af2a4680cd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups/a4c5058a-b9f6-4e1c-93ce-b85566e53690" status: 200 len: 265 microversion: 2.1 time: 0.080344 Feb 12 21:05:30.173905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 566/1118] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:05:30 2022] GET /compute/v2.1/os-server-groups/a4c5058a-b9f6-4e1c-93ce-b85566e53690 => generated 265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:30.178951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37602473-caea-40ff-8bd4-b112d44a4fdb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.180802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-37602473-caea-40ff-8bd4-b112d44a4fdb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:30.245106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:30.256843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab6e976b-8a26-4da6-ae69-d00e9fb32169 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1466 microversion: 2.1 time: 0.230814 Feb 12 21:05:30.260175 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 553/1119] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:30 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1466 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:30.262867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37602473-caea-40ff-8bd4-b112d44a4fdb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:30.266426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.268588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:30.275956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37602473-caea-40ff-8bd4-b112d44a4fdb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:30.278752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37602473-caea-40ff-8bd4-b112d44a4fdb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:30.280070 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37602473-caea-40ff-8bd4-b112d44a4fdb tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1261 microversion: 2.25 time: 0.105160 Feb 12 21:05:30.281045 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 567/1120] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:30 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:30.281745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.282208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.283263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.283701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.286931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.287731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:30.296168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.296168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.296424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.297007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.469309 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0307a49-7156-486d-a105-cb50f759697a tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 200 len: 1619 microversion: 2.1 time: 0.207758 Feb 12 21:05:30.471215 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 554/1121] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:30 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 1619 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:30.482632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-797576258"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:30.483279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:30.483392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:30.483497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.483978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.484686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.485128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.486420 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce01a470-b3f7-4786-9183-b5e0040de1ac tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.203844 Feb 12 21:05:30.498733 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 568/1122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:30 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:30.506501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:30.506501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:30.513685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.514414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.515441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:30.516068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:30.679838 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-940cdd44-0a19-46a0-a669-8d1c3e5bcfd8 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1619 microversion: 2.1 time: 0.179123 Feb 12 21:05:30.680433 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 569/1123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:30 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1619 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:30.702415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce3b2f65-731e-4ca6-accb-48a01386980f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: .version_select at 0x7fa8fec89280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1000292898", "policies": ["anti-affinity"]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:30.727588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ce3b2f65-731e-4ca6-accb-48a01386980f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:30.733213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ce3b2f65-731e-4ca6-accb-48a01386980f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:30.865072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ce3b2f65-731e-4ca6-accb-48a01386980f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:30.874850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ce3b2f65-731e-4ca6-accb-48a01386980f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:30.890538 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce3b2f65-731e-4ca6-accb-48a01386980f tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.192546 Feb 12 21:05:30.891151 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 570/1124] 10.222.0.31 () {60 vars in 1173 bytes} [Sat Feb 12 21:05:30 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:31.012853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-888408284", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "da7a162c-2879-4f24-bb04-7051dc36b643"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:31.067110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:05:31.078961 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9366a7a2-b8b0-4ea2-be54-3a0c0280e569 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "POST /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77/action" status: 202 len: 0 microversion: 2.1 time: 0.607238 Feb 12 21:05:31.084910 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 555/1125] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:05:30 2022] POST /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:05:31.096555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e10364a-0e76-47db-a9d9-1a5c535040fb tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fe0e9b80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:31.183938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e10364a-0e76-47db-a9d9-1a5c535040fb tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1421 microversion: 2.1 time: 0.096287 Feb 12 21:05:31.190857 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 556/1126] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:31 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:31.196747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6656c7d6-fe9f-49d4-8c64-ab7b5ecaa406 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe024e50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:31.261915 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6656c7d6-fe9f-49d4-8c64-ab7b5ecaa406 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1452 microversion: 2.1 time: 0.068855 Feb 12 21:05:31.269975 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 557/1127] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:31 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:31.303461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:31.305569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:31.317225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:31.318118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:31.319093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:31.319530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:31.413284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:05:31.413865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:05:31.414467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:05:31.414983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:05:31.415647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:05:31.427826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:31.437947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:31.439929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:31.441035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0eb3e3bd-e7bb-41c8-a8c1-525d90ca3791 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1265 microversion: 2.25 time: 0.144470 Feb 12 21:05:31.441797 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 558/1128] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:31 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:31.456304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:31.456547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:31.458967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:31.459426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:31.500617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:31.504723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:31.505953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:31.510708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:31.518130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:31.519284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:31.523090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:31.525166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:31.531395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Going to run 2 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:05:31.533953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:05:31.664414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=141727) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Feb 12 21:05:31.722513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:31.729535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:31.735290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:31.741990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4e0c34a7-b0ab-4c10-a995-665841904809 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.240692 Feb 12 21:05:31.742764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 559/1129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:31 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:31.884441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86adc039-40f6-4d94-8455-f158e56b0b44 tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1623161991", "id": 1033703300, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:31.886153 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:31.886153 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:31.970076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:31.975626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:31.990488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=99e01316-e5b8-4cf6-b921-313a90bc4a48,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:05:31.993748 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86adc039-40f6-4d94-8455-f158e56b0b44 tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.249874 Feb 12 21:05:31.994494 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 560/1130] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:05:31 2022] POST /compute/v2.1/flavors => generated 468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:05:32.002422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cdec2171-96cd-43f2-bcbf-7c0bd7c19378 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-841041754", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5cab0814-9f7c-48da-bf29-6e9e480a8e78", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:32.066610 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cdec2171-96cd-43f2-bcbf-7c0bd7c19378 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Block Device 5cab0814-9f7c-48da-bf29-6e9e480a8e78 is not bootable. Feb 12 21:05:32.067254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cdec2171-96cd-43f2-bcbf-7c0bd7c19378 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Block Device 5cab0814-9f7c-48da-bf29-6e9e480a8e78 is not bootable. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:32.068101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cdec2171-96cd-43f2-bcbf-7c0bd7c19378 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.070735 Feb 12 21:05:32.068703 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 561/1131] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:32.179521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:32.186673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:32.210952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b0b54e6-fb49-4720-9f23-b47bf5e67569 tempest-FlavorsV261TestJSON-709228470 tempest-FlavorsV261TestJSON-709228470-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:32.223726 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b0b54e6-fb49-4720-9f23-b47bf5e67569 tempest-FlavorsV261TestJSON-709228470 tempest-FlavorsV261TestJSON-709228470-project] 10.222.0.31 "GET /compute/v2.1/flavors/1033703300" status: 200 len: 468 microversion: 2.61 time: 0.153980 Feb 12 21:05:32.224279 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 562/1132] 10.222.0.31 () {60 vars in 1198 bytes} [Sat Feb 12 21:05:32 2022] GET /compute/v2.1/flavors/1033703300 => generated 468 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:05:32.230246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:32.233012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:32.239982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:32.240516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:32.241429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:32.241916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:32.415502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:32.437412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-35342d89-7605-419a-b0a6-f4b459b3e37b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.199279 Feb 12 21:05:32.437412 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 563/1133] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:32 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:32.437412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-87e61c33-e3ae-4bf7-826e-2d83a8b172d9 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fe036dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:32.501681 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-87e61c33-e3ae-4bf7-826e-2d83a8b172d9 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1421 microversion: 2.1 time: 0.074379 Feb 12 21:05:32.502396 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 564/1134] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:32 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1421 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:32.506865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea3494d5-9d2c-4878-b464-a1b2f9f64b6f tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] Action: 'update', calling method: .version_select at 0x7fa90543d310>, body: {"flavor": {"description": "new"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:32.516872 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:32.516872 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:32.829022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:32.834317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'server_group_members'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:32.868764 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-402adf55-02a2-4b16-8fd6-88434fec85af tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.860229 Feb 12 21:05:32.869746 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 571/1135] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 1862 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Feb 12 21:05:32.879322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25cec49c-4594-4621-b677-436505aae55c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fec74430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:32.965548 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25cec49c-4594-4621-b677-436505aae55c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1452 microversion: 2.1 time: 0.090232 Feb 12 21:05:32.966131 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 572/1136] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:32 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:32.975506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:32.976112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:32.998685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:32.999035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.003430 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea3494d5-9d2c-4878-b464-a1b2f9f64b6f tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] 10.222.0.31 "PUT /compute/v2.1/flavors/1033703300" status: 200 len: 469 microversion: 2.61 time: 0.497839 Feb 12 21:05:33.004400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.004870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.016141 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 565/1137] 10.222.0.31 () {62 vars in 1218 bytes} [Sat Feb 12 21:05:32 2022] PUT /compute/v2.1/flavors/1033703300 => generated 469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:05:33.025305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.031502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:33.044393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.045878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.047403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.051352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.249748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:33.270563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:33.274640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:33.281042 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68a92dd1-077a-49c4-8ae7-00922f8ce3c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1321 microversion: 2.25 time: 0.263743 Feb 12 21:05:33.294896 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 566/1138] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:33.301754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.307216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:33.319887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:33.320048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.320412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.321213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.321675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.342829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b4987199-4c9b-4bf8-9a5e-6e5773bf0571 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.375624 Feb 12 21:05:33.356296 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 573/1139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:32 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:33.383850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-10a3955a-cd9f-4efe-8047-6de283dd2aee req-111d00a6-e530-4858-9b45-cdc16131cab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3267b0c7-25e2-44b9-afd1-21270d2d53bb", "name": "network-vif-unplugged", "status": "completed", "tag": "31030585-0e0e-44d7-bd66-e3136d668ce8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:33.388213 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:33.388213 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:33.410764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-10a3955a-cd9f-4efe-8047-6de283dd2aee req-111d00a6-e530-4858-9b45-cdc16131cab7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.411362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-10a3955a-cd9f-4efe-8047-6de283dd2aee req-111d00a6-e530-4858-9b45-cdc16131cab7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.434262 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-10a3955a-cd9f-4efe-8047-6de283dd2aee req-111d00a6-e530-4858-9b45-cdc16131cab7 service nova] Creating event network-vif-unplugged:31030585-0e0e-44d7-bd66-e3136d668ce8 for instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb on nch1-master-1 Feb 12 21:05:33.450145 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-10a3955a-cd9f-4efe-8047-6de283dd2aee req-111d00a6-e530-4858-9b45-cdc16131cab7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074219 Feb 12 21:05:33.451444 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 574/1140] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:33.461281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.471856 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:33.471856 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:33.479816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:33.479816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Searching by: {'deleted': False, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:05:33.519668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.520184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.521636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:33.522146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:33.561529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:33.576821 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-af7f0c9d-d610-48b1-a1b1-b70594fd89ab tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.280769 Feb 12 21:05:33.586614 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 567/1141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:33.594220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64569b52-1841-4d26-a5d8-bd41555ab0bb tempest-FlavorsV261TestJSON-709228470 tempest-FlavorsV261TestJSON-709228470-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.643859 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64569b52-1841-4d26-a5d8-bd41555ab0bb tempest-FlavorsV261TestJSON-709228470 tempest-FlavorsV261TestJSON-709228470-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.056035 Feb 12 21:05:33.655871 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 568/1142] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:33.656079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:05:33.659732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18c35d3c-6616-43c5-9b35-5228ab6947f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdfc4b80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.713244 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-18c35d3c-6616-43c5-9b35-5228ab6947f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1421 microversion: 2.1 time: 0.066572 Feb 12 21:05:33.733786 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 569/1143] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:33.738462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ad4d755-9b4d-4baa-8320-9d51885a4227 tempest-FlavorsV261TestJSON-709228470 tempest-FlavorsV261TestJSON-709228470-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.792560 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ad4d755-9b4d-4baa-8320-9d51885a4227 tempest-FlavorsV261TestJSON-709228470 tempest-FlavorsV261TestJSON-709228470-project] 10.222.0.31 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.057553 Feb 12 21:05:33.805306 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 570/1144] 10.222.0.31 () {60 vars in 1165 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:33.819674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-878be686-88ed-4cd2-8f41-088c0b6fdd88 tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.820796 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:33.820796 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:33.857719 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d81ce620-0838-4d65-8cd7-9e9500d21842 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.403480 Feb 12 21:05:33.864128 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 575/1145] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/servers => generated 1662 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:33.868856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc968979-dc64-4142-a422-c8af418607a5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.869620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc968979-dc64-4142-a422-c8af418607a5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:33.923631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-878be686-88ed-4cd2-8f41-088c0b6fdd88 tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1033703300" status: 202 len: 0 microversion: 2.61 time: 0.103122 Feb 12 21:05:33.923631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 571/1146] 10.222.0.31 () {60 vars in 1201 bytes} [Sat Feb 12 21:05:33 2022] DELETE /compute/v2.1/flavors/1033703300 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:05:33.929118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-be57bf37-e0cc-4191-98e0-7552107f8336 tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:33.953841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-be57bf37-e0cc-4191-98e0-7552107f8336 tempest-FlavorsV261TestJSON-1472630228 tempest-FlavorsV261TestJSON-1472630228-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.029019 Feb 12 21:05:33.955025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 572/1147] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:33.978130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28a3de42-d90b-4a0c-832c-5ba21519eac5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdfc45e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:34.018599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc968979-dc64-4142-a422-c8af418607a5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:34.026835 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc968979-dc64-4142-a422-c8af418607a5 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1218 microversion: 2.1 time: 0.161577 Feb 12 21:05:34.031037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 576/1148] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:34.032425 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28a3de42-d90b-4a0c-832c-5ba21519eac5 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1452 microversion: 2.1 time: 0.057752 Feb 12 21:05:34.033873 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 573/1149] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:33 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:34.302050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:34.305266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:34.315036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:34.315495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:34.316317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:34.316992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:34.596229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:34.598293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:34.609955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:34.610853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:34.611853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:34.612619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:34.687796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:34.697330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:34.703216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:34.705453 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4711a614-0474-4fc0-ba33-cfa3d72480d3 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1361 microversion: 2.25 time: 0.407753 Feb 12 21:05:34.707620 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 577/1150] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:34 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:34.736187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a081e9d-fb4d-4a10-a077-b8a6b74189af tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fec3a9d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:34.822716 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a081e9d-fb4d-4a10-a077-b8a6b74189af tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1421 microversion: 2.1 time: 0.092060 Feb 12 21:05:34.823432 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 578/1151] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:34 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:35.048038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-78caa6ab-3cf8-4ece-8ebb-c34b6641e937 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fec3a160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:35.114803 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-78caa6ab-3cf8-4ece-8ebb-c34b6641e937 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1452 microversion: 2.1 time: 0.067170 Feb 12 21:05:35.114803 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 579/1152] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:35 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:35.119275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df4dc5b0-5b3e-4f39-bf25-d79a7de25263 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:35.120087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df4dc5b0-5b3e-4f39-bf25-d79a7de25263 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:35.183313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df4dc5b0-5b3e-4f39-bf25-d79a7de25263 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:35.192075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df4dc5b0-5b3e-4f39-bf25-d79a7de25263 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1218 microversion: 2.1 time: 0.078331 Feb 12 21:05:35.203532 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 580/1153] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:35 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:35.349091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:35.359669 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7514402c-bd8a-4e2e-b43f-87d3b087d307 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.769438 Feb 12 21:05:35.372349 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 574/1154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:34 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:35.533877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7bba5e91-4c22-4ee1-b924-a72fe9ff066f req-9117d497-32f5-445f-a8e2-456520afb043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "name": "network-vif-plugged", "status": "completed", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:35.535370 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:35.535370 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:35.549760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7bba5e91-4c22-4ee1-b924-a72fe9ff066f req-9117d497-32f5-445f-a8e2-456520afb043 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:35.550217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7bba5e91-4c22-4ee1-b924-a72fe9ff066f req-9117d497-32f5-445f-a8e2-456520afb043 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:35.585202 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7bba5e91-4c22-4ee1-b924-a72fe9ff066f req-9117d497-32f5-445f-a8e2-456520afb043 service nova] Creating event network-vif-plugged:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:05:35.602623 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7bba5e91-4c22-4ee1-b924-a72fe9ff066f req-9117d497-32f5-445f-a8e2-456520afb043 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073241 Feb 12 21:05:35.620457 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 581/1155] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:35.725938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:35.726556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:35.752890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:35.753349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:35.754206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:35.754647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:35.839359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbcf2493-c4e2-43a9-bc5f-f0b5e921111c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fec17310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:35.905515 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fbcf2493-c4e2-43a9-bc5f-f0b5e921111c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1421 microversion: 2.1 time: 0.072716 Feb 12 21:05:35.912301 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 582/1156] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:35 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:36.125343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ee67014-f85b-4ee4-b95f-faa1454c658f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fec3a4c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:36.213955 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ee67014-f85b-4ee4-b95f-faa1454c658f tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1452 microversion: 2.1 time: 0.092210 Feb 12 21:05:36.215568 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 583/1157] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:36 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:36.222733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:36.229477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:36.255257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:36.255257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:36.255257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:36.259153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:36.271627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:36.284167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:36.303038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:36.303038 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d25a25b-99fd-451f-b1e9-cfdd9c823067 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1361 microversion: 2.25 time: 0.569491 Feb 12 21:05:36.305594 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 575/1158] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:35 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1361 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:36.376664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:36.377492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:36.412316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:36.412788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:36.413637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:36.414086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:36.475460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:36.494046 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07193ed4-f559-4f3f-b622-f376ae93536a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1214 microversion: 2.1 time: 0.270540 Feb 12 21:05:36.497468 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 584/1159] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:36 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:36.728637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a5baf8b-752f-41c0-b6d3-0582f259c8ed tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1744667659", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "destination_type": "local"}, {"source_type": "volume", "uuid": "9a2bafc2-de43-4f5c-ba5a-eb44751ad189", "destination_type": "invalid"}], "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:36.731856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a5baf8b-752f-41c0-b6d3-0582f259c8ed tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:36.732818 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a5baf8b-752f-41c0-b6d3-0582f259c8ed tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.008641 Feb 12 21:05:36.733835 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 585/1160] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:36 2022] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:36.753249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:36.862085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:36.862085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:36.862085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:36.862085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:36.864378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:37.290989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:37.301266 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6eaa49da-827f-4396-bc0d-4822b75a9cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1540 microversion: 2.1 time: 0.926387 Feb 12 21:05:37.307818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 576/1161] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:36 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1540 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:37.322205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-473934f5-a48a-4716-abc7-5f0e12b3cbe5 req-424dd810-f959-48b7-8be5-2406c539c23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0d6420-a0c3-4a88-9549-864fdefe2378", "tag": "76d6d407-e6c3-4fc4-984f-2f18ac7b3009"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:37.333868 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:37.333868 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:37.345627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-473934f5-a48a-4716-abc7-5f0e12b3cbe5 req-424dd810-f959-48b7-8be5-2406c539c23f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:37.348693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-473934f5-a48a-4716-abc7-5f0e12b3cbe5 req-424dd810-f959-48b7-8be5-2406c539c23f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:37.375787 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-473934f5-a48a-4716-abc7-5f0e12b3cbe5 req-424dd810-f959-48b7-8be5-2406c539c23f service nova] Creating event network-changed:76d6d407-e6c3-4fc4-984f-2f18ac7b3009 for instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 on nch1-master-1 Feb 12 21:05:37.386315 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-473934f5-a48a-4716-abc7-5f0e12b3cbe5 req-424dd810-f959-48b7-8be5-2406c539c23f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073430 Feb 12 21:05:37.391103 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 577/1162] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:37.398618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f8694ca4-8297-429a-a579-98fcda427fb9 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdfe1af0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:37.487587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:37.509236 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2e1700f-7db2-4fd9-bc46-2010b94ed1cb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.769888 Feb 12 21:05:37.525583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 586/1163] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:36 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:37.525583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44feafd0-ede9-44da-a2fe-32fb03b73c06 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fece1430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:51.404669 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f8694ca4-8297-429a-a579-98fcda427fb9 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1430 microversion: 2.1 time: 14.011909 Feb 12 21:05:51.405159 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 578/1164] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:37 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1430 bytes in 14013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:51.419294 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44feafd0-ede9-44da-a2fe-32fb03b73c06 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1452 microversion: 2.1 time: 13.904453 Feb 12 21:05:51.420932 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 587/1165] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:37 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1452 bytes in 13908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:51.424353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:51.425155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:51.425648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:51.426330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:51.436069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.436533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.437343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.437815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.438312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.438773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.439602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.440028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.641178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:51.653349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:51.659027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:51.659027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:51.659027 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81f48d8f-f73f-4238-9e80-6e6d9dcaf9cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1361 microversion: 2.25 time: 0.244653 Feb 12 21:05:51.659346 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 579/1166] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:51 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:51.675107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:51.676126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:51.680985 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddea5e9f-2027-4c97-a53d-6579ccf6e752 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1318 microversion: 2.1 time: 0.258782 Feb 12 21:05:51.692068 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 588/1167] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:51 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:51.697628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-788c4ee9-f0b2-4a77-ace7-7d2f3d2cb996 req-0c25d12b-2227-4f5f-b746-f28c2bc59082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "name": "network-vif-plugged", "status": "completed", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:51.700211 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:51.700211 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:51.701135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.703279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.704362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.706258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.721267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-788c4ee9-f0b2-4a77-ace7-7d2f3d2cb996 req-0c25d12b-2227-4f5f-b746-f28c2bc59082 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.721932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-788c4ee9-f0b2-4a77-ace7-7d2f3d2cb996 req-0c25d12b-2227-4f5f-b746-f28c2bc59082 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.739135 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-788c4ee9-f0b2-4a77-ace7-7d2f3d2cb996 req-0c25d12b-2227-4f5f-b746-f28c2bc59082 service nova] Creating event network-vif-plugged:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:05:51.744857 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-788c4ee9-f0b2-4a77-ace7-7d2f3d2cb996 req-0c25d12b-2227-4f5f-b746-f28c2bc59082 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051462 Feb 12 21:05:51.762239 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 589/1168] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:51.762239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:51.762239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:51.762239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.762239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.764658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.764658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.929464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:51.938423 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b66f3c1-d681-4cf0-adb1-c8e6a513fd2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.279097 Feb 12 21:05:51.939279 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 580/1169] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:51 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:51.943969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-13acad07-dd53-41ed-a9cc-5fc391e68efc req-a794b473-4fac-46a5-a761-6b898a1b1f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c506a05b-2643-47fa-a737-ef76cf15e0e9", "tag": "5bafff40-3831-43c8-81dd-8619fc446d2e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:51.945765 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:51.945765 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:51.954090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-13acad07-dd53-41ed-a9cc-5fc391e68efc req-a794b473-4fac-46a5-a761-6b898a1b1f4a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:51.954757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-13acad07-dd53-41ed-a9cc-5fc391e68efc req-a794b473-4fac-46a5-a761-6b898a1b1f4a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:51.958940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:51.968719 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-13acad07-dd53-41ed-a9cc-5fc391e68efc req-a794b473-4fac-46a5-a761-6b898a1b1f4a service nova] Creating event network-changed:5bafff40-3831-43c8-81dd-8619fc446d2e for instance c506a05b-2643-47fa-a737-ef76cf15e0e9 on nch1-master-1 Feb 12 21:05:51.969934 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a15ac6a6-9d7c-43c4-9b81-2faafa6f2304 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1468 microversion: 2.1 time: 0.222382 Feb 12 21:05:51.970751 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 590/1170] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:51 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:51.974990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-13acad07-dd53-41ed-a9cc-5fc391e68efc req-a794b473-4fac-46a5-a761-6b898a1b1f4a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034565 Feb 12 21:05:51.988744 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 581/1171] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:51.992946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7db33875-e035-4da5-b2d1-f01de3ad0757 req-b7f50177-8512-459a-b3a8-b7dc2cafcace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e01316-e5b8-4cf6-b921-313a90bc4a48", "tag": "343f7369-bd4a-4c45-bac6-12a12a82d733"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:51.994871 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:51.994871 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:52.011901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7db33875-e035-4da5-b2d1-f01de3ad0757 req-b7f50177-8512-459a-b3a8-b7dc2cafcace service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.013195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7db33875-e035-4da5-b2d1-f01de3ad0757 req-b7f50177-8512-459a-b3a8-b7dc2cafcace service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.032040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7db33875-e035-4da5-b2d1-f01de3ad0757 req-b7f50177-8512-459a-b3a8-b7dc2cafcace service nova] Creating event network-changed:343f7369-bd4a-4c45-bac6-12a12a82d733 for instance 99e01316-e5b8-4cf6-b921-313a90bc4a48 on nch2-master-1 Feb 12 21:05:52.040102 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7db33875-e035-4da5-b2d1-f01de3ad0757 req-b7f50177-8512-459a-b3a8-b7dc2cafcace service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063963 Feb 12 21:05:52.041266 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 591/1172] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:52.050968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3f980ecd-b229-43e8-8e1d-8b4ef7644857 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8feaef280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:52.121309 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3f980ecd-b229-43e8-8e1d-8b4ef7644857 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 200 len: 1430 microversion: 2.1 time: 0.077874 Feb 12 21:05:52.122283 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 592/1173] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:52 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 1430 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:52.131772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:52.133489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:52.165140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.167308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.171028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.171618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.188400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Calling method '.version_select at 0x7fa8fdfe1670>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:52.190078 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:52.190078 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:52.192454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.193496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.216746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.225668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.246486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.246939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.247768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.248203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.262088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.265199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.279986 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ab1d57e-34c0-4167-9706-98dd199c24bb tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.300164 Feb 12 21:05:52.281646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 582/1174] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:05:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:52.295293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eaa1904e-1f40-4ccd-a787-0365bf009258 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1173316923", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:52.301573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eaa1904e-1f40-4ccd-a787-0365bf009258 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:52.302703 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eaa1904e-1f40-4ccd-a787-0365bf009258 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.018686 Feb 12 21:05:52.306507 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 583/1175] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:52 2022] POST /compute/v2.1/servers => generated 624 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:52.312255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:05:52.322528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for user 424f5011a4ef40c48465523369eab808 and project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:05:52.330067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:52.330869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:52.338399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.338855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.344223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.344223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.866434 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52900af8-dd03-4689-bf0c-04177ba0ccc3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.740977 Feb 12 21:05:52.868712 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 593/1176] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:05:52 2022] POST /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:05:52.882066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Calling method '.version_select at 0x7fa8fec893a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:52.889840 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:52.889840 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:52.895205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.895205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.909926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.910789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.967502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:52.978199 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-915f41f7-f313-4b99-b219-19758d9009f1 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1467 microversion: 2.1 time: 0.669065 Feb 12 21:05:52.978199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 584/1177] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:52 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1467 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:52.987236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:52.989906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:52.993267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:52.994037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:53.005536 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-28831d36-5437-49c8-89a6-ba7c6b21a23c tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 749 microversion: 2.1 time: 0.135081 Feb 12 21:05:53.007713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.014781 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 594/1178] 10.222.0.31 () {58 vars in 1211 bytes} [Sat Feb 12 21:05:52 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 749 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:53.014966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.014966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.014966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.021885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-916677cd-9dcb-4dd2-ac05-5334db8d6fbe tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8feae0dc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.092017 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-916677cd-9dcb-4dd2-ac05-5334db8d6fbe tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1461 microversion: 2.1 time: 0.080827 Feb 12 21:05:53.094843 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 595/1179] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:53.100544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.101507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:53.111094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.111701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.113231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.113815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.315213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.324407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4af623f2-3e17-4c2e-a6b3-1ada7ffc73df tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.344032 Feb 12 21:05:53.326311 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 585/1180] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:52 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:53.331494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.332284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:53.339013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.341229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.342218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.342762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.362657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.374279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.374883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.376972 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cbaba063-5ba2-44e9-adbd-a3dae83cd24a tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1361 microversion: 2.25 time: 0.282090 Feb 12 21:05:53.378318 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 596/1181] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:53.383940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.384744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:53.393029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.393762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.394753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.395512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.524063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.537531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0495c32-59ee-4466-8b4b-2e331639d293 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1318 microversion: 2.1 time: 0.209911 Feb 12 21:05:53.538117 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 586/1182] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:53.542701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25d816b0-d959-44f1-8629-3eb5e755ce59 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fe024040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.589319 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25d816b0-d959-44f1-8629-3eb5e755ce59 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9" status: 200 len: 784 microversion: 2.1 time: 0.049971 Feb 12 21:05:53.591388 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 587/1183] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9 => generated 784 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:53.595991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Calling method '.version_select at 0x7fa8fdfe1790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.597042 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:53.597042 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:53.598902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.599543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.618027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.618775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.630067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.631689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.638457 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0657068d-874b-4645-995f-c2b30d31aa9a tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045874 Feb 12 21:05:53.639317 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 588/1184] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:53.641777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.644848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-add0ffb6-d687-46ad-98b2-97a98c69adb6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe024c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.654018 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5caefe2e-7fff-4402-8751-12033b859d06 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1467 microversion: 2.1 time: 0.274512 Feb 12 21:05:53.663772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 597/1185] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:53.669224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.670017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:53.678433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.679004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.679901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.680442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.690089 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-add0ffb6-d687-46ad-98b2-97a98c69adb6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 200 len: 1461 microversion: 2.1 time: 0.049492 Feb 12 21:05:53.691310 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 589/1186] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 1461 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:53.708976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-305037e4-5a30-4480-a55f-ca501911a3fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.726534 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-305037e4-5a30-4480-a55f-ca501911a3fe tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027475 Feb 12 21:05:53.727269 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 590/1187] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:53.732937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9a45f551-355e-4922-8691-2a160c5bf360 tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Calling method '.version_select at 0x7fa8fdfc45e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.738730 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:53.738730 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:53.738730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a45f551-355e-4922-8691-2a160c5bf360 tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.738730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a45f551-355e-4922-8691-2a160c5bf360 tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.762872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a45f551-355e-4922-8691-2a160c5bf360 tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.763308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a45f551-355e-4922-8691-2a160c5bf360 tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.771043 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9a45f551-355e-4922-8691-2a160c5bf360 tempest-HypervisorAdminUnderV252Test-647606956 tempest-HypervisorAdminUnderV252Test-647606956-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.041566 Feb 12 21:05:53.779085 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 591/1188] 10.222.0.31 () {58 vars in 1208 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:53.779085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:53.779085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:53.786240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.786701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.787574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:53.788018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:53.961840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:53.971428 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a16cc7c-705e-495c-b561-c8be28766ce7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.306180 Feb 12 21:05:53.972390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 598/1189] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:53.976854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-faba5565-4b38-4409-94d0-e9ccd7735f24 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8feada940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:54.009154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:54.023653 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36eed7f6-cf0b-4c45-9f04-239226566346 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1467 microversion: 2.1 time: 0.248749 Feb 12 21:05:54.024563 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 592/1190] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:53 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1467 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:54.034395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0d6420-a0c3-4a88-9549-864fdefe2378", "name": "network-vif-plugged", "status": "completed", "tag": "76d6d407-e6c3-4fc4-984f-2f18ac7b3009"}, {"server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "name": "network-vif-unplugged", "status": "completed", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}, {"server_uuid": "c506a05b-2643-47fa-a737-ef76cf15e0e9", "name": "network-vif-plugged", "status": "completed", "tag": "5bafff40-3831-43c8-81dd-8619fc446d2e"}, {"server_uuid": "99e01316-e5b8-4cf6-b921-313a90bc4a48", "name": "network-vif-plugged", "status": "completed", "tag": "343f7369-bd4a-4c45-bac6-12a12a82d733"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:54.036912 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:54.036912 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:54.047280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:54.056415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:54.085070 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Creating event network-vif-plugged:76d6d407-e6c3-4fc4-984f-2f18ac7b3009 for instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 on nch1-master-1 Feb 12 21:05:54.085843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Creating event network-vif-unplugged:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:05:54.094478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Creating event network-vif-plugged:5bafff40-3831-43c8-81dd-8619fc446d2e for instance c506a05b-2643-47fa-a737-ef76cf15e0e9 on nch1-master-1 Feb 12 21:05:54.094478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Creating event network-vif-plugged:343f7369-bd4a-4c45-bac6-12a12a82d733 for instance 99e01316-e5b8-4cf6-b921-313a90bc4a48 on nch2-master-1 Feb 12 21:05:54.098162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] Instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:05:54.112282 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d18c5254-66aa-4cc3-bf51-c4cef07db178 req-89ca5f2a-ec11-419e-a0b6-52adb94eeeb2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.086628 Feb 12 21:05:54.113498 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 593/1191] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:54.123447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3cdb64a-fd52-46ac-b7c6-884ca05a60d2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe036d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:54.307000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3cdb64a-fd52-46ac-b7c6-884ca05a60d2 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?changes-since=2022-02-12T21%3A04%3A06Z" status: 200 len: 2375 microversion: 2.1 time: 0.191638 Feb 12 21:05:54.307791 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 594/1192] 10.222.0.31 () {58 vars in 1198 bytes} [Sat Feb 12 21:05:54 2022] GET /compute/v2.1/images?changes-since=2022-02-12T21%3A04%3A06Z => generated 2375 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:54.325049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb680286-63b7-4de7-9daf-71fd6bc5a694 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:54.325049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb680286-63b7-4de7-9daf-71fd6bc5a694 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:54.325296 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb680286-63b7-4de7-9daf-71fd6bc5a694 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006516 Feb 12 21:05:54.325296 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 595/1193] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:54 2022] POST /compute/v2.1/servers => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:54.334088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c310af3-668a-42e8-97a2-1d68febdd57c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa904434b80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:54.469025 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c310af3-668a-42e8-97a2-1d68febdd57c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-598439679" status: 200 len: 484 microversion: 2.1 time: 0.139029 Feb 12 21:05:54.469834 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 596/1194] 10.222.0.31 () {58 vars in 1228 bytes} [Sat Feb 12 21:05:54 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-598439679 => generated 484 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:54.499136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:54.499904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:54.509084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:54.509785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:54.510607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:54.511046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:54.758952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:54.767539 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70559218-7a23-4c29-80c2-3d816e11f86d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.283571 Feb 12 21:05:54.771551 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 597/1195] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:54 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:54.772765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:54.773561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:54.779615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:54.780287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:54.781253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:54.781882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:54.973689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:54.987555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:55.009002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:55.009002 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1755830e-e67e-405f-a739-78ddc3ed4d4c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1361 microversion: 2.25 time: 0.221086 Feb 12 21:05:55.009002 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 598/1196] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:54 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:55.009002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8b62a12a-afe1-46d7-a17b-5313893e9a9b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe10f670>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:55.120309 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8b62a12a-afe1-46d7-a17b-5313893e9a9b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?server=eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 957 microversion: 2.1 time: 0.121558 Feb 12 21:05:55.122396 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 599/1197] 10.222.0.31 () {58 vars in 1208 bytes} [Sat Feb 12 21:05:54 2022] GET /compute/v2.1/images?server=eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 957 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:55.135035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:55.136179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:55.145215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:55.145955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:55.148976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:55.148976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:55.321166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:55.330236 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb870eca-9abc-4a2e-bf72-dee31cf376de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1318 microversion: 2.1 time: 0.206968 Feb 12 21:05:55.330829 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 600/1198] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:55 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:55.335124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:55.335758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:55.343310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:55.343798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:55.345188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:55.345659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:55.508741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:55.518240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e819fb86-e1bc-4c78-aab6-e78e8fcd1084 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1467 microversion: 2.1 time: 0.186242 Feb 12 21:05:55.518837 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 601/1199] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:55 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1467 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:55.523256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:55.523914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:55.532448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:55.532915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:55.533821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:55.534326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:55.722192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:55.732641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-464b2f2f-e21d-43d8-9821-a77f89ef66a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.212669 Feb 12 21:05:55.733634 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 602/1200] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:55 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:55.742091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3965b216-044f-4bc3-8b97-0a18b7bb42c1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdf81940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:55.892033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3965b216-044f-4bc3-8b97-0a18b7bb42c1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fv2.1%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 484 microversion: 2.1 time: 0.156985 Feb 12 21:05:55.893982 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 603/1201] 10.222.0.31 () {58 vars in 1316 bytes} [Sat Feb 12 21:05:55 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fv2.1%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 484 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:55.915469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5b44bb4d-06b3-452a-96c1-70fa91b8f8e7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdff8c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:55.937878 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-faba5565-4b38-4409-94d0-e9ccd7735f24 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "DELETE /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 204 len: 0 microversion: 2.1 time: 1.964234 Feb 12 21:05:55.942421 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 599/1202] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:53 2022] DELETE /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 0 bytes in 1966 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:05:55.948384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ed1cd99-832d-496a-a9f0-a02987219bdc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1682858453", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": -1, "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:55.980463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7ed1cd99-832d-496a-a9f0-a02987219bdc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Flavor -1 could not be found. Feb 12 21:05:55.981696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ed1cd99-832d-496a-a9f0-a02987219bdc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:55.982919 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ed1cd99-832d-496a-a9f0-a02987219bdc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.039227 Feb 12 21:05:55.983485 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 600/1203] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:55 2022] POST /compute/v2.1/servers => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:05:56.005625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dfd67728-9121-452a-afae-4d6ca353453e tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fea65c10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:56.007870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5b44bb4d-06b3-452a-96c1-70fa91b8f8e7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 484 microversion: 2.1 time: 0.106879 Feb 12 21:05:56.008671 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 604/1204] 10.222.0.31 () {58 vars in 1302 bytes} [Sat Feb 12 21:05:55 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 484 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:56.025848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:56.031828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:56.049185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-dfd67728-9121-452a-afae-4d6ca353453e tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] HTTP exception thrown: Image not found. Feb 12 21:05:56.049923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dfd67728-9121-452a-afae-4d6ca353453e tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:56.050773 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dfd67728-9121-452a-afae-4d6ca353453e tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 404 len: 62 microversion: 2.1 time: 0.053524 Feb 12 21:05:56.051722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.052180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.052589 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 601/1205] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:55 2022] GET /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:05:56.059136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:56.064855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.064855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.066922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:56.076706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.077272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.092746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.092746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.324615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:56.337269 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2df1c67b-a68c-48af-be84-2fffec47249d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.327501 Feb 12 21:05:56.342714 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 605/1206] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:56 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:56.356565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7b8bb1c-0140-4f31-acdd-7c3594c712a6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdf818b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:56.430610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:56.442609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:56.444972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:56.446642 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d7f4524-cdd1-429c-a105-0926b336e566 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1361 microversion: 2.25 time: 0.392483 Feb 12 21:05:56.447947 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 602/1207] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:56 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:56.455190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1674733530"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:56.456613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:56.465845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.472626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.472626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.472626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.596874 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7b8bb1c-0140-4f31-acdd-7c3594c712a6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.249696 Feb 12 21:05:56.602994 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 606/1208] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:05:56 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:56.617716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "name": "network-vif-plugged", "status": "completed", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}, {"server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "name": "network-vif-unplugged", "status": "completed", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:56.620043 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:56.620043 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:56.641409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.642242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.658554 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] Creating event network-vif-plugged:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:05:56.659076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] Creating event network-vif-unplugged:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:05:56.669080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] Instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:05:56.687035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-697ea83e-49b7-4212-a41d-a6ff4376656a req-55673d0b-4da2-42f9-90fd-45f04fb26daa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.082356 Feb 12 21:05:56.689160 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 607/1209] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:56.701812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:56.701812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:56.711624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.712001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.713004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.716645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.884311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:56.892620 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-26f2caa2-4c5f-4d61-98f0-dd2dca4c4f0e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1467 microversion: 2.1 time: 0.201094 Feb 12 21:05:56.893230 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 608/1210] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:56 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1467 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:56.901698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:56.903400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:56.909668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.910210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:56.911007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:56.911912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.047748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.056616 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-528d657b-c435-4351-b86a-4aa4dbc76ee7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.162338 Feb 12 21:05:57.057327 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 609/1211] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:56 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:57.062734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:57.063346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:57.072138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.072820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.074570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.075735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.233859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.241400 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c3db090-f2b2-4878-a11c-00ea0ff8a501 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1467 microversion: 2.1 time: 0.182952 Feb 12 21:05:57.250604 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 610/1212] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:57 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:57.250604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2a78e85-4e84-479d-b6b7-08ee815d556b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdfea1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:57.337730 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2a78e85-4e84-479d-b6b7-08ee815d556b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.094424 Feb 12 21:05:57.338389 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 611/1213] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:05:57 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:57.344329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:57.345555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:57.352353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.352878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.353724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.354161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.491846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.499959 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80a2db20-4fd0-49e7-b848-9ca9a3df0ee4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48" status: 200 len: 1467 microversion: 2.1 time: 0.160574 Feb 12 21:05:57.500522 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 612/1214] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:57 2022] GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48 => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:57.505392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cfeee2e4-9ec4-4fe7-8e0a-a4887623380f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2122403610", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:57.506728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cfeee2e4-9ec4-4fe7-8e0a-a4887623380f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:57.507501 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cfeee2e4-9ec4-4fe7-8e0a-a4887623380f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.006090 Feb 12 21:05:57.507991 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 613/1215] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:57 2022] POST /compute/v2.1/servers => generated 145 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:57.513371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96afc465-458d-4f47-96d6-e45c49aabf9c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fe161550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:57.585748 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96afc465-458d-4f47-96d6-e45c49aabf9c tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.076607 Feb 12 21:05:57.586313 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 614/1216] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:05:57 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:57.592151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:57.592151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:57.598096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.598544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.599510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.600068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.744332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.756176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.757713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.758866 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c4e2102-2a4c-44c3-92a9-ac04b144ac15 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1558 microversion: 2.25 time: 0.171655 Feb 12 21:05:57.759442 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 615/1217] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:57 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:57.764547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:57.768200 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:57.768200 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:57.769644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.770597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Searching by: {'reservation_id': 'r-ynuzstw0', 'deleted': False, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:05:57.776147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.776589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.777621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.778056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:57.872097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:05:57.941679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:57.949296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:57.949791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.085225 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ad5598d-506a-41fc-b5f4-398760fd87d9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/detail?reservation_id=r-ynuzstw0" status: 200 len: 2927 microversion: 2.1 time: 0.324554 Feb 12 21:05:58.085875 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 616/1218] 10.222.0.31 () {58 vars in 1196 bytes} [Sat Feb 12 21:05:57 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ynuzstw0 => generated 2927 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:58.090516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.091224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:58.097876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.098323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.099116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.099555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.236995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:58.244465 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-695ac677-e416-41a5-a38b-c37f3c91de70 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.157606 Feb 12 21:05:58.244981 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 617/1219] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:58.249272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc353b7b-d979-4c70-9cdf-1190b266f815 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdff83a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.327393 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc353b7b-d979-4c70-9cdf-1190b266f815 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?changes-since=2022-02-12T21%3A04%3A01Z" status: 200 len: 6327 microversion: 2.1 time: 0.081347 Feb 12 21:05:58.328111 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 618/1220] 10.222.0.31 () {58 vars in 1219 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/images/detail?changes-since=2022-02-12T21%3A04%3A01Z => generated 6327 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:58.332716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.333318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:58.340227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.340759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.341569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.342006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.523185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:05:58.539020 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-229bf355-015b-4f0e-a6a2-27a3ebac49c2 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 2050 microversion: 2.25 time: 0.210027 Feb 12 21:05:58.539744 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 619/1221] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 2050 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:05:58.543972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-24fd98d3-67d9-4af5-b895-aba988287f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.560166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.server_groups [None req-24fd98d3-67d9-4af5-b895-aba988287f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Querying cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) for 2 instances {{(pid=141726) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 12 21:05:58.564047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24fd98d3-67d9-4af5-b895-aba988287f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.564047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24fd98d3-67d9-4af5-b895-aba988287f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.594907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-24fd98d3-67d9-4af5-b895-aba988287f6a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups/da7a162c-2879-4f24-bb04-7051dc36b643" status: 200 len: 271 microversion: 2.1 time: 0.054231 Feb 12 21:05:58.596601 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 620/1222] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/os-server-groups/da7a162c-2879-4f24-bb04-7051dc36b643 => generated 271 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:58.601072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.601733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:58.608053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.610082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.610082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.610082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.637979 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f9192c77-07c6-4aaa-b7ad-16b97646878f tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "POST /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99/action" status: 202 len: 0 microversion: 2.1 time: 2.187719 Feb 12 21:05:58.638686 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 603/1223] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:05:56 2022] POST /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99/action => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:05:58.645274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.646019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:58.653838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.654294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.655107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.655543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.753522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:58.765738 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-24e7b7e5-4084-42bb-a275-c6363e7f44f1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1467 microversion: 2.1 time: 0.167067 Feb 12 21:05:58.766691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 621/1224] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1467 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:58.780266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9fa1d541-b189-460a-ad46-41720e2afe3b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdff93a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.837764 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9fa1d541-b189-460a-ad46-41720e2afe3b tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-598439679" status: 200 len: 664 microversion: 2.1 time: 0.069633 Feb 12 21:05:58.838429 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 622/1225] 10.222.0.31 () {58 vars in 1249 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-598439679 => generated 664 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:58.844871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0939b834-ee61-4231-9d6d-6949bdb58644 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.847718 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:58.847718 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:05:58.848992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0939b834-ee61-4231-9d6d-6949bdb58644 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.849538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0939b834-ee61-4231-9d6d-6949bdb58644 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.850558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0939b834-ee61-4231-9d6d-6949bdb58644 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.851205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0939b834-ee61-4231-9d6d-6949bdb58644 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.874042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:58.878370 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0939b834-ee61-4231-9d6d-6949bdb58644 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038481 Feb 12 21:05:58.879019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 623/1226] 10.222.0.31 () {60 vars in 1216 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:05:58.892425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:58.892425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:58.895276 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7595cfbd-710a-4466-a5cb-8bcdc5f83551 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.255199 Feb 12 21:05:58.895910 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 604/1227] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:58.900808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.901329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.902916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:58.903513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:58.916311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36bb6673-002c-4c31-b56c-2bff42bf0585 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8feaef1f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.009347 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36bb6673-002c-4c31-b56c-2bff42bf0585 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.093331 Feb 12 21:05:59.011218 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 605/1228] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.018585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-460a34b1-54ec-4dfe-ab36-32213bf19c37 req-738b7266-164e-4ba9-b811-f5b34dbc10db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "name": "network-vif-unplugged", "status": "completed", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:59.020809 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:05:59.020809 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:05:59.031715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-460a34b1-54ec-4dfe-ab36-32213bf19c37 req-738b7266-164e-4ba9-b811-f5b34dbc10db service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.032620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-460a34b1-54ec-4dfe-ab36-32213bf19c37 req-738b7266-164e-4ba9-b811-f5b34dbc10db service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.056909 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-460a34b1-54ec-4dfe-ab36-32213bf19c37 req-738b7266-164e-4ba9-b811-f5b34dbc10db service nova] Creating event network-vif-unplugged:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:05:59.072537 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-460a34b1-54ec-4dfe-ab36-32213bf19c37 req-738b7266-164e-4ba9-b811-f5b34dbc10db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052795 Feb 12 21:05:59.072537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 606/1229] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:59.078164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-836ebe2c-114e-4737-8cba-f1ba6f6bb888 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fea67820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.142459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-836ebe2c-114e-4737-8cba-f1ba6f6bb888 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fv2.1%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1464 microversion: 2.1 time: 0.072668 Feb 12 21:05:59.143407 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 607/1230] 10.222.0.31 () {58 vars in 1337 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fv2.1%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.157164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4774b7c-1889-4da0-8844-1c5e530d3ca3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8feaefb80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.212502 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef8845ae-5cea-481c-bd5f-546ff9580198 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 200 len: 1618 microversion: 2.1 time: 0.332482 Feb 12 21:05:59.213804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 624/1231] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:58 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 1618 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.228044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60478c04-5880-4319-b5b8-14df922a4718 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-975384531", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:59.238994 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-60478c04-5880-4319-b5b8-14df922a4718 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Feb 12 21:05:59.241958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60478c04-5880-4319-b5b8-14df922a4718 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:05:59.244218 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60478c04-5880-4319-b5b8-14df922a4718 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028282 Feb 12 21:05:59.246353 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 625/1232] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:59 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:05:59.251803 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4774b7c-1889-4da0-8844-1c5e530d3ca3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1464 microversion: 2.1 time: 0.095609 Feb 12 21:05:59.251803 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 608/1233] 10.222.0.31 () {58 vars in 1323 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.31%2Fcompute%2Fservers%2F3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1464 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.263216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.263809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.264113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:59.264568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:59.272704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.274580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.274724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.274837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.274939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.274939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.275187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.275707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.521166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:59.522297 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-008eb367-6002-496f-a420-02e2a64711a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.268300 Feb 12 21:05:59.522297 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 609/1234] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.527270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b85fc77-ba60-4a00-affc-ade634741073 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8feada430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.534813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7b950abd-bd38-4e81-84be-e78cc6c2a93d tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48" status: 200 len: 1618 microversion: 2.1 time: 0.284016 Feb 12 21:05:59.535879 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 626/1235] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48 => generated 1618 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.539725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.544150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:59.549615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.550277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.551469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:05:59.552079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:05:59.659095 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b85fc77-ba60-4a00-affc-ade634741073 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.135741 Feb 12 21:05:59.660319 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 610/1236] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.680625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-51db0b96-dc79-4a90-b5e8-daac02ad6300 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8feaf3af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.764617 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-51db0b96-dc79-4a90-b5e8-daac02ad6300 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.088790 Feb 12 21:05:59.765089 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 611/1237] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:05:59.770636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-338921587", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "579b174f-d572-49b2-8f60-9e0d62cc450e"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:05:59.821547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:05:59.854362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:05:59.865762 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b75d103f-950c-468f-a14d-eaa916eefe73 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.329216 Feb 12 21:05:59.875610 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 627/1238] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:05:59.886612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b661fba2-5f1c-4436-9e79-82e81bcf96a3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdfb4af0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.967522 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b661fba2-5f1c-4436-9e79-82e81bcf96a3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9" status: 200 len: 784 microversion: 2.1 time: 0.089862 Feb 12 21:05:59.968197 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 628/1239] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9 => generated 784 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:05:59.978837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:05:59.983416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:05:59.999272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:00.000260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:00.005591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:00.007708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:00.179515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:00.180106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:00.180599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:00.181121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:00.181676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:00.192913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:00.193684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:00.195721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:00.196269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:00.219360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:00.225320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:00.242113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:00.249525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:00.352009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:00.367720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fe94613-3e16-42f3-bc6b-05c9c1d9d2ec tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1533 microversion: 2.1 time: 0.396475 Feb 12 21:06:00.367720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 629/1240] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:05:59 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1533 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:00.372223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a496917-9ec6-4e8a-88bb-892321dcc5a6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdea0f70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:00.421847 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56527a1c-5166-41d8-ab76-fca14bc43c0d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654493 Feb 12 21:06:00.442305 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 612/1241] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:00.444240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a496917-9ec6-4e8a-88bb-892321dcc5a6 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.076088 Feb 12 21:06:00.448410 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 630/1242] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:06:00 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:00.453698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c9a42c85-e248-46b4-9566-9923a180c536 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8feaf3f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:00.457960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6738b723-3f5a-4d3f-b42b-b84b914d46cc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-913873240", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "key_name": "tempest-key-1172757974", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:00.538633 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c9a42c85-e248-46b4-9566-9923a180c536 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.094415 Feb 12 21:06:00.539538 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 613/1243] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:00 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:00.544651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31fc8534-cedb-4a76-8965-e1d6dbcf835c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:00.545297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31fc8534-cedb-4a76-8965-e1d6dbcf835c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:00.554904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-6738b723-3f5a-4d3f-b42b-b84b914d46cc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] validate_networks() for [('b37f44d3-46f5-4895-8fa7-7d479d4b0ff2', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:00.671092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31fc8534-cedb-4a76-8965-e1d6dbcf835c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:00.680260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31fc8534-cedb-4a76-8965-e1d6dbcf835c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1216 microversion: 2.1 time: 0.139644 Feb 12 21:06:00.689807 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 614/1244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:00 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:00.694944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf83166c-7453-4a71-b6ce-639f9c300315 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fea67f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:00.794962 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-6738b723-3f5a-4d3f-b42b-b84b914d46cc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Invalid key_name provided. Feb 12 21:06:00.806196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6738b723-3f5a-4d3f-b42b-b84b914d46cc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid key_name provided. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:00.807618 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6738b723-3f5a-4d3f-b42b-b84b914d46cc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.356918 Feb 12 21:06:00.811616 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 631/1245] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:00 2022] POST /compute/v2.1/servers => generated 70 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:06:00.826772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:00.829842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:00.837021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:00.841729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:00.841729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:00.841729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:00.997509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:01.009832 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ede9f8e3-7a94-44fa-ace7-36dd600ae719 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.193578 Feb 12 21:06:01.010866 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 632/1246] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:00 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:01.029785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:01.030690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:01.037037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.037541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.038352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.038882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.213218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:01.213218 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97ae1014-0d81-4f26-b50d-22b65790db87 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.187083 Feb 12 21:06:01.213218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 633/1247] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:01 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:01.223701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6e859626-1a12-424a-b271-ceb5611c0a6a req-49ee3703-e10f-4a39-8c74-d46513c8c577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "name": "network-vif-unplugged", "status": "completed", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:01.225466 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:01.225466 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:01.234441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e859626-1a12-424a-b271-ceb5611c0a6a req-49ee3703-e10f-4a39-8c74-d46513c8c577 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.234936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e859626-1a12-424a-b271-ceb5611c0a6a req-49ee3703-e10f-4a39-8c74-d46513c8c577 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.248812 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6e859626-1a12-424a-b271-ceb5611c0a6a req-49ee3703-e10f-4a39-8c74-d46513c8c577 service nova] Creating event network-vif-unplugged:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:06:01.255062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-6e859626-1a12-424a-b271-ceb5611c0a6a req-49ee3703-e10f-4a39-8c74-d46513c8c577 service nova] Instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:06:01.262676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6e859626-1a12-424a-b271-ceb5611c0a6a req-49ee3703-e10f-4a39-8c74-d46513c8c577 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048919 Feb 12 21:06:01.266748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 634/1248] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:01.327466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c921dc82-aa6c-49a0-b065-853bcc9ff1ea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-103549966", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:01.415003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-c921dc82-aa6c-49a0-b065-853bcc9ff1ea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Neutron security group does_not_exist not found {{(pid=141726) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Feb 12 21:06:01.415658 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c921dc82-aa6c-49a0-b065-853bcc9ff1ea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Feb 12 21:06:01.416221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c921dc82-aa6c-49a0-b065-853bcc9ff1ea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:01.417050 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c921dc82-aa6c-49a0-b065-853bcc9ff1ea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.094319 Feb 12 21:06:01.418237 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 635/1249] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:01 2022] POST /compute/v2.1/servers => generated 106 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:06:01.422960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:01.423691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:01.429934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.430387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.431197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.431634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.577923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:01.586317 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7df2345-b740-4b1d-a6f1-ac1c42d121dc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1533 microversion: 2.1 time: 0.167032 Feb 12 21:06:01.586884 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 636/1250] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:01 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1533 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:01.704379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-236348936", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:01.752182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:01.946830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:01.947254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:01.947901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:01.948761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:01.949936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:01.959153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.959602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.960429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:01.960996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:01.980023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Getting quotas for project 799d7a4057974c53bec70a307fe068ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:01.985373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Getting quotas for user 2a3d067a7f5e4cd492d1e2af08520249 and project 799d7a4057974c53bec70a307fe068ad. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:01.998824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:02.001172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:02.185477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-313fc06c-dc75-4032-92e0-b79ca3c7532d tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597519 Feb 12 21:06:02.186161 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 637/1251] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:02.190507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:02.191378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:02.197472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:02.197929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:02.199368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:02.199818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:02.276322 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf83166c-7453-4a71-b6ce-639f9c300315 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f" status: 204 len: 0 microversion: 2.1 time: 1.580534 Feb 12 21:06:02.276322 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 615/1252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:00 2022] DELETE /compute/v2.1/images/4e60a3a7-496e-4e47-8460-1e3227e3968f => generated 0 bytes in 1582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:02.277115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-67276589-93e2-4451-9319-6077c5011037 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fea67280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:02.329868 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-67276589-93e2-4451-9319-6077c5011037 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.056511 Feb 12 21:06:02.335565 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 616/1253] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:02 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:02.336253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:02.336960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:02.343684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:02.344707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:02.345763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:02.346393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:02.402024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:02.410865 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf7ea48a-0aad-4be5-b0aa-7adef91d7f2f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.223679 Feb 12 21:06:02.411538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 638/1254] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:02 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:02.417261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7de8dc2a-bf78-418c-82bc-d35320770acc", "device": "/dev/xvdb"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:02.419886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:02.426303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:02.426957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:02.427835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:02.428275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:02.452447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:02.461983 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f66e824d-90cc-42bd-8ef8-e1766c08069d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1268 microversion: 2.1 time: 0.129976 Feb 12 21:06:02.463299 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 617/1255] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:02 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:02.470054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31321dc6-dc51-4034-be36-8ffb4366e4fd tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:02.470900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31321dc6-dc51-4034-be36-8ffb4366e4fd tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:02.539999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31321dc6-dc51-4034-be36-8ffb4366e4fd tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:02.548818 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31321dc6-dc51-4034-be36-8ffb4366e4fd tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1222 microversion: 2.1 time: 0.084116 Feb 12 21:06:02.549558 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 618/1256] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:02 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:02.556099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89472e9e-f4bd-4a42-872e-5124f06084b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fea67a60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:05.588419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5acebecb-cc3e-4005-bfc5-bcf3d23c33ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "POST /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 3.175577 Feb 12 21:06:05.589127 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 639/1257] 10.222.0.31 () {62 vars in 1363 bytes} [Sat Feb 12 21:06:02 2022] POST /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments => generated 194 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:06:05.609077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:05.611749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:05.618666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:05.619190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:05.624105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:05.624105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:05.946517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:05.967283 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27a338da-eb24-486b-b122-a1acf1ac7cea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.363781 Feb 12 21:06:05.967775 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 640/1258] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:05 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:06.004943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.005949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:06.016781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.017959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.021218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.021907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.233312 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89472e9e-f4bd-4a42-872e-5124f06084b0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb" status: 204 len: 0 microversion: 2.1 time: 3.682432 Feb 12 21:06:06.235244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 619/1259] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:02 2022] DELETE /compute/v2.1/images/5b41ed88-6ba1-44b4-8771-d4dde76adacb => generated 0 bytes in 3685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:06.243372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ada9a68-ba52-400d-8890-969ee25d6d4a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fea673a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.305494 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ada9a68-ba52-400d-8890-969ee25d6d4a tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.068654 Feb 12 21:06:06.307353 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 620/1260] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:06 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:06.313110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.327765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:06.327890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:06.332515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.332981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.333664 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6a0e8e4-a903-4e73-84a7-6777ed129874 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1526 microversion: 2.1 time: 0.364143 Feb 12 21:06:06.333817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.334240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.334361 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 641/1261] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:05 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1526 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:06.350127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.355843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:06.363189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.368152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.369284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.369957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.491608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:06.505499 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-396bb615-92f5-48c4-bb5b-9c33fe52a2f2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1226 microversion: 2.1 time: 0.170049 Feb 12 21:06:06.506401 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 642/1262] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:06 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:06.515512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec049ee2-3dea-45cd-8b38-d100532ba1f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.517975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec049ee2-3dea-45cd-8b38-d100532ba1f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: f623d90c-8f70-4a9a-8135-172c6efd3da0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:06.531820 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ec049ee2-3dea-45cd-8b38-d100532ba1f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance f623d90c-8f70-4a9a-8135-172c6efd3da0 could not be found. Feb 12 21:06:06.532429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec049ee2-3dea-45cd-8b38-d100532ba1f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance f623d90c-8f70-4a9a-8135-172c6efd3da0 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:06.534341 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec049ee2-3dea-45cd-8b38-d100532ba1f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f623d90c-8f70-4a9a-8135-172c6efd3da0" status: 404 len: 111 microversion: 2.1 time: 0.026829 Feb 12 21:06:06.535829 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 643/1263] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:06:06 2022] DELETE /compute/v2.1/servers/f623d90c-8f70-4a9a-8135-172c6efd3da0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:06.567547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b170b175-4069-4eaa-8f51-451a872d6a8a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdeb4550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.646935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:06.667128 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aea007f0-f9cf-4e73-81b2-d446c5f9fddd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.354641 Feb 12 21:06:06.667963 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 621/1264] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:06 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:06.681566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:06.683396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:06.700786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.753986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:06.753986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:06.753986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:07.096444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:07.107862 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c66a1816-8ca5-4937-b930-c3fa9a9f7ef1 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1526 microversion: 2.1 time: 0.433057 Feb 12 21:06:07.120328 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 622/1265] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:06 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1526 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:07.126171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:07.129976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:07.138628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:07.138628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:07.138628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:07.139060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:07.562618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:07.572801 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d6df32c-ba84-4936-96fe-bdfac12822f7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.450816 Feb 12 21:06:07.573404 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 623/1266] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:07 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:07.602969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b60efd0-3cc9-48be-8c9b-88f74a68469b tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:07.604318 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:07.604318 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:07.618264 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8b60efd0-3cc9-48be-8c9b-88f74a68469b tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] HTTP exception thrown: Flavor edf5ec40-0389-4b3f-b769-d647ab34aefe could not be found. Feb 12 21:06:07.619146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b60efd0-3cc9-48be-8c9b-88f74a68469b tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Returning 404 to user: Flavor edf5ec40-0389-4b3f-b769-d647ab34aefe could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:07.620777 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b60efd0-3cc9-48be-8c9b-88f74a68469b tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/edf5ec40-0389-4b3f-b769-d647ab34aefe" status: 404 len: 109 microversion: 2.1 time: 0.040370 Feb 12 21:06:07.624546 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 624/1267] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:06:07 2022] DELETE /compute/v2.1/flavors/edf5ec40-0389-4b3f-b769-d647ab34aefe => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:07.660111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4b9676ad-157b-47e3-96e2-ae5088f6f6fb tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8feaf8160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:08.785158 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b170b175-4069-4eaa-8f51-451a872d6a8a tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c" status: 204 len: 0 microversion: 2.1 time: 2.243167 Feb 12 21:06:08.789926 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 644/1268] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:06 2022] DELETE /compute/v2.1/images/9a7031dd-8c1e-4ced-8334-fb1233bddf3c => generated 0 bytes in 2247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:08.803054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c702c9bb-0529-4093-97e7-da55d5583bcf req-27cd20da-932d-4ae3-82b4-132b38914d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "name": "network-vif-plugged", "status": "completed", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:08.810817 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:08.810817 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:08.825736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c702c9bb-0529-4093-97e7-da55d5583bcf req-27cd20da-932d-4ae3-82b4-132b38914d72 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:08.827148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c702c9bb-0529-4093-97e7-da55d5583bcf req-27cd20da-932d-4ae3-82b4-132b38914d72 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:08.856654 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c702c9bb-0529-4093-97e7-da55d5583bcf req-27cd20da-932d-4ae3-82b4-132b38914d72 service nova] Creating event network-vif-plugged:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:06:08.864247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c702c9bb-0529-4093-97e7-da55d5583bcf req-27cd20da-932d-4ae3-82b4-132b38914d72 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071660 Feb 12 21:06:08.865950 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 645/1269] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:08.873643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:08.874618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:08.880758 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4b9676ad-157b-47e3-96e2-ae5088f6f6fb tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 1.237975 Feb 12 21:06:08.883199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:08.883884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:08.884886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:08.885554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:08.889276 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 625/1270] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:07 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:08.908448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:08.910085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:08.927236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:08.928205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:08.931679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:08.932553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.098997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:09.108803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:09.119038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-90c7bdcd-8bfb-4cb0-b531-341ee9a3b20f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.225493 Feb 12 21:06:09.131174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 626/1271] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:08 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:09.131406 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-29652154-74a4-4b0d-80ec-ec2bc8f4f8b9 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1280 microversion: 2.1 time: 0.256343 Feb 12 21:06:09.131513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:09.131513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:09.139784 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 646/1272] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:08 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1280 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:09.140607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.141328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.143038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.144081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.152010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1860997465", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:09.216242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:09.368322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:09.384302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e769a47-68e9-41ca-8c56-20818548a0de tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.259217 Feb 12 21:06:09.384956 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 627/1273] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:09 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:09.406688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a3aa371e-bdf4-46ad-af21-4db437f0bd37 req-8d96d734-a811-4ce9-9759-47b5417f3dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f87ab1-85fb-49c2-9720-20ce04a1c7b1", "tag": "2cde5d15-d636-49b0-9a4a-067de06e9f91"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:09.408070 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:09.408070 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:09.417079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a3aa371e-bdf4-46ad-af21-4db437f0bd37 req-8d96d734-a811-4ce9-9759-47b5417f3dc8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.417612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a3aa371e-bdf4-46ad-af21-4db437f0bd37 req-8d96d734-a811-4ce9-9759-47b5417f3dc8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.432977 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a3aa371e-bdf4-46ad-af21-4db437f0bd37 req-8d96d734-a811-4ce9-9759-47b5417f3dc8 service nova] Creating event network-changed:2cde5d15-d636-49b0-9a4a-067de06e9f91 for instance 60f87ab1-85fb-49c2-9720-20ce04a1c7b1 on nch1-master-1 Feb 12 21:06:09.439346 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a3aa371e-bdf4-46ad-af21-4db437f0bd37 req-8d96d734-a811-4ce9-9759-47b5417f3dc8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051895 Feb 12 21:06:09.440493 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 628/1274] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:09.445706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:09.446648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:09.453991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.457072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.457072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.457072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.489095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:06:09.883775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6c3a4e4-580e-4664-87de-5deb0aad4438 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 204 len: 0 microversion: 2.1 time: 0.441660 Feb 12 21:06:09.884774 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 629/1275] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:06:09 2022] DELETE /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:09.893953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a5ed036-63f4-4c92-a611-bf98912510a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:09.903595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a5ed036-63f4-4c92-a611-bf98912510a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Failed to fetch instance by id 9223372036854775808 {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:06:09.903595 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9a5ed036-63f4-4c92-a611-bf98912510a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Feb 12 21:06:09.904263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a5ed036-63f4-4c92-a611-bf98912510a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:09.910459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a5ed036-63f4-4c92-a611-bf98912510a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024113 Feb 12 21:06:09.911690 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 630/1276] 10.222.0.31 () {58 vars in 1187 bytes} [Sat Feb 12 21:06:09 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:06:09.916048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:09.933029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:09.942027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.953982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:09.954970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:09.955490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.100984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:10.102420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:10.103119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:10.103790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:10.104533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:10.118685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.119549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.123484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.124125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.146555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:10.154127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Getting quotas for user 424f5011a4ef40c48465523369eab808 and project 55f8176a19e946ee8eecaa5d963d908c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:10.174174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:10.176690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:10.220995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:10.233727 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-22350d43-7156-44d3-9f9a-f643e5c25460 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1472 microversion: 2.1 time: 0.321023 Feb 12 21:06:10.235233 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 631/1277] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:09 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:10.242519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e8c588a4-d176-4795-b983-054d31dae75d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fea7c4c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:10.303052 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e8c588a4-d176-4795-b983-054d31dae75d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.066529 Feb 12 21:06:10.304031 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 632/1278] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:10 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:10.308715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:10.310059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:10.316554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.317018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.317938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.318476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.354736 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d4559e41-e481-4a59-bbc8-d775e8cba860 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213346 Feb 12 21:06:10.360721 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 647/1279] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:10.368591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:10.369557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:10.381345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.382179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.383402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.384844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.554634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:10.566474 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-48e190d2-d9a5-400a-acb2-6a662e6142fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.260128 Feb 12 21:06:10.567417 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 633/1280] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:10 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:10.581878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e167eb5-1786-4973-b5a2-b04ceb2aabc4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:10.582807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e167eb5-1786-4973-b5a2-b04ceb2aabc4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:10.665419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e167eb5-1786-4973-b5a2-b04ceb2aabc4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:10.678865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e167eb5-1786-4973-b5a2-b04ceb2aabc4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1213 microversion: 2.1 time: 0.109790 Feb 12 21:06:10.679925 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 634/1281] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:10 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:10.685638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:10.686373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:10.694539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.694995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.697838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.698736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.712683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:10.722257 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-819722d2-da56-4ca3-a5b4-9aec2612ab00 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.360225 Feb 12 21:06:10.723668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 648/1282] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:10 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:10.737425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:10.739984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:10.752412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.753474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.758053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.758758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.864959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:10.874233 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f8fbdd7a-e599-42a5-92f5-c4cbd1c7df63 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.192886 Feb 12 21:06:10.875008 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 635/1283] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:10 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:10.896900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2e3667d3-686d-4947-bdb8-38e27bc8a7b5 req-7ae176b7-35c3-4071-a293-907ff778304d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "name": "network-vif-plugged", "status": "completed", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:10.899234 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:10.899234 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:10.922613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2e3667d3-686d-4947-bdb8-38e27bc8a7b5 req-7ae176b7-35c3-4071-a293-907ff778304d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:10.927423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2e3667d3-686d-4947-bdb8-38e27bc8a7b5 req-7ae176b7-35c3-4071-a293-907ff778304d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:10.945231 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2e3667d3-686d-4947-bdb8-38e27bc8a7b5 req-7ae176b7-35c3-4071-a293-907ff778304d service nova] Creating event network-vif-plugged:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:06:10.958054 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2e3667d3-686d-4947-bdb8-38e27bc8a7b5 req-7ae176b7-35c3-4071-a293-907ff778304d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064677 Feb 12 21:06:10.959009 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 636/1284] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:06:11.126758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:11.135793 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc7ed904-ef48-4299-89c4-1361b49b995f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.410793 Feb 12 21:06:11.138027 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 649/1285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:10 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:11.156523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86f8e513-e276-4e90-8de8-99586308f8b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.157703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-86f8e513-e276-4e90-8de8-99586308f8b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Failed to fetch instance by id -1 {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:06:11.158608 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-86f8e513-e276-4e90-8de8-99586308f8b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance -1 could not be found. Feb 12 21:06:11.159369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86f8e513-e276-4e90-8de8-99586308f8b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance -1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:11.160463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-86f8e513-e276-4e90-8de8-99586308f8b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009053 Feb 12 21:06:11.162936 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 637/1286] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:06:11 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:06:11.171503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.172213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:11.179246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.180627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.181709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.182357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.252594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.253706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:11.266961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.267412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.268293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.268735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.499032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:11.513543 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49aa5ee9-f4f4-43f4-a8f7-a3952f9c33bf tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1472 microversion: 2.1 time: 0.264738 Feb 12 21:06:11.517806 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 638/1287] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:11 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:11.525672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:11.538312 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a15822d6-25c7-47ca-a174-2d1ba39cb824 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.371226 Feb 12 21:06:11.553498 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 650/1288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:11 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:11.553678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-339cafdb-6dca-4497-b6fd-9b0368741177 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fea67a60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.579144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.579770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:11.592875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.593800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.594913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.596165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.624407 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-339cafdb-6dca-4497-b6fd-9b0368741177 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.108441 Feb 12 21:06:11.626367 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 639/1289] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:11 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:11.697855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ed4d5f1-4e76-44ef-94bf-923afd9798c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.698768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6ed4d5f1-4e76-44ef-94bf-923afd9798c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:11.807236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6ed4d5f1-4e76-44ef-94bf-923afd9798c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:11.829876 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6ed4d5f1-4e76-44ef-94bf-923afd9798c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1213 microversion: 2.1 time: 0.135503 Feb 12 21:06:11.844748 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 640/1290] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:11 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:11.849791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:11.850661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:11.860870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.861699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:11.862721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:11.863360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.068533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:12.080241 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-915022d7-db8b-4294-acc7-338b245e1111 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.233244 Feb 12 21:06:12.089913 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 641/1291] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:11 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:12.089913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:12.089913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:12.092200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:12.101852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.102403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.102792 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1c334b9-31ec-4719-92d1-e4373bf74f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.532560 Feb 12 21:06:12.103538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.104477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.114708 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 651/1292] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:11 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:12.119808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a6d3910-fca0-4939-aa53-0719dff0f440 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:12.129126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a6d3910-fca0-4939-aa53-0719dff0f440 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: f51aea97-e8cb-4dc2-9bdb-00584ca86ccf] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:12.148058 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-5a6d3910-fca0-4939-aa53-0719dff0f440 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance f51aea97-e8cb-4dc2-9bdb-00584ca86ccf could not be found. Feb 12 21:06:12.149075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a6d3910-fca0-4939-aa53-0719dff0f440 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance f51aea97-e8cb-4dc2-9bdb-00584ca86ccf could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:12.150345 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a6d3910-fca0-4939-aa53-0719dff0f440 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/f51aea97-e8cb-4dc2-9bdb-00584ca86ccf/action" status: 404 len: 111 microversion: 2.1 time: 0.034128 Feb 12 21:06:12.156621 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 652/1293] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:12 2022] POST /compute/v2.1/servers/f51aea97-e8cb-4dc2-9bdb-00584ca86ccf/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:12.160473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:12.161322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:12.169159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.170004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.171036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.171693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.345207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:12.369322 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-02642944-9336-4ddb-a9cd-d4f492122ffe tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.286150 Feb 12 21:06:12.381176 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 642/1294] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:12 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:12.386274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:12.387146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:12.396530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.397325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.398397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.399006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.616607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:12.631704 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c66a1385-d935-4071-833f-acfe9b4aee72 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.471189 Feb 12 21:06:12.635291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 653/1295] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:12 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:12.645456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4ca7d8e0-f1f7-41d3-83e2-4a5a3152a7c1 req-94852abd-2158-4320-835c-b5ca9714e8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab66d1c8-2792-4aa8-b7e2-05772dc10f16", "tag": "087eb01e-6188-4522-bae6-62fbc143e630"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:12.649910 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:12.649910 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:12.661316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4ca7d8e0-f1f7-41d3-83e2-4a5a3152a7c1 req-94852abd-2158-4320-835c-b5ca9714e8a5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.663109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4ca7d8e0-f1f7-41d3-83e2-4a5a3152a7c1 req-94852abd-2158-4320-835c-b5ca9714e8a5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.698123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:12.698334 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4ca7d8e0-f1f7-41d3-83e2-4a5a3152a7c1 req-94852abd-2158-4320-835c-b5ca9714e8a5 service nova] Creating event network-changed:087eb01e-6188-4522-bae6-62fbc143e630 for instance ab66d1c8-2792-4aa8-b7e2-05772dc10f16 on nch2-master-1 Feb 12 21:06:12.719566 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ffb2084c-0144-4bcc-9660-b5bca0697c1a tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 2128 microversion: 2.25 time: 0.336904 Feb 12 21:06:12.721021 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 643/1296] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:12 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 2128 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:12.726896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:12.727566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:12.736333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.736882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.737722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.738167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.749780 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4ca7d8e0-f1f7-41d3-83e2-4a5a3152a7c1 req-94852abd-2158-4320-835c-b5ca9714e8a5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113039 Feb 12 21:06:12.751134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 654/1297] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:12.777713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec355b91-60e2-476b-9ab6-d211409d1094 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fde5a430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:12.859231 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec355b91-60e2-476b-9ab6-d211409d1094 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.106527 Feb 12 21:06:12.872447 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 655/1298] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:12 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:12.882744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:12.883724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:12.894345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.897340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:12.900065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:12.900835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.020221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:13.032296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91d1ea59-3abc-41b3-bd50-08f5df86e3a1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1472 microversion: 2.1 time: 0.309847 Feb 12 21:06:13.045323 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 644/1299] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:12 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:13.045323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:13.045323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:13.050375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:13.050943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.052015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:13.052549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.097270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'flavor' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:13.119198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Going to try to live migrate instance to nch2-master-1 {{(pid=141727) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:06:13.302566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:13.315118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb60934b-3981-4c86-ac80-2932dfee9fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.440929 Feb 12 21:06:13.326321 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 656/1300] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:12 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:13.332233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:13.332949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:13.339519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:13.344815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.344815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:13.344815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.475371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:13.496185 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cefb0635-b03a-4f7b-9115-1c6f137b1556 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1265 microversion: 2.1 time: 0.165349 Feb 12 21:06:13.499167 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 657/1301] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:13 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:13.505804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:13.506504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:13.517075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:13.520760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.520760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:13.520760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:13.962890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:13.976358 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3252448-d548-4c92-bc9b-d133faaae5d2 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.474614 Feb 12 21:06:13.977652 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 658/1302] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:13 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:13.983359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4e3eb6e-8b54-42f5-860b-795514f277c5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:13.985044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4e3eb6e-8b54-42f5-860b-795514f277c5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 1c6566a8-5189-47ee-ae67-2e3f89ded754] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:13.993592 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c4e3eb6e-8b54-42f5-860b-795514f277c5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 1c6566a8-5189-47ee-ae67-2e3f89ded754 could not be found. Feb 12 21:06:13.995153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4e3eb6e-8b54-42f5-860b-795514f277c5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 1c6566a8-5189-47ee-ae67-2e3f89ded754 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:13.996226 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4e3eb6e-8b54-42f5-860b-795514f277c5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/1c6566a8-5189-47ee-ae67-2e3f89ded754/action" status: 404 len: 111 microversion: 2.1 time: 0.017438 Feb 12 21:06:14.001535 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 659/1303] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:13 2022] POST /compute/v2.1/servers/1c6566a8-5189-47ee-ae67-2e3f89ded754/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:14.002227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:14.003580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:14.240905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.241419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.242201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.242914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.439011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:14.451465 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93e8064e-5f1e-4b3b-a85a-3dcf47a0a353 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.452941 Feb 12 21:06:14.456793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 660/1304] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:13 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:14.461044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-692a84f9-3617-44d6-aa83-7b9e926f2162 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdea21f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:14.535715 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-692a84f9-3617-44d6-aa83-7b9e926f2162 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.078428 Feb 12 21:06:14.541867 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 661/1305] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:14 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:14.543168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:14.544315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:14.551977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.552660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.553608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.554265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.893554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:14.908484 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-95449da0-ea02-43aa-87d6-668e3e9d7a39 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.368479 Feb 12 21:06:14.913536 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 662/1306] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:14 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:14.922023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:14.922708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:14.929766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.930403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.931391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.931632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.975922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:14.976383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:14.976847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lazy-loading 'fault' on Instance uuid 3267b0c7-25e2-44b9-afd1-21270d2d53bb {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:15.030406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:15.039539 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec3e402e-1b68-4b31-be76-3c9aed24d8a7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 200 len: 1306 microversion: 2.1 time: 0.127491 Feb 12 21:06:15.040148 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 663/1307] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:14 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 1306 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:15.054088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:15.054751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:15.061764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.067268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.067268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.067268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.142238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:15.153026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-961be037-e47c-48ac-9183-e71048266f34 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1271 microversion: 2.1 time: 0.109720 Feb 12 21:06:15.160738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 664/1308] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:15 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:15.167160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d9f67115-9cf0-4fe4-b1ef-7f503f1b222b req-099ca244-54dd-4abf-890a-cc4888afa7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3267b0c7-25e2-44b9-afd1-21270d2d53bb", "name": "network-vif-deleted", "tag": "31030585-0e0e-44d7-bd66-e3136d668ce8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:15.167557 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:15.167557 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:15.185927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d9f67115-9cf0-4fe4-b1ef-7f503f1b222b req-099ca244-54dd-4abf-890a-cc4888afa7de service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.186772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d9f67115-9cf0-4fe4-b1ef-7f503f1b222b req-099ca244-54dd-4abf-890a-cc4888afa7de service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.203720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d9f67115-9cf0-4fe4-b1ef-7f503f1b222b req-099ca244-54dd-4abf-890a-cc4888afa7de service nova] Creating event network-vif-deleted:31030585-0e0e-44d7-bd66-e3136d668ce8 for instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb on nch1-master-1 Feb 12 21:06:15.212934 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d9f67115-9cf0-4fe4-b1ef-7f503f1b222b req-099ca244-54dd-4abf-890a-cc4888afa7de service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050692 Feb 12 21:06:15.213975 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 665/1309] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:15.220531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:15.221251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:15.230558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.231636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.233278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.233766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.823641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:15.823641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2aa8ce01-9ce1-4a77-b20d-42f858c00357 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.485324 Feb 12 21:06:15.823641 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 666/1310] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:15 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:15.823641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:15.830862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:15.830862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.830862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.830862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.834904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.907336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:15.920390 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-784cb4d0-aa2c-4200-9130-6db4da2ed3bb tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.215892 Feb 12 21:06:15.921077 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 667/1311] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:15 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:15.926228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:15.926944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:15.932811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.933261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:15.934144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:15.934624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.131892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:16.147622 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-22bae7fa-bf9f-41bf-bf5e-41e7cbd52d1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.225429 Feb 12 21:06:16.148318 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 668/1312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:15 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:16.156890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60ef0449-2dd4-430d-97cf-ccf7712f603c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdea0ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:16.219739 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60ef0449-2dd4-430d-97cf-ccf7712f603c tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.069216 Feb 12 21:06:16.220854 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 669/1313] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:16 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:16.229090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72e5bf63-1d59-4a80-87a7-a44c41b4f6f3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:16.229974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72e5bf63-1d59-4a80-87a7-a44c41b4f6f3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 90b1d36c-a12a-40b8-b042-46015507fd63] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:16.235943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-72e5bf63-1d59-4a80-87a7-a44c41b4f6f3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 90b1d36c-a12a-40b8-b042-46015507fd63 could not be found. Feb 12 21:06:16.236530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72e5bf63-1d59-4a80-87a7-a44c41b4f6f3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 90b1d36c-a12a-40b8-b042-46015507fd63 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:16.237436 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72e5bf63-1d59-4a80-87a7-a44c41b4f6f3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/90b1d36c-a12a-40b8-b042-46015507fd63" status: 404 len: 111 microversion: 2.1 time: 0.015367 Feb 12 21:06:16.238157 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 670/1314] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:16 2022] GET /compute/v2.1/servers/90b1d36c-a12a-40b8-b042-46015507fd63 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:16.243324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:16.243930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: 3267b0c7-25e2-44b9-afd1-21270d2d53bb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:16.251733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.252456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.254661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.255465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.270892 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] HTTP exception thrown: Instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb could not be found. Feb 12 21:06:16.271796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Returning 404 to user: Instance 3267b0c7-25e2-44b9-afd1-21270d2d53bb could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:16.273317 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8795b59c-8629-4bfe-a6a8-aeddf124e9f7 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb" status: 404 len: 111 microversion: 2.1 time: 0.033412 Feb 12 21:06:16.273915 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 671/1315] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:16 2022] GET /compute/v2.1/servers/3267b0c7-25e2-44b9-afd1-21270d2d53bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:16.278358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:16.278967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:16.295349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.299252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.299252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.299252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.563626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:16.571302 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c7d1925-d4aa-449e-9eaa-514c422eb3a4 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.296357 Feb 12 21:06:16.574301 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 672/1316] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:16 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:16.581771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:16.585546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:16.600184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.600877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.602448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.605050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.794025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:16.802766 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb94a623-f68a-41ff-8556-341cf3bd9cc5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.227148 Feb 12 21:06:16.803668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 673/1317] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:16 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:16.808115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:16.808701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:16.837224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.837943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.838498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:16.838947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:16.918338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:06:17.121108 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc770d05-96e3-44fa-b42a-84ad0767e363 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/action" status: 202 len: 0 microversion: 2.25 time: 4.085565 Feb 12 21:06:17.122912 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 645/1318] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:06:13 2022] POST /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/action => generated 0 bytes in 4088 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:17.132826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:17.133742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:17.145399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.145399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.145399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.145399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.353979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03b6a637-92ea-4000-ba9a-24002738a293 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 204 len: 0 microversion: 2.1 time: 0.548684 Feb 12 21:06:17.355092 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 674/1319] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:06:16 2022] DELETE /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:17.363096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:17.364588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:17.380351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.382630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.387910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.388726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.448605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:17.488056 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb820b23-5dbe-4cb8-b566-91c15d0d09ad tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.359951 Feb 12 21:06:17.493663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 646/1320] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:17 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:17.500506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:17.501120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:17.510851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.511997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.515552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.515552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.765823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:17.777105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:17.782586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:17.787983 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eee58bd0-a3af-4cde-8b1b-cb9b95ab72d4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.293129 Feb 12 21:06:17.807017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 647/1321] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:17 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:17.812663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:17.813724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:17.832513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.832968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:17.834266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:17.835862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.139906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:18.149556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a43b023b-61b9-49d5-b475-9194112bfcf3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.792447 Feb 12 21:06:18.161223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 675/1322] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:17 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:18.166475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c5cde38-84c8-4369-b390-bdcab035d032 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdfea430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:18.225764 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c5cde38-84c8-4369-b390-bdcab035d032 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.063046 Feb 12 21:06:18.226820 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 676/1323] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:18 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:18.233200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:18.234334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:18.243371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.244180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.245221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.245920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.307724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:18.321145 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-06889b5f-2cdd-4aeb-b846-d53fc9310b46 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.512631 Feb 12 21:06:18.321767 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 648/1324] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:17 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:18.330398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0609b2dd-cd1c-45ea-8c87-1b594fcacaa2 req-43392b39-bfee-4cbf-b999-2e262a06a5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:18.337621 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:18.337621 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:18.361107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0609b2dd-cd1c-45ea-8c87-1b594fcacaa2 req-43392b39-bfee-4cbf-b999-2e262a06a5d5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.361804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0609b2dd-cd1c-45ea-8c87-1b594fcacaa2 req-43392b39-bfee-4cbf-b999-2e262a06a5d5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.383526 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0609b2dd-cd1c-45ea-8c87-1b594fcacaa2 req-43392b39-bfee-4cbf-b999-2e262a06a5d5 service nova] Creating event network-changed:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch2-master-1 Feb 12 21:06:18.391557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0609b2dd-cd1c-45ea-8c87-1b594fcacaa2 req-43392b39-bfee-4cbf-b999-2e262a06a5d5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068589 Feb 12 21:06:18.392774 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 649/1325] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:18.398309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:18.399260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:18.408104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.408864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.410609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.411281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.460023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:18.468679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-105322b0-7ae5-42a2-9972-d9b53c5c0189 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1473 microversion: 2.1 time: 0.240156 Feb 12 21:06:18.473736 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 677/1326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:18 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1473 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:18.478442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1635903-61d5-47d7-abde-6e4c05178b04 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1290341358", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:18.479947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1635903-61d5-47d7-abde-6e4c05178b04 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:18.480749 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1635903-61d5-47d7-abde-6e4c05178b04 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.005947 Feb 12 21:06:18.487769 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 678/1327] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:06:18.503009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:18.507186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:18.521203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.521686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.523425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.523875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.647641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:18.662702 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44661e06-ab6f-42d6-986b-119188efe777 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.268226 Feb 12 21:06:18.663646 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 650/1328] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:18 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:18.797912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6e58b5de-caec-48ee-b38c-2e201ed92a9f req-2f00f382-2d7b-414d-b3eb-95c17a246910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab66d1c8-2792-4aa8-b7e2-05772dc10f16", "name": "network-vif-plugged", "status": "completed", "tag": "087eb01e-6188-4522-bae6-62fbc143e630"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:18.801022 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:18.801022 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:18.821546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6e58b5de-caec-48ee-b38c-2e201ed92a9f req-2f00f382-2d7b-414d-b3eb-95c17a246910 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.823012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6e58b5de-caec-48ee-b38c-2e201ed92a9f req-2f00f382-2d7b-414d-b3eb-95c17a246910 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.833914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:18.838276 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6e58b5de-caec-48ee-b38c-2e201ed92a9f req-2f00f382-2d7b-414d-b3eb-95c17a246910 service nova] Creating event network-vif-plugged:087eb01e-6188-4522-bae6-62fbc143e630 for instance ab66d1c8-2792-4aa8-b7e2-05772dc10f16 on nch2-master-1 Feb 12 21:06:18.844056 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec5efced-bf9c-4b5e-99bd-3f22c5604a2a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.355158 Feb 12 21:06:18.846831 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 679/1329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:18 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:18.849655 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6e58b5de-caec-48ee-b38c-2e201ed92a9f req-2f00f382-2d7b-414d-b3eb-95c17a246910 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058407 Feb 12 21:06:18.850467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:18.851491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 651/1330] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:18.854118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:18.865470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.866336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.867155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.867604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.872282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:18.873009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:18.892893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.893491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:18.894328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:18.894775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.260989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:19.278456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:19.287049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:19.291343 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec8bf053-6362-49eb-81ad-8fdbe738b26f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.444671 Feb 12 21:06:19.294291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 680/1331] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:18 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:19.317182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:19.318088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:19.328955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:19.329770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.330834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:19.331588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.548609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:19.564443 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df05c92b-4d30-40cd-a246-750ab74e67ba tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.268901 Feb 12 21:06:19.565694 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 681/1332] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:19 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:19.572363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-edeaddb4-59c2-49c8-9a8c-f62ef1583f16 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdfb4550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:19.643442 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-edeaddb4-59c2-49c8-9a8c-f62ef1583f16 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.076502 Feb 12 21:06:19.645008 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 682/1333] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:19 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:19.653434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:19.654325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:19.672083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:19.677629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.678843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:19.679621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.717205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:19.734254 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c4ff8550-ab01-4867-a216-637b6e86ac6b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.865947 Feb 12 21:06:19.734254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 652/1334] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:18 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:19.738198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:19.742661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:19.764623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:19.765449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.766478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:19.767092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:19.963282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:19.977907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cbc49d85-877b-4d75-a7c2-24e02300cc1d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.321094 Feb 12 21:06:19.978549 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 683/1335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:19 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:19.983530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:19.984153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:20.031600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.032064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.032926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.033342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.279590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.279590 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d0120cda-b2ea-45a8-9254-035ccaac55a8 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1473 microversion: 2.1 time: 0.544514 Feb 12 21:06:20.290427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 653/1336] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:19 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1473 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:20.297686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96a7d6eb-1903-4627-95d3-e37de4c73ab2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2015809706", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:20.300763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96a7d6eb-1903-4627-95d3-e37de4c73ab2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:20.302335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96a7d6eb-1903-4627-95d3-e37de4c73ab2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.008107 Feb 12 21:06:20.307750 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 654/1337] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:06:20.314902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:20.315472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:20.324535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.325782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.326710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.327151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.468525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.484113 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1bb527d-e9d8-43c7-a313-f7eab68ce07b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.504447 Feb 12 21:06:20.494425 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 684/1338] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:19 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:20.494425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:20.494425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:20.505138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.505645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.506448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.506887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.655172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.684557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac4dd48b-527b-47e1-aa2e-427e15c0bd02 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.373498 Feb 12 21:06:20.686371 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 655/1339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:20 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:20.692656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:20.693266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:20.724409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.725679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.727808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.728783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.740726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.755578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.759802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.763758 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de5ceaf7-d30d-456e-8922-eca2f0df86f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.275573 Feb 12 21:06:20.763758 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 685/1340] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:20 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:20.767744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31c1a829-b554-462c-90a8-4ca384b29b7b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdff84c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:20.839595 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31c1a829-b554-462c-90a8-4ca384b29b7b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.075296 Feb 12 21:06:20.840207 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 686/1341] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:20 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:20.846400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:20.847348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:20.854135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.859965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.861149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:20.861965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:20.977795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:20.985752 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f08767d-1bd1-4f67-90ee-bedf8eb93ce3 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1322 microversion: 2.1 time: 0.298161 Feb 12 21:06:20.990607 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 656/1342] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:20 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:20.994745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-8d1ffcb1-afab-44e6-9b9a-ae59a85d2a48 req-c2973bb2-e2aa-4ea2-bdd8-7f5a55ef6eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f87ab1-85fb-49c2-9720-20ce04a1c7b1", "name": "network-vif-plugged", "status": "completed", "tag": "2cde5d15-d636-49b0-9a4a-067de06e9f91"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:20.997205 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:20.997205 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:21.024512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8d1ffcb1-afab-44e6-9b9a-ae59a85d2a48 req-c2973bb2-e2aa-4ea2-bdd8-7f5a55ef6eb7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.025067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8d1ffcb1-afab-44e6-9b9a-ae59a85d2a48 req-c2973bb2-e2aa-4ea2-bdd8-7f5a55ef6eb7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.041654 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-8d1ffcb1-afab-44e6-9b9a-ae59a85d2a48 req-c2973bb2-e2aa-4ea2-bdd8-7f5a55ef6eb7 service nova] Creating event network-vif-plugged:2cde5d15-d636-49b0-9a4a-067de06e9f91 for instance 60f87ab1-85fb-49c2-9720-20ce04a1c7b1 on nch1-master-1 Feb 12 21:06:21.048158 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-8d1ffcb1-afab-44e6-9b9a-ae59a85d2a48 req-c2973bb2-e2aa-4ea2-bdd8-7f5a55ef6eb7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056559 Feb 12 21:06:21.053619 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 657/1343] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:21.055155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9849fb0b-3137-4fd7-93ae-86b8a2ed20ec req-421d7385-7bb6-4e72-86e2-0990edae3f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb912b1f-e486-40b6-b01c-5a26c3374a77", "name": "network-vif-deleted", "tag": "868c095f-3711-40a3-a930-a2e4658e031f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:21.056805 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:21.056805 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:21.070424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9849fb0b-3137-4fd7-93ae-86b8a2ed20ec req-421d7385-7bb6-4e72-86e2-0990edae3f8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.072008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9849fb0b-3137-4fd7-93ae-86b8a2ed20ec req-421d7385-7bb6-4e72-86e2-0990edae3f8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.093510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.107223 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9849fb0b-3137-4fd7-93ae-86b8a2ed20ec req-421d7385-7bb6-4e72-86e2-0990edae3f8b service nova] Creating event network-vif-deleted:868c095f-3711-40a3-a930-a2e4658e031f for instance eb912b1f-e486-40b6-b01c-5a26c3374a77 on nch1-master-1 Feb 12 21:06:21.109444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccdf41dc-7847-4330-a13f-40c1175a2d5c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.263763 Feb 12 21:06:21.112303 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 687/1344] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:20 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:21.112465 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9849fb0b-3137-4fd7-93ae-86b8a2ed20ec req-421d7385-7bb6-4e72-86e2-0990edae3f8b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062148 Feb 12 21:06:21.113256 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 658/1345] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:21.128606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d498acb7-e508-4be6-a196-bccdc29f662b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:21.128741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d498acb7-e508-4be6-a196-bccdc29f662b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 4d9500b8-a4ce-479e-902c-0296a15de4fd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.134709 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d498acb7-e508-4be6-a196-bccdc29f662b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 4d9500b8-a4ce-479e-902c-0296a15de4fd could not be found. Feb 12 21:06:21.135466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d498acb7-e508-4be6-a196-bccdc29f662b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 4d9500b8-a4ce-479e-902c-0296a15de4fd could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:21.136338 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d498acb7-e508-4be6-a196-bccdc29f662b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/4d9500b8-a4ce-479e-902c-0296a15de4fd/action" status: 404 len: 111 microversion: 2.1 time: 0.013465 Feb 12 21:06:21.138674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:21.139402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.142853 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 659/1346] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:21 2022] POST /compute/v2.1/servers/4d9500b8-a4ce-479e-902c-0296a15de4fd/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:21.155302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.155839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.158708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:21.159379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.165764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.166464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.179707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.180170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.181027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.181719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.421818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.430708 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e9f4309-e7eb-41c4-a498-5ff64bbb6255 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.284973 Feb 12 21:06:21.431436 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 660/1347] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:21.437185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:21.439176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.444756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.445554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.446948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.447571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.538830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.546527 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-215c8a8a-3e70-41fb-a6f8-45ce67fb1367 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1302 microversion: 2.1 time: 0.113647 Feb 12 21:06:21.547464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 661/1348] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:21.548930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.552338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:21.552487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.556692 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36be0f0d-9290-47d6-b882-6a2ddc9cc2d1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.436748 Feb 12 21:06:21.557263 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 688/1349] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:21.558384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.558871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.560195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.560624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.562546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:21.563153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.572940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.573547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.574487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.575652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.712901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.721688 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-10e0edee-513f-43d7-8c5f-108aecd27a7c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.173092 Feb 12 21:06:21.722258 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 662/1350] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:21.725782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.734418 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-20ed25aa-3183-4e8b-ba3a-524fd4c9a203 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.176172 Feb 12 21:06:21.738809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 689/1351] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:21.738945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:21.739421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.745112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.745593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.746374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.747010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.780396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:21.781083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:21.788083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.788940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.789317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:21.789945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:21.967594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.978334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.979898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:21.981137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7770bb57-8a54-4626-8f2a-74bc06514016 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.204976 Feb 12 21:06:21.985991 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 690/1352] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:06:21.990832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-066959dc-f2ac-4c8d-9637-56b096b4bab2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fdfc4940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.053824 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc010565-f991-4bb3-8eed-61801d84934e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 202 len: 0 microversion: 2.1 time: 0.318457 Feb 12 21:06:22.058503 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 663/1353] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:21 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:06:22.060606 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-066959dc-f2ac-4c8d-9637-56b096b4bab2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1427 microversion: 2.1 time: 0.073377 Feb 12 21:06:22.061199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 691/1354] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:21 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:22.065455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.066444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.073340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.075228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.077950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.078850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.080091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.080814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.081913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.082522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.083411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.083845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.246076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:22.256349 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f952a421-1925-46ae-9dbd-db7c1d9c7ff4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1511 microversion: 2.1 time: 0.189932 Feb 12 21:06:22.257578 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 692/1355] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:22.275906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:22.300196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-197f7835-a497-41f8-8f50-837d264ec3cf tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1472 microversion: 2.1 time: 0.226381 Feb 12 21:06:22.300196 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 664/1356] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:22.305875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.306552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.314832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.315382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.316244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.316751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.342031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:22.342872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:22.343782 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61fa2cd9-d763-4fb1-9583-5715e779e475 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.042231 Feb 12 21:06:22.344398 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 693/1357] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16/diagnostics => generated 117 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:22.355545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.356290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.364234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.364824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.366067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.366596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.394686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:06:22.563808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.565114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.572398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.572854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.574128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.574128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.613924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.614687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.615142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lazy-loading 'fault' on Instance uuid eb912b1f-e486-40b6-b01c-5a26c3374a77 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:22.660664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e42100a92414275a7218318b53388da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ed44c8eee2476593e75478c214644c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:22.667583 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b919f7ec-6a26-4931-a7c2-07433e3b02d0 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 200 len: 1307 microversion: 2.1 time: 0.107408 Feb 12 21:06:22.672236 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 694/1358] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:22.672987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.673625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.680624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.681077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.681903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.682342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.833687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:22.841647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c6b5bcf-6913-42f6-a0a0-7ac9f9b5306b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1316 microversion: 2.1 time: 0.171982 Feb 12 21:06:22.850750 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 695/1359] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:22.850750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.850750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.854177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.854633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.855423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.856613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.939021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-145c3e0e-de2d-42fa-a848-f93f4323f116 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 204 len: 0 microversion: 2.1 time: 0.587236 Feb 12 21:06:22.940564 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 665/1360] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:06:22 2022] DELETE /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:22.948838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:22.957949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:22.964717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.966063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:22.967270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:22.967910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.026681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.031777 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd69f0b5-83f9-4375-8243-db3ad8de9a59 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.188060 Feb 12 21:06:23.032380 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 696/1361] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:23.036809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.037447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.044914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.050026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.050026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.050026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.120831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.129156 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcaf4450-31ee-4e7b-8933-9923a9328c69 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1478 microversion: 2.1 time: 0.184952 Feb 12 21:06:23.129763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 666/1362] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:22 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:23.134356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce2115c9-4144-40a0-83fc-1632052971ec tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fea7bc10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.180453 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce2115c9-4144-40a0-83fc-1632052971ec tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1436 microversion: 2.1 time: 0.049317 Feb 12 21:06:23.183563 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 667/1363] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1436 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:23.192676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-523e1d4b-c54f-4825-8f85-9a33957480c8 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fec743a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.201246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.221655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.223172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.224728 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9d677fbf-fcf4-4ad9-9585-2ebcf1bc09c6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.191018 Feb 12 21:06:23.225284 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 697/1364] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:23.242309 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-523e1d4b-c54f-4825-8f85-9a33957480c8 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 200 len: 1436 microversion: 2.1 time: 0.053369 Feb 12 21:06:23.242878 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 668/1365] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 1436 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:23.254837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.257212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.261606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.262575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.263569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.264010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.279675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.280219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.287158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.287618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.288608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.289057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.423577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.432129 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-289d1220-8ca4-4a16-8e02-060419efd9a2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1480 microversion: 2.1 time: 0.181180 Feb 12 21:06:23.432712 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 698/1366] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1480 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:23.448650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:23.457626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8f4fd6a0-4163-4447-8b5d-39d188777355 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1491 microversion: 2.1 time: 0.185373 Feb 12 21:06:23.458384 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 669/1367] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1491 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:23.480375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:23.481168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.487324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.489318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.489318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.489318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.513305 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'pause' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state paused Feb 12 21:06:23.513929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'pause' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state paused {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:23.514786 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0c0e9a3-94c0-4014-a8a4-64b642a4439c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 143 microversion: 2.1 time: 0.038310 Feb 12 21:06:23.515349 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 699/1368] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:23 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 143 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:06:23.523429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:23.523958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.530673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.531063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.532244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.532679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.685849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.686586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] [instance: eb912b1f-e486-40b6-b01c-5a26c3374a77] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.695356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.695940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.696648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.697152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.717195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] HTTP exception thrown: Instance eb912b1f-e486-40b6-b01c-5a26c3374a77 could not be found. Feb 12 21:06:23.717844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Returning 404 to user: Instance eb912b1f-e486-40b6-b01c-5a26c3374a77 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:23.719567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e83e0821-145a-4580-85ad-288bf7f87ff1 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77" status: 404 len: 111 microversion: 2.1 time: 0.037382 Feb 12 21:06:23.719567 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 700/1369] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/servers/eb912b1f-e486-40b6-b01c-5a26c3374a77 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:06:23.726917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57343e81-0c26-40eb-a831-c134ae832777 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fdea0940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.858559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf511b9c-3c95-403e-bfcc-13b7ed89f6fc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 202 len: 0 microversion: 2.1 time: 0.338063 Feb 12 21:06:23.861643 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 670/1370] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:23 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:23.864013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:23.864709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:23.871277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.872356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:23.873152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:23.873606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.013032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.020395 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2a24cdc-a8d3-4bfc-8c30-e21cfff06938 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1466 microversion: 2.1 time: 0.160368 Feb 12 21:06:24.021170 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 671/1371] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:23 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:24.025275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.030440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:24.031745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.032139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.032918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.033380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.178061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.187514 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6586ae7-9ee8-49df-977e-adef05de52a5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1498 microversion: 2.1 time: 0.165531 Feb 12 21:06:24.188083 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 672/1372] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:24 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:24.192574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.193168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:24.198762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.199209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.200054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.200656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.347093 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd25c2c2-046f-47eb-934a-bba12e6b8454 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1617 microversion: 2.1 time: 0.157961 Feb 12 21:06:24.348012 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 673/1373] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:24 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1617 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:24.351209 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57343e81-0c26-40eb-a831-c134ae832777 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/images/54befd77-21e0-467e-af7e-25b9136bf595" status: 204 len: 0 microversion: 2.1 time: 0.627583 Feb 12 21:06:24.352033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 701/1374] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:23 2022] DELETE /compute/v2.1/images/54befd77-21e0-467e-af7e-25b9136bf595 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:24.352450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.353115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:24.359360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.360241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:24.365887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.366408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.367476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.368087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.369098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.369717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.370890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.371329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.562766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.570546 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6683b145-23af-4e3f-9c2d-a0eac8f4e071 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1478 microversion: 2.1 time: 0.216475 Feb 12 21:06:24.571293 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 702/1375] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:24 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1478 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:24.576152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.576887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:24.583380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.583958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.584833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.585349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.656091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.663897 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8431200-0c50-4c8c-987b-9ff219935e28 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.315017 Feb 12 21:06:24.674697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 674/1376] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:24 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:24.679734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b40db3ce-cd39-4a77-9853-28e8821b26e3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa8fec3a040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.751589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.761723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.764653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:24.765849 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de050919-d53f-42e3-9df5-39d1036700af tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.193387 Feb 12 21:06:24.777253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 703/1377] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:24 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:24.777253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:24.777253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:24.779537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.780295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:24.781330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:24.782397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:25.025971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:25.038044 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd2a1ef5-77ab-4a39-b75f-54da3132b39d tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1467 microversion: 2.1 time: 0.270300 Feb 12 21:06:25.049604 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 704/1378] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:24 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1467 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:25.054427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-91754534", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["579b174f-d572-49b2-8f60-9e0d62cc450e"]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:25.106898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:25.380266 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b40db3ce-cd39-4a77-9853-28e8821b26e3 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/images/69dbe8c0-fc71-4f1e-9254-37cfb3e68b4a" status: 204 len: 0 microversion: 2.1 time: 0.700421 Feb 12 21:06:25.380266 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 675/1379] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:24 2022] DELETE /compute/v2.1/images/69dbe8c0-fc71-4f1e-9254-37cfb3e68b4a => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:25.382308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f68a92cd-fded-44ea-a3e4-fe96ef2351ef req-ea961b03-7abf-4a9a-b9fc-10eec5556115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0d6420-a0c3-4a88-9549-864fdefe2378", "name": "network-vif-unplugged", "status": "completed", "tag": "76d6d407-e6c3-4fc4-984f-2f18ac7b3009"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:25.384171 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:25.384171 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:25.395730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f68a92cd-fded-44ea-a3e4-fe96ef2351ef req-ea961b03-7abf-4a9a-b9fc-10eec5556115 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:25.396180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f68a92cd-fded-44ea-a3e4-fe96ef2351ef req-ea961b03-7abf-4a9a-b9fc-10eec5556115 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:25.412163 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f68a92cd-fded-44ea-a3e4-fe96ef2351ef req-ea961b03-7abf-4a9a-b9fc-10eec5556115 service nova] Creating event network-vif-unplugged:76d6d407-e6c3-4fc4-984f-2f18ac7b3009 for instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 on nch1-master-1 Feb 12 21:06:25.413952 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f68a92cd-fded-44ea-a3e4-fe96ef2351ef req-ea961b03-7abf-4a9a-b9fc-10eec5556115 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035725 Feb 12 21:06:25.414728 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 676/1380] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:25.420099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a5b16e7-d745-4952-8638-1fc2cbc7fa9b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8feaf3ee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:25.518177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:25.518704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:25.519452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:25.520045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:25.520467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:25.529760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:25.530221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:25.531050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:25.531492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:25.556068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:25.565758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:25.584936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:25.587437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:25.748806 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ce9acee-954c-4886-8e8a-7cd62f456fa3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698137 Feb 12 21:06:25.750175 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 705/1381] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:25.755409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:25.759643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:25.766096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:25.766940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:25.768064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:25.768677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:26.003670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:26.012340 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54e4671f-e3d8-4e97-a532-4df540f770ce tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.260688 Feb 12 21:06:26.013050 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 706/1382] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:25 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:26.017809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f5c16c5-f056-4475-bee2-7a9644385f18 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] Calling method '.version_select at 0x7fa904075c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:26.738605 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f5c16c5-f056-4475-bee2-7a9644385f18 tempest-ListImageFiltersTestJSON-945542025 tempest-ListImageFiltersTestJSON-945542025-project] 10.222.0.31 "DELETE /compute/v2.1/images/8612e5f0-91fa-4961-9276-9ae3cde9195a" status: 204 len: 0 microversion: 2.1 time: 0.724288 Feb 12 21:06:26.743070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 707/1383] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:26 2022] DELETE /compute/v2.1/images/8612e5f0-91fa-4961-9276-9ae3cde9195a => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:26.749651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:26.750653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:26.758659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:26.759858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:26.760999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:26.761647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:26.806645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:26.807365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:26.807994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lazy-loading 'fault' on Instance uuid ab66d1c8-2792-4aa8-b7e2-05772dc10f16 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:26.857124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3d067a7f5e4cd492d1e2af08520249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799d7a4057974c53bec70a307fe068ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:26.865434 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50bcd552-b506-42bd-89c4-eadf6206c791 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 200 len: 1312 microversion: 2.1 time: 0.120876 Feb 12 21:06:26.865852 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 708/1384] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:26 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:26.880503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:26.881128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:26.890027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:26.890547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:26.891362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:26.891802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.028526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.036012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-795187c9-dd84-46a5-bb18-3f61dd4507c6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.169203 Feb 12 21:06:27.036575 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 709/1385] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:26 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:27.040919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1365d760-01c9-4ed8-95b9-fe731a1d0a85 req-8f31c4ec-396c-48e5-9a28-75d8573b3910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab66d1c8-2792-4aa8-b7e2-05772dc10f16", "name": "network-vif-deleted", "tag": "087eb01e-6188-4522-bae6-62fbc143e630"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:27.042475 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:27.042475 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:27.049772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1365d760-01c9-4ed8-95b9-fe731a1d0a85 req-8f31c4ec-396c-48e5-9a28-75d8573b3910 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.050281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1365d760-01c9-4ed8-95b9-fe731a1d0a85 req-8f31c4ec-396c-48e5-9a28-75d8573b3910 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.062181 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1365d760-01c9-4ed8-95b9-fe731a1d0a85 req-8f31c4ec-396c-48e5-9a28-75d8573b3910 service nova] Creating event network-vif-deleted:087eb01e-6188-4522-bae6-62fbc143e630 for instance ab66d1c8-2792-4aa8-b7e2-05772dc10f16 on nch2-master-1 Feb 12 21:06:27.067250 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1365d760-01c9-4ed8-95b9-fe731a1d0a85 req-8f31c4ec-396c-48e5-9a28-75d8573b3910 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029543 Feb 12 21:06:27.067886 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 710/1386] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:27.072578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.073346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.079714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.080162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.080941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.081507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.144087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a5b16e7-d745-4952-8638-1fc2cbc7fa9b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "DELETE /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963" status: 204 len: 0 microversion: 2.1 time: 1.728023 Feb 12 21:06:27.144668 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 677/1387] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:25 2022] DELETE /compute/v2.1/images/9a900684-1f49-4859-bd39-345121e03963 => generated 0 bytes in 1729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:27.148991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.149747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.156442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.165349 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e1dd1bab-64de-4883-bba3-1e26620e25ad tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1219 microversion: 2.1 time: 0.096193 Feb 12 21:06:27.176186 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 711/1388] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:27 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:27.176186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.176186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.177316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.178143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.178599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.179051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.179803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.179955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.180259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.180514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.344857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.351468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.354175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.355686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.357563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e8b725e-7cd1-42bd-b56b-18411af7d664 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.211803 Feb 12 21:06:27.358797 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 678/1389] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:27 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:27.366066 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9835e61-7a40-4019-b05c-348b30f8fe0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.198817 Feb 12 21:06:27.368223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 712/1390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:27 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:27.370694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d03b0ba2-d374-4b37-aa59-8af2ac9ccab1 req-65d88113-6ba6-43ea-b2b8-be7f56ea2aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "name": "network-vif-plugged", "status": "completed", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:27.373313 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:27.373313 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:27.379549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6064ea03-8359-481d-a95a-f926fcdcf3db tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '.version_select at 0x7fa8fe0244c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.381587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d03b0ba2-d374-4b37-aa59-8af2ac9ccab1 req-65d88113-6ba6-43ea-b2b8-be7f56ea2aad service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.382017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d03b0ba2-d374-4b37-aa59-8af2ac9ccab1 req-65d88113-6ba6-43ea-b2b8-be7f56ea2aad service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.394333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d03b0ba2-d374-4b37-aa59-8af2ac9ccab1 req-65d88113-6ba6-43ea-b2b8-be7f56ea2aad service nova] Creating event network-vif-plugged:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch2-master-1 Feb 12 21:06:27.410534 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d03b0ba2-d374-4b37-aa59-8af2ac9ccab1 req-65d88113-6ba6-43ea-b2b8-be7f56ea2aad service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044499 Feb 12 21:06:27.414389 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 679/1391] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:27.422875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:27.423902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.438136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.438592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.439456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.439893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.447934 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-6064ea03-8359-481d-a95a-f926fcdcf3db tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] HTTP exception thrown: Image not found. Feb 12 21:06:27.449530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6064ea03-8359-481d-a95a-f926fcdcf3db tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:27.450175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6064ea03-8359-481d-a95a-f926fcdcf3db tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "DELETE /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1" status: 404 len: 62 microversion: 2.1 time: 0.080535 Feb 12 21:06:27.450743 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 713/1392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:27 2022] DELETE /compute/v2.1/images/095f13cf-f7af-43c0-9cf8-0974797ce2b1 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:06:27.456413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6e60c4da-8417-4183-8580-841cec3d8e4a req-bd431e44-738a-4cf6-88d7-762d8f938e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0d6420-a0c3-4a88-9549-864fdefe2378", "tag": "76d6d407-e6c3-4fc4-984f-2f18ac7b3009"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:27.458134 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:27.458134 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:27.468546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e60c4da-8417-4183-8580-841cec3d8e4a req-bd431e44-738a-4cf6-88d7-762d8f938e04 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.469002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e60c4da-8417-4183-8580-841cec3d8e4a req-bd431e44-738a-4cf6-88d7-762d8f938e04 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.476448 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. Feb 12 21:06:27.477778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:27.478618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c619ef1-026b-44fa-b7f8-ffcdd5ca34ba tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed/action" status: 404 len: 111 microversion: 2.1 time: 0.062294 Feb 12 21:06:27.480040 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 680/1393] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:27 2022] POST /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:27.486949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.487449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.496787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.497518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.498318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.498754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.501034 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6e60c4da-8417-4183-8580-841cec3d8e4a req-bd431e44-738a-4cf6-88d7-762d8f938e04 service nova] Creating event network-changed:76d6d407-e6c3-4fc4-984f-2f18ac7b3009 for instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 on nch1-master-1 Feb 12 21:06:27.516388 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6e60c4da-8417-4183-8580-841cec3d8e4a req-bd431e44-738a-4cf6-88d7-762d8f938e04 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055477 Feb 12 21:06:27.517946 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 714/1394] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:27.530288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:06:27.531538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.551707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.561979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.562439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.563301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.563773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.832190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:27.842813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0569c409-28f3-4e0f-bbfe-8a8491065e77 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.324056 Feb 12 21:06:27.843775 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 715/1395] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:27 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:27.860231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.860851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:27.867314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.867768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.868757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:27.869517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:27.981518 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1365d5a9-52e2-4943-bc3d-0e40fe66a7b4 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "DELETE /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 204 len: 0 microversion: 2.1 time: 0.499973 Feb 12 21:06:27.985654 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 681/1396] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:06:27 2022] DELETE /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:27.998273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:27.999133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] [instance: ab66d1c8-2792-4aa8-b7e2-05772dc10f16] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.006823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.007275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.008074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.008512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.025671 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] HTTP exception thrown: Instance ab66d1c8-2792-4aa8-b7e2-05772dc10f16 could not be found. Feb 12 21:06:28.026895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] Returning 404 to user: Instance ab66d1c8-2792-4aa8-b7e2-05772dc10f16 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:28.032109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eebf91c2-e570-4ff7-b88b-ed17c68b48c5 tempest-ServerDiagnosticsNegativeTest-1778169571 tempest-ServerDiagnosticsNegativeTest-1778169571-project] 10.222.0.31 "GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16" status: 404 len: 111 microversion: 2.1 time: 0.043638 Feb 12 21:06:28.032939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 682/1397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:27 2022] GET /compute/v2.1/servers/ab66d1c8-2792-4aa8-b7e2-05772dc10f16 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:28.040289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:28.040838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.046986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.047635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.048596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.049195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.145290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.159081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ceeed56-963e-4e3d-b238-ff2e40beedd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.302313 Feb 12 21:06:28.160450 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 716/1398] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:27 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:28.170765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:28.174417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.190862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.191536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.192584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.193342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.234757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.249013 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41b9f042-ee70-49de-9e14-d431240a6594 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1473 microversion: 2.1 time: 0.211885 Feb 12 21:06:28.250097 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 683/1399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:28 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:28.258329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:28.259475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.270740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.271554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.272980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.273840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.405194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.418151 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-234c9eaf-a175-4740-ba96-c75c080660fa tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1267 microversion: 2.1 time: 0.166533 Feb 12 21:06:28.419310 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 684/1400] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:28 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:28.424365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-294ddadc-ba95-42c5-a248-37582405a8b3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:28.425775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-294ddadc-ba95-42c5-a248-37582405a8b3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 4473a109-be64-45e4-9dab-119a34750183] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.432383 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-294ddadc-ba95-42c5-a248-37582405a8b3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 4473a109-be64-45e4-9dab-119a34750183 could not be found. Feb 12 21:06:28.436238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-294ddadc-ba95-42c5-a248-37582405a8b3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 4473a109-be64-45e4-9dab-119a34750183 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:28.436238 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-294ddadc-ba95-42c5-a248-37582405a8b3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/4473a109-be64-45e4-9dab-119a34750183/action" status: 404 len: 111 microversion: 2.1 time: 0.013344 Feb 12 21:06:28.438973 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 685/1401] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:28 2022] POST /compute/v2.1/servers/4473a109-be64-45e4-9dab-119a34750183/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:28.445722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:28.446604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.459391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.461627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.467155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.467820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.502094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.510019 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1855a5b-1d40-4e32-9670-e2a8498c78c0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.347866 Feb 12 21:06:28.511748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 717/1402] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:28 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:28.517270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:28.517920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.524781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.528126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.528126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.528126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.677260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.692515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.694486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.697830 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-662409aa-0489-4d67-aa8a-bb333e4716c5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.257023 Feb 12 21:06:28.701763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 686/1403] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:28 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:28.907725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:28.919959 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3eebab2-f462-48c4-b83d-95b7a8ad0ebc tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.405839 Feb 12 21:06:28.921221 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 718/1404] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:28 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:28.938984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:28.939976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:28.947124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.948322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:28.949267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:28.950232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.095904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:29.103679 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f12a180e-8c15-4d3a-919c-c0a9a2b1cb6f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.169935 Feb 12 21:06:29.104254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 687/1405] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:28 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:29.120871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:29.122420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.129717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.130168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.130957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.131394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.166210 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. Feb 12 21:06:29.166210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:29.175863 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bccd5e86-04ab-4620-8ee3-2e2eadd1cc79 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed/action" status: 404 len: 111 microversion: 2.1 time: 0.058523 Feb 12 21:06:29.178338 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 719/1406] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:29 2022] POST /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:29.186486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:29.189316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.195032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.195683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.196482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.196921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.268642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:29.269864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.277019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.278567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.280105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.281006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.372475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:29.380895 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63d37bf1-4b2c-4001-a521-b901a65b34c8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.197961 Feb 12 21:06:29.381415 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 688/1407] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:29 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:29.404460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:29.405536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.413495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.414243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.415269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.421160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.558140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:29.569107 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4be06c5-443a-45de-bc2f-da8f18eeea6b tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1473 microversion: 2.1 time: 0.303972 Feb 12 21:06:29.570157 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 720/1408] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:29 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:29.576609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:29.577535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.589190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.589190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.590012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.591343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.608129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:29.616187 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9cae560f-3509-4c0a-afc2-517093006aea tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.217681 Feb 12 21:06:29.616890 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 689/1409] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:29 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:29.638217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e547250f-bb8b-4aba-a085-aa82166ecfc2 req-5bfb5928-651b-45c1-a6f4-7883bdcb2112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "name": "network-vif-unplugged", "status": "completed", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:29.642202 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:29.642202 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:29.651100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e547250f-bb8b-4aba-a085-aa82166ecfc2 req-5bfb5928-651b-45c1-a6f4-7883bdcb2112 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.651750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e547250f-bb8b-4aba-a085-aa82166ecfc2 req-5bfb5928-651b-45c1-a6f4-7883bdcb2112 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.666555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e547250f-bb8b-4aba-a085-aa82166ecfc2 req-5bfb5928-651b-45c1-a6f4-7883bdcb2112 service nova] Creating event network-vif-unplugged:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:06:29.672452 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e547250f-bb8b-4aba-a085-aa82166ecfc2 req-5bfb5928-651b-45c1-a6f4-7883bdcb2112 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042049 Feb 12 21:06:29.675235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:29.685875 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 690/1410] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:29.692913 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d975b9d8-fb40-4936-b755-27343d71d538 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1273 microversion: 2.1 time: 0.121304 Feb 12 21:06:29.694783 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 721/1411] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:29 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:29.700126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:29.700840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.719816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.721231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88575ebe-f7f0-4a33-9b66-6be3d1fc0583 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:29.724633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88575ebe-f7f0-4a33-9b66-6be3d1fc0583 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 4b7f2d3e-f58d-4e7d-a7bb-c62eb1ca6791] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.724768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.725578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.726036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.733060 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-88575ebe-f7f0-4a33-9b66-6be3d1fc0583 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 4b7f2d3e-f58d-4e7d-a7bb-c62eb1ca6791 could not be found. Feb 12 21:06:29.734415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88575ebe-f7f0-4a33-9b66-6be3d1fc0583 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 4b7f2d3e-f58d-4e7d-a7bb-c62eb1ca6791 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:29.736337 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88575ebe-f7f0-4a33-9b66-6be3d1fc0583 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/4b7f2d3e-f58d-4e7d-a7bb-c62eb1ca6791/action" status: 404 len: 111 microversion: 2.1 time: 0.040119 Feb 12 21:06:29.737212 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 722/1412] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:29 2022] POST /compute/v2.1/servers/4b7f2d3e-f58d-4e7d-a7bb-c62eb1ca6791/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:29.747156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:29.748289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:29.760737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.764818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:29.764818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:29.764818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.061607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.069933 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16a3a9b9-d9c8-4717-ab7e-abc534a7b111 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1313 microversion: 2.1 time: 0.381637 Feb 12 21:06:30.073392 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 691/1413] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:29 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:30.087514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:30.088219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:30.097903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.098060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.099172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.100181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.100902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.117871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.127538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.132694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e243704a-36a8-4293-8c27-e1b2f19ade1f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.392955 Feb 12 21:06:30.133514 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 723/1414] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:29 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:30.381543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.406396 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f875ec6d-57e7-4057-8ebe-45af7de870d7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.328318 Feb 12 21:06:30.407329 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 692/1415] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:30 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:30.432564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:30.434321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:30.457959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.460837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.463081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.467042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.592279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:30.592279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:30.596117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.596829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.597831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.598495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.736701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.745121 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99d62f65-48f3-4688-8e2f-8f6ae6a2295d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.320459 Feb 12 21:06:30.748117 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 724/1416] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:30 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:30.775254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:30.778969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:30.793931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.794803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.795948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.796503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.871994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:30.879635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b95f180a-e4cf-4f5d-8a1c-f593bcbbb8b0 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1473 microversion: 2.1 time: 0.296458 Feb 12 21:06:30.880575 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 693/1417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:30 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:30.886196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b868bcc-b597-43c8-9a77-f7ed5985a962 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:30.888351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b868bcc-b597-43c8-9a77-f7ed5985a962 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: dc83ea6f-9010-4a72-90f4-549e2a9669e1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:30.896551 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8b868bcc-b597-43c8-9a77-f7ed5985a962 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance dc83ea6f-9010-4a72-90f4-549e2a9669e1 could not be found. Feb 12 21:06:30.897474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b868bcc-b597-43c8-9a77-f7ed5985a962 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance dc83ea6f-9010-4a72-90f4-549e2a9669e1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:30.899432 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b868bcc-b597-43c8-9a77-f7ed5985a962 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/dc83ea6f-9010-4a72-90f4-549e2a9669e1/action" status: 404 len: 111 microversion: 2.1 time: 0.017808 Feb 12 21:06:30.900575 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 694/1418] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:30 2022] POST /compute/v2.1/servers/dc83ea6f-9010-4a72-90f4-549e2a9669e1/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:30.923265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:30.929650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:30.946370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.947764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:30.948841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:30.961872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.131907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.141523 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5611718a-8fbe-4864-98de-984aa8af7fc6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.228323 Feb 12 21:06:31.142113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 695/1419] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:30 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:31.150399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:31.150399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.155983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.156439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.157245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.157774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.312187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.323131 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb96ba2b-faf4-4f80-b3bf-bd5471284f84 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1463 microversion: 2.1 time: 0.179338 Feb 12 21:06:31.323706 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 696/1420] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:31 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:31.342356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:31.343173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.349491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.349941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.351118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.351713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.519885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.530536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.532042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.533626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db432e21-65de-44ac-8a94-13ce28df1608 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.208949 Feb 12 21:06:31.534391 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 697/1421] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:31 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:31.541311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:31.541955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.549182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.549661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.550462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.550902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.567645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.577055 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e95b085a-5acd-4975-87cf-83b8f9fe76c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.809251 Feb 12 21:06:31.578083 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 725/1422] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:30 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:31.582495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:31.583268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.589920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.591852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.591852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.591852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.700987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.708581 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-519b9132-af9f-48c8-a48b-83da6fa3ae0a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.172979 Feb 12 21:06:31.709163 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 698/1423] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:31 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:31.727153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:31.727877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.735785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.735785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.737051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.737525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.755650 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cadadee8-02b4-42f7-bbba-067a57a993a5 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1614 microversion: 2.1 time: 0.175985 Feb 12 21:06:31.756266 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 726/1424] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:31 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1614 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:31.767490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'restore' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active Feb 12 21:06:31.767490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'restore' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:31.767490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56134a85-6b3c-42a4-85cc-2f6838f03bf6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 145 microversion: 2.1 time: 0.043126 Feb 12 21:06:31.767490 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 699/1425] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:31 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 145 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:06:31.774602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:31.775527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.776551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:31.777434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:31.782856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.783356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.784621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.785250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.786761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.788004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.789104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:31.789599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:31.889015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '20d7d6a104844b608d73b5e714bf63a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9f4266b43c44dd9c60ed238e9fe0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:31.891601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] flavor_id is None. Assuming migration. {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4093}} Feb 12 21:06:31.891601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:06:32.229075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:32.238129 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5fa0d8fb-cf0a-4ad1-8109-a9a82e043c56 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.466936 Feb 12 21:06:32.238710 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 727/1426] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:31 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:32.260887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:32.263119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:32.273153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.273267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.278367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.278367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.660489 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b08b8991-5681-4f67-be1f-2f0ab78ea0d7 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a/action" status: 202 len: 0 microversion: 2.1 time: 0.889406 Feb 12 21:06:32.667409 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 700/1427] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:31 2022] POST /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:32.708042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4b6d5c49-5b2d-47cf-92a4-304a30a4a973 req-1ce9862a-b5b5-4a1b-be2d-55aa2fbede65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608f3421-9d47-451f-aab9-8b516d566201", "tag": "d12f9147-b8b3-4cc7-ba78-bc82fb796c36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:32.709850 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:32.709850 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:32.730291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4b6d5c49-5b2d-47cf-92a4-304a30a4a973 req-1ce9862a-b5b5-4a1b-be2d-55aa2fbede65 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.731085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4b6d5c49-5b2d-47cf-92a4-304a30a4a973 req-1ce9862a-b5b5-4a1b-be2d-55aa2fbede65 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.752529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4b6d5c49-5b2d-47cf-92a4-304a30a4a973 req-1ce9862a-b5b5-4a1b-be2d-55aa2fbede65 service nova] Creating event network-changed:d12f9147-b8b3-4cc7-ba78-bc82fb796c36 for instance 608f3421-9d47-451f-aab9-8b516d566201 on nch1-master-1 Feb 12 21:06:32.760038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4b6d5c49-5b2d-47cf-92a4-304a30a4a973 req-1ce9862a-b5b5-4a1b-be2d-55aa2fbede65 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081129 Feb 12 21:06:32.762732 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 701/1428] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:32.769982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:32.770943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:32.778814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.779565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.780601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.781110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.854477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:32.865384 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d3f1a2da-8785-470c-a876-5bd995b47091 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1473 microversion: 2.1 time: 0.625383 Feb 12 21:06:32.876154 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 728/1429] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:32 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1473 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:32.881428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:32.882077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:32.888892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.889585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.890548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.891146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.940164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:32.948403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c7363e16-ae65-451c-b1aa-d318af6d0424 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.183597 Feb 12 21:06:32.950177 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 702/1430] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:32 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:32.955047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:32.956086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:32.962609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.963311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:32.964410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:32.968402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:33.131049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:33.140041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:33.141801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:33.143933 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4308b36c-74f7-4074-ae58-cf2b98fb2b0b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.266402 Feb 12 21:06:33.144792 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 729/1431] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:32 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:33.146483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:33.150626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:33.151433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:33.158275 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba2e85a3-0512-4ae6-ac12-fb67223418a7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.206516 Feb 12 21:06:33.161768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:33.161895 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 703/1432] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:32 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:33.161983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:33.161983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:33.161983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:33.465824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-598d82d4-1bb4-4e91-bd40-f603c3d757e0 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fea2de50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-605621374", "description": "tempest-description-683646635"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:33.505263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:33.515395 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4da59cc-d7c2-4ab1-8f0b-d85cd1922326 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1472 microversion: 2.1 time: 0.368647 Feb 12 21:06:33.516354 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 730/1433] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:33 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:33.521394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4def80ca-8e44-4784-8445-8c0c261cb125 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:33.522272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4def80ca-8e44-4784-8445-8c0c261cb125 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 72e1d9e3-9e00-4f2a-a3e9-91c949326e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:33.528894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4def80ca-8e44-4784-8445-8c0c261cb125 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 72e1d9e3-9e00-4f2a-a3e9-91c949326e6f could not be found. Feb 12 21:06:33.529907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4def80ca-8e44-4784-8445-8c0c261cb125 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 72e1d9e3-9e00-4f2a-a3e9-91c949326e6f could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:33.537809 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4def80ca-8e44-4784-8445-8c0c261cb125 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/72e1d9e3-9e00-4f2a-a3e9-91c949326e6f/action" status: 404 len: 111 microversion: 2.1 time: 0.014236 Feb 12 21:06:33.537809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 731/1434] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:33 2022] POST /compute/v2.1/servers/72e1d9e3-9e00-4f2a-a3e9-91c949326e6f/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:33.543139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:33.544441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:33.552221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:33.553115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:33.560727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:33.563252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:33.844672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:33.853031 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d4dfd67b-ad22-42fc-8f5c-f624ac4cda5d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.313657 Feb 12 21:06:33.854821 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 732/1435] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:33 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:33.945827 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-598d82d4-1bb4-4e91-bd40-f603c3d757e0 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.785784 Feb 12 21:06:33.947530 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 704/1436] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:33 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:33.957862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:33.960038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:33.972894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:33.973503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:33.974388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:33.974865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.037450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-694843482", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:34.097832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:34.176129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:34.186804 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-51070cee-4558-4938-95d0-355077a24423 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.237053 Feb 12 21:06:34.187846 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 705/1437] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:33 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:34.199155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:34.204909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:34.208147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.208683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.209593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.210228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.241731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.242187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.242639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lazy-loading 'fault' on Instance uuid cdd11fb3-ce20-420b-a958-95089b17ff99 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:34.291197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34dcf9eabda74da6a6e26ad039bd9258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fadab1c622d04b36be08c573468cd5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:34.302767 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3d4ba16-e69b-40eb-a2be-798043552345 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 200 len: 1307 microversion: 2.1 time: 0.110014 Feb 12 21:06:34.302767 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 706/1438] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:34 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:34.304151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56c08ffc-99bc-441d-b37c-d00808e3b707 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fe9e93a0>, body: {"security_group_rule": {"parent_group_id": "34f27a0f-5bf1-4284-9c84-dfb6046989b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:34.320969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:34.321743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:34.322228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:34.322710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:34.323134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:34.332938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.338032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.338032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.338032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.354183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Getting quotas for project e182ad91ab97452284bae777d54ec83d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:34.359604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Getting quotas for user 2953a6e295b345d0a7d571a023562671 and project e182ad91ab97452284bae777d54ec83d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:34.372734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:34.378091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:34.530894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5103defb-5d75-4c33-9bdd-8c68c97e9e98 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674143 Feb 12 21:06:34.532158 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 733/1439] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:34.544828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:34.544828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:34.545992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.546670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.547598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.548260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.791333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56c08ffc-99bc-441d-b37c-d00808e3b707 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.490868 Feb 12 21:06:34.799979 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 707/1440] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:06:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:34.800185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:34.800950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:34.807007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.807454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.808411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.809857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.814661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:34.833140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:34.834853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:34.836205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a63421a7-c35a-46ca-a977-fdecd17057c4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.302577 Feb 12 21:06:34.836883 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 734/1441] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:34 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:34.842615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:34.843441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:34.854834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.855501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.857178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.858069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.896992 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'resume' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active Feb 12 21:06:34.897755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'resume' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:34.898710 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6832fd6f-48aa-43e7-bd5b-83d1010d4d9d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 144 microversion: 2.1 time: 0.060633 Feb 12 21:06:34.899654 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 735/1442] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:34 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 144 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:06:34.906519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:34.907442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:34.913668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.914123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.914927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:34.915396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:34.985922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:34.993738 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6ef1684-0bdf-4252-961f-d79dd776c586 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.197274 Feb 12 21:06:34.994404 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 708/1443] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:34 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:34.999095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-557a01f2-002d-46b2-8564-3112cb45a747 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:35.000030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-557a01f2-002d-46b2-8564-3112cb45a747 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:35.056352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-557a01f2-002d-46b2-8564-3112cb45a747 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:35.064095 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-557a01f2-002d-46b2-8564-3112cb45a747 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1221 microversion: 2.1 time: 0.068593 Feb 12 21:06:35.065324 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 709/1444] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:34 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:35.078428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-118ad82a-7d1f-46dc-893c-70384f6ef732 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fe9011f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-163157896", "description": "tempest-description-1471785403"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:35.135933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:35.144987 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6fee20df-12c5-470f-97bd-2a3efa13f2c3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1472 microversion: 2.1 time: 0.244075 Feb 12 21:06:35.155956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 736/1445] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:34 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:35.155956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a1db6ed5-2563-4f1b-8dee-84a37f717c11 req-f84efc8b-d79c-42c2-a650-9e058ff6c9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd11fb3-ce20-420b-a958-95089b17ff99", "name": "network-vif-deleted", "tag": "a7c57268-d530-4f9d-b77d-da6cb2a2b872"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:35.155956 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:35.155956 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:35.160950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a1db6ed5-2563-4f1b-8dee-84a37f717c11 req-f84efc8b-d79c-42c2-a650-9e058ff6c9d2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.161417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a1db6ed5-2563-4f1b-8dee-84a37f717c11 req-f84efc8b-d79c-42c2-a650-9e058ff6c9d2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.179074 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a1db6ed5-2563-4f1b-8dee-84a37f717c11 req-f84efc8b-d79c-42c2-a650-9e058ff6c9d2 service nova] Creating event network-vif-deleted:a7c57268-d530-4f9d-b77d-da6cb2a2b872 for instance cdd11fb3-ce20-420b-a958-95089b17ff99 on nch2-master-1 Feb 12 21:06:35.186724 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a1db6ed5-2563-4f1b-8dee-84a37f717c11 req-f84efc8b-d79c-42c2-a650-9e058ff6c9d2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039915 Feb 12 21:06:35.187729 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 737/1446] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:35.193681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:35.194647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:35.204991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.205667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.206509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.206950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.455006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:35.464126 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df43afb8-533d-468b-9a99-1a9471c077bb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.275184 Feb 12 21:06:35.465418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 738/1447] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:35 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:35.473637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:35.474422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] [instance: cdd11fb3-ce20-420b-a958-95089b17ff99] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:35.483683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.484140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.484936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.485391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.503413 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] HTTP exception thrown: Instance cdd11fb3-ce20-420b-a958-95089b17ff99 could not be found. Feb 12 21:06:35.504264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] Returning 404 to user: Instance cdd11fb3-ce20-420b-a958-95089b17ff99 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:35.508886 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e12231dc-c96a-4d46-8c89-3a30ec0d1dc2 tempest-ImagesOneServerTestJSON-193579508 tempest-ImagesOneServerTestJSON-193579508-project] 10.222.0.31 "GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99" status: 404 len: 111 microversion: 2.1 time: 0.038683 Feb 12 21:06:35.508886 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 739/1448] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:35 2022] GET /compute/v2.1/servers/cdd11fb3-ce20-420b-a958-95089b17ff99 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:35.510891 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-118ad82a-7d1f-46dc-893c-70384f6ef732 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.444057 Feb 12 21:06:35.512097 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 710/1449] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:35.514797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:35.515430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:35.523529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9fab418b-d1cf-4c2b-be12-48e05c03d60c tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fea6a040>, body: {"security_group_rule": {"parent_group_id": "9482fb68-0c3a-43da-ab1e-c9131db26487", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:35.530126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.530942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.532144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.532946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.942864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:35.952390 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa4a9463-c098-4aeb-90e4-4cbb5276a05b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.445044 Feb 12 21:06:35.952985 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 740/1450] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:35 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:35.958485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:35.959098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:35.966995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.967552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.968399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:35.968892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:35.999387 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9fab418b-d1cf-4c2b-be12-48e05c03d60c tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.480390 Feb 12 21:06:36.000902 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 711/1451] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:06:35 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:06:36.016303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:36.017450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:36.048420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.048882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.058414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.059434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.306998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:36.319190 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf05ea60-53f3-4e29-b863-81ca0fb8cb61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.311541 Feb 12 21:06:36.332279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 712/1452] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:36 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:36.354527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d86695f-e46d-4e03-aafb-ef79f5749d51 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fea24ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-49340092", "description": "tempest-description-2112321060"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:36.706358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:36.716734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:36.718545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:36.720006 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a884667-6838-46ad-be8c-79834bd84567 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.765280 Feb 12 21:06:36.720674 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 741/1453] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:35 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:36.725828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:36.726967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:36.734464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.735090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.736340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.738539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.804405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:36.812298 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2cde9a97-056a-4adb-9e7f-06acec61cec1 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1273 microversion: 2.1 time: 0.090546 Feb 12 21:06:36.812959 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 742/1454] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:36 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:36.825147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2bdebbcd-7692-41f5-893a-de5bedad86a1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "b37f44d3-46f5-4895-8fa7-7d479d4b0ff2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:36.825147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2bdebbcd-7692-41f5-893a-de5bedad86a1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:36.825147 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2bdebbcd-7692-41f5-893a-de5bedad86a1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.005546 Feb 12 21:06:36.825147 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 743/1455] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:36 2022] POST /compute/v2.1/servers => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:06:36.836173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:36.837191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:36.845331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.845980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.846798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.847231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.919243 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d86695f-e46d-4e03-aafb-ef79f5749d51 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.584984 Feb 12 21:06:36.923393 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 713/1456] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:36 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:36.927425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:36.928274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:36.935531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.936477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:36.937509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:36.938131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.032752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:37.051311 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-412c18a0-e526-49e2-be75-45f20c578578 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1472 microversion: 2.1 time: 0.229888 Feb 12 21:06:37.052647 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 744/1457] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:36 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:37.060066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-79aa1397-fe6a-4278-b967-d6d16ab30696 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fe167c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-914908402", "description": "tempest-description-1032801047"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:37.198216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:37.209592 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-485016bb-716b-4c8c-be40-2280e263d001 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.287510 Feb 12 21:06:37.224330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 714/1458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:36 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:37.230855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:37.231632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:37.238755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.244363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.244363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.244363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.598080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:37.613892 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0f9d019-7f68-4ef5-9a5a-a402a7b9418e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.387817 Feb 12 21:06:37.615541 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 715/1459] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:37 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:37.633056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:37.633763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:37.657012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.657940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.658760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.659206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.847832 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-79aa1397-fe6a-4278-b967-d6d16ab30696 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.793528 Feb 12 21:06:37.848565 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 745/1460] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:37.855303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-af8b9dcd-b15c-4ad5-9a28-249f0e95aa78 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:37.856555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-af8b9dcd-b15c-4ad5-9a28-249f0e95aa78 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: e9f09a3d-57d1-444f-ad33-e72e77d76b2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:37.863544 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-af8b9dcd-b15c-4ad5-9a28-249f0e95aa78 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance e9f09a3d-57d1-444f-ad33-e72e77d76b2d could not be found. Feb 12 21:06:37.869775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-af8b9dcd-b15c-4ad5-9a28-249f0e95aa78 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance e9f09a3d-57d1-444f-ad33-e72e77d76b2d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:37.869775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-af8b9dcd-b15c-4ad5-9a28-249f0e95aa78 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/e9f09a3d-57d1-444f-ad33-e72e77d76b2d/action" status: 404 len: 111 microversion: 2.1 time: 0.015883 Feb 12 21:06:37.869775 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 746/1461] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:37 2022] POST /compute/v2.1/servers/e9f09a3d-57d1-444f-ad33-e72e77d76b2d/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:37.872344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:37.873045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:37.880656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.881228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.882175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.882719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.935632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:37.944578 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e428720-1cd3-435c-9fac-29ddda310d35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.327708 Feb 12 21:06:37.945145 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 716/1462] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:37 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:37.950291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:37.951400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:37.958120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.958574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:37.959366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:37.959797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.041111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.052318 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fcd97099-c889-4ad1-b1f5-3046c8678a78 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1291 microversion: 2.1 time: 0.105906 Feb 12 21:06:38.054244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 717/1463] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:37 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:38.069184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c5ea650-547a-4d19-9552-bf6df6111e68 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fe905ee0>, body: {"security_group_rule": {"parent_group_id": "ebcbdd1e-dd90-4531-bb45-b384add04940", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "18efd3cc-030f-448a-acb2-04cf96a373e0"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:38.132256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.143015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.144698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.146145 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e1c276eb-e136-4839-9772-634f20c82f91 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1646 microversion: 2.25 time: 0.278995 Feb 12 21:06:38.146899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 747/1464] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:37 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1646 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:38.169647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:38.170286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:38.176725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.177606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.178608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.179054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.466434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.478896 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88acbfb3-e6a8-4138-9e9c-70efc148e5ae tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.313612 Feb 12 21:06:38.490175 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 748/1465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:38 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:38.499032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:38.500489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:38.508405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.509393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.510979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.511428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.773401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.780582 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c5ea650-547a-4d19-9552-bf6df6111e68 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.724227 Feb 12 21:06:38.781188 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 718/1466] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:06:38 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:38.790284 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb2a2cac-97c3-4382-9caf-1e1d05fa6908 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.290847 Feb 12 21:06:38.790284 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 749/1467] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:38 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:38.790284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:38.790284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:38.795499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.796352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.797574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.798266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.945974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa9f7737-46d0-4ae4-adb9-c29117ded1bc tempest-AbsoluteLimitsTestJSON-1583832798 tempest-AbsoluteLimitsTestJSON-1583832798-project] Calling method '.version_select at 0x7fa8fe905b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:38.963113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa9f7737-46d0-4ae4-adb9-c29117ded1bc tempest-AbsoluteLimitsTestJSON-1583832798 tempest-AbsoluteLimitsTestJSON-1583832798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.963560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa9f7737-46d0-4ae4-adb9-c29117ded1bc tempest-AbsoluteLimitsTestJSON-1583832798 tempest-AbsoluteLimitsTestJSON-1583832798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.964366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa9f7737-46d0-4ae4-adb9-c29117ded1bc tempest-AbsoluteLimitsTestJSON-1583832798 tempest-AbsoluteLimitsTestJSON-1583832798-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:38.964823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa9f7737-46d0-4ae4-adb9-c29117ded1bc tempest-AbsoluteLimitsTestJSON-1583832798 tempest-AbsoluteLimitsTestJSON-1583832798-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:38.979747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:38.990136 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aecfaf8f-4379-49bb-b4f8-7508a4cf63c9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.206163 Feb 12 21:06:38.991653 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 750/1468] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:38 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:38.998304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff7dbde4-2c7f-4a49-bb7e-fe66f9421916 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fdfeac10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1533956789", "description": "tempest-description-924768237"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:38.998597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa9f7737-46d0-4ae4-adb9-c29117ded1bc tempest-AbsoluteLimitsTestJSON-1583832798 tempest-AbsoluteLimitsTestJSON-1583832798-project] 10.222.0.31 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.205823 Feb 12 21:06:38.999931 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 719/1469] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 21:06:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:39.020775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:39.021711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:39.030870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.031640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.032679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.033275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.263509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:39.272411 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ded77251-b51c-4300-86a5-1d2fc26bd2f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.270814 Feb 12 21:06:39.273088 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 720/1470] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:39 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:39.280287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:39.281044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:39.288048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.288491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.292082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.292082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.321872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'flavor' on Instance uuid bb565b3e-86a6-4ab9-b812-5901d747f049 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:39.647160 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff7dbde4-2c7f-4a49-bb7e-fe66f9421916 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.654187 Feb 12 21:06:39.647799 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 751/1471] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:39.652426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:39.653447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:39.659624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.660124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.660980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.661439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.911844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:39.920392 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9252ddd8-bc3d-4285-b315-8e7acd3e852e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.271411 Feb 12 21:06:39.923670 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 752/1472] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:39 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:39.930162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:39.935435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:39.945742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.946237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:39.948651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:39.949680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.180939 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7718fff2-04df-4992-ae36-64193f0a8483 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 202 len: 0 microversion: 2.1 time: 0.906176 Feb 12 21:06:40.181638 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 721/1473] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:39 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:40.187785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-23550b08-4ca0-4711-8a67-7a27d93f64bc tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fec74280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-569990578", "description": "tempest-description-1888079344"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:40.207769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:40.219942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:40.222020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:40.223520 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df51b5a3-5c6d-4f31-8b28-52e5bcdf7b16 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1636 microversion: 2.25 time: 0.296949 Feb 12 21:06:40.224726 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 753/1474] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:39 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1636 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:40.229636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:40.231215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:40.244931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.245442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.246644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.247678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.457244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:40.475558 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9e4cdac2-b173-4a58-9891-d9d42d7f49a9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.249435 Feb 12 21:06:40.476226 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 754/1475] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:40 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:40.484095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:40.484711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:40.495616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.496124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.497892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.498509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.653661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:40.664892 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc63b514-3df6-44e4-9e27-c3abbe0339ef tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.186780 Feb 12 21:06:40.665805 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 755/1476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:40 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:40.671217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51394468-45eb-4ccf-9bf6-18ee8808a573 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '.version_select at 0x7fa8fe0e1280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:40.672660 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:40.672660 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:40.675179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51394468-45eb-4ccf-9bf6-18ee8808a573 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.675883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51394468-45eb-4ccf-9bf6-18ee8808a573 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.691719 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51394468-45eb-4ccf-9bf6-18ee8808a573 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 4470 microversion: 2.25 time: 0.024608 Feb 12 21:06:40.692360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 756/1477] 10.222.0.31 () {60 vars in 1183 bytes} [Sat Feb 12 21:06:40 2022] GET /compute/v2.1/os-migrations => generated 4470 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:40.696716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:40.697601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:40.705322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.705909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.706727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.707172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.864792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:40.870305 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2e7501e-0968-4e4f-be05-7a41eeafa374 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.176894 Feb 12 21:06:40.870875 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 757/1478] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:40 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:40.886295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-909d9fea-0a3a-499f-9c7f-828962c809ec req-e70f7013-eee2-4292-bc11-8b0145c63dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d50fb4-9ee8-417a-8fc9-0b853c37edbf", "tag": "a318a716-17e1-474f-b913-0ba637029c68"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:40.888715 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:40.888715 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:40.896851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-909d9fea-0a3a-499f-9c7f-828962c809ec req-e70f7013-eee2-4292-bc11-8b0145c63dfa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.897295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-909d9fea-0a3a-499f-9c7f-828962c809ec req-e70f7013-eee2-4292-bc11-8b0145c63dfa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.910190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-909d9fea-0a3a-499f-9c7f-828962c809ec req-e70f7013-eee2-4292-bc11-8b0145c63dfa service nova] Creating event network-changed:a318a716-17e1-474f-b913-0ba637029c68 for instance 33d50fb4-9ee8-417a-8fc9-0b853c37edbf on nch2-master-1 Feb 12 21:06:40.917717 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-909d9fea-0a3a-499f-9c7f-828962c809ec req-e70f7013-eee2-4292-bc11-8b0145c63dfa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Feb 12 21:06:40.919429 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 758/1479] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:40.925594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:40.927376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:40.934688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.935361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.936427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.936864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.957385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-23550b08-4ca0-4711-8a67-7a27d93f64bc tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.774099 Feb 12 21:06:40.957947 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 722/1480] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:40.964929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:40.966384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:40.974741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.980540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:40.981966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:40.982436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.118168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:41.133598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43e76152-3291-42ef-bb57-d2b3ce1777b9 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 2128 microversion: 2.25 time: 0.212693 Feb 12 21:06:41.134805 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 759/1481] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:40 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 2128 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:41.142665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-446d543e-113b-4552-9e15-3dd346f32730 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fe161310>, body: {"security_group_rule": {"parent_group_id": "6721f783-2628-4b35-94c5-2a0980daec2e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "07900337-c064-4f8a-9c4b-c02e43af732a"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:41.273434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:41.286400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b3c967f5-db9b-43e2-9df3-8a2206f0f9fb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.326214 Feb 12 21:06:41.298339 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 723/1482] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:40 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:41.306233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:41.306853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:41.317141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.318116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.319087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.319557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.544523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:41.557561 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc7be1f9-8d7a-4866-b418-f8e7ec30cd77 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 2128 microversion: 2.25 time: 0.257649 Feb 12 21:06:41.558140 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 724/1483] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:06:41 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 2128 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:06:41.565057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a560d11f-1750-49c0-a091-f0e6c62e7f92 req-852174fc-36c2-4b60-a76b-1f03a4159ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608f3421-9d47-451f-aab9-8b516d566201", "name": "network-vif-plugged", "status": "completed", "tag": "d12f9147-b8b3-4cc7-ba78-bc82fb796c36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:41.567041 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:41.567041 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:41.575279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a560d11f-1750-49c0-a091-f0e6c62e7f92 req-852174fc-36c2-4b60-a76b-1f03a4159ee3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.575723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a560d11f-1750-49c0-a091-f0e6c62e7f92 req-852174fc-36c2-4b60-a76b-1f03a4159ee3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.589137 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a560d11f-1750-49c0-a091-f0e6c62e7f92 req-852174fc-36c2-4b60-a76b-1f03a4159ee3 service nova] Creating event network-vif-plugged:d12f9147-b8b3-4cc7-ba78-bc82fb796c36 for instance 608f3421-9d47-451f-aab9-8b516d566201 on nch1-master-1 Feb 12 21:06:41.596632 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a560d11f-1750-49c0-a091-f0e6c62e7f92 req-852174fc-36c2-4b60-a76b-1f03a4159ee3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035944 Feb 12 21:06:41.596632 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 725/1484] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:41.602182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:41.602891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:41.617496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.617949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.619237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.619851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.805412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-446d543e-113b-4552-9e15-3dd346f32730 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.666679 Feb 12 21:06:41.806653 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 760/1485] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:06:41 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:41.818353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:41.818353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:41.821628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.822090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.822901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:41.823339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:41.989305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:41.997634 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70e977df-bb64-4d3b-b662-8a53b7662566 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.189319 Feb 12 21:06:41.998217 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 761/1486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:41 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:42.003312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:42.008242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:42.012224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.012745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.013673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.014118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.102552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lazy-loading 'services' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:06:42.170131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:42.177996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-242726ee-3d99-4501-882a-c5c15c77e731 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.580170 Feb 12 21:06:42.178875 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 726/1487] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:41 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:42.183265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63f7eda5-e430-4175-a23f-7aece72cf35b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe9e9160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:42.368177 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5624010f-2a31-4609-96de-f651b6766b0f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments/7de8dc2a-bf78-418c-82bc-d35320770acc" status: 202 len: 0 microversion: 2.25 time: 0.368443 Feb 12 21:06:42.369720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 762/1488] 10.222.0.31 () {60 vars in 1456 bytes} [Sat Feb 12 21:06:41 2022] DELETE /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments/7de8dc2a-bf78-418c-82bc-d35320770acc => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:06:42.377682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:42.378407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:42.391959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.392473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.393320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.396558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.472850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63f7eda5-e430-4175-a23f-7aece72cf35b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/07900337-c064-4f8a-9c4b-c02e43af732a" status: 202 len: 0 microversion: 2.1 time: 0.292598 Feb 12 21:06:42.473475 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 727/1489] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:42 2022] DELETE /compute/v2.1/os-security-groups/07900337-c064-4f8a-9c4b-c02e43af732a => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:42.482861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:42.483480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:42.503450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.504185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.505406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.506009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.582551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:42.590556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15909f3c-6852-4033-8bd0-6a81f3227301 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1315 microversion: 2.1 time: 0.217635 Feb 12 21:06:42.591164 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 763/1490] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:42 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:42.595962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:42.596938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:42.602872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.603327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.604133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:42.604573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:42.639478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccb43bca-45af-47a6-99c7-9e10fdd8ffb0 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.047013 Feb 12 21:06:42.641814 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 764/1491] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:06:42 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:06:42.646179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9670128f-df4a-418c-8463-1df2baa11d35 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe111820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:42.658345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:42.665768 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c48e1bfa-4fa9-4dff-92a5-be42702c86ae tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.191151 Feb 12 21:06:42.666338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 728/1492] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:42 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:42.726621 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9670128f-df4a-418c-8463-1df2baa11d35 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/6721f783-2628-4b35-94c5-2a0980daec2e" status: 200 len: 247 microversion: 2.1 time: 0.083792 Feb 12 21:06:42.727216 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 765/1493] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:06:42 2022] GET /compute/v2.1/os-security-groups/6721f783-2628-4b35-94c5-2a0980daec2e => generated 247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:42.739806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ed66a43b-fd50-4760-874d-17a803e76582 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fea3c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1017870727", "description": "tempest-description-723321165"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:43.016567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:43.017121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:43.023078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.023563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.024353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.024793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.222437 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ed66a43b-fd50-4760-874d-17a803e76582 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.486430 Feb 12 21:06:43.227254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 729/1494] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:43.228150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:43.229006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:43.232614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:43.235482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.236008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.237027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.237484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.242046 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66f846d6-d17f-4ee6-948a-c6a13d1e43e8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.230160 Feb 12 21:06:43.242668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 766/1495] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:43 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:43.247945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10bc43bd-faf6-435d-a82d-58a3d055eb54 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fe167280>, body: {"security_group_rule": {"parent_group_id": "de9fb39f-1fa2-4741-8efc-02f847e03f49", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:43.391945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:43.399303 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ec4f8a4a-8d81-436e-8236-43988e8d3cfe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.175221 Feb 12 21:06:43.399864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 730/1496] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:43 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:43.617848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:43.620592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:43.627063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.627522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.628357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.629062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.675590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10bc43bd-faf6-435d-a82d-58a3d055eb54 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.431424 Feb 12 21:06:43.676250 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 767/1497] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:06:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:43.683840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:43.685849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:43.693865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.694319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.695124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.696080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.738464 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa3e957e-76df-4a12-b1cb-275171ad5676 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.060795 Feb 12 21:06:43.739052 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 768/1498] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:06:43 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:43.744039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34a9b3a5-f04f-496b-8a16-57c10b07166f tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Action: 'create', calling method: .version_select at 0x7fa8fdea2b80>, body: {"security_group_rule": {"parent_group_id": "de9fb39f-1fa2-4741-8efc-02f847e03f49", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:43.798909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:43.816225 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0fa7b546-1159-496d-b423-5a1b5140c8c1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1465 microversion: 2.1 time: 0.212300 Feb 12 21:06:43.821789 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 731/1499] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:43 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1465 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:43.828041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:43.829054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:43.835269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.835726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.836532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:43.836961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:43.991152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:43.998826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a0ea2969-ec02-434d-86c9-ecd835de24ad tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.174631 Feb 12 21:06:43.999389 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 732/1500] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:43 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:44.131287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-779eb2d1-936c-4123-a112-0514f4872b18 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Calling method '.version_select at 0x7fa8fe901310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.154707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-779eb2d1-936c-4123-a112-0514f4872b18 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 591d8895-dfb9-46b1-ae7e-b95385c08420 does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-779eb2d1-936c-4123-a112-0514f4872b18 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Neutron security group 591d8895-dfb9-46b1-ae7e-b95385c08420 not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-779eb2d1-936c-4123-a112-0514f4872b18 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] HTTP exception thrown: Security group 591d8895-dfb9-46b1-ae7e-b95385c08420 does not exist Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-4b99173f-58b5-4499-a14e-f2ece580a127'] Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-779eb2d1-936c-4123-a112-0514f4872b18 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Returning 404 to user: Security group 591d8895-dfb9-46b1-ae7e-b95385c08420 does not exist Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-4b99173f-58b5-4499-a14e-f2ece580a127'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-779eb2d1-936c-4123-a112-0514f4872b18 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/591d8895-dfb9-46b1-ae7e-b95385c08420" status: 404 len: 194 microversion: 2.1 time: 0.156935 Feb 12 21:06:44.159401 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 733/1501] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:43 2022] DELETE /compute/v2.1/os-security-groups/591d8895-dfb9-46b1-ae7e-b95385c08420 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:44.162327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.163122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:44.171765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.172221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.173017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.173481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.306129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8be2d0cf-5eab-48d5-bfd4-afb11a691929 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1616 microversion: 2.1 time: 0.147306 Feb 12 21:06:44.306767 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 734/1502] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:44 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1616 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:44.311854 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e266204-8e06-44f0-80b4-54642de6033b tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004092 Feb 12 21:06:44.316520 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 735/1503] 10.222.0.31 () {58 vars in 1163 bytes} [Sat Feb 12 21:06:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 21:06:44.316891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.322986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:44.333506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.333976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.334839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.335282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.380069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34a9b3a5-f04f-496b-8a16-57c10b07166f tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.639743 Feb 12 21:06:44.380689 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 769/1504] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:06:43 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:44.386787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8d5fafb7-d45f-448e-992c-0ac511736a25 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Calling method '.version_select at 0x7fa8fdfeaee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.495259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:44.503597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c1abf68d-d93c-40bb-97f7-30d841270b36 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.190328 Feb 12 21:06:44.504427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 736/1505] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:44 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:44.508802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-033ee4c9-625a-4054-90da-6d4e12e93cc3 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fea24ee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.539494 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8d5fafb7-d45f-448e-992c-0ac511736a25 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.156731 Feb 12 21:06:44.540712 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 770/1506] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:06:44 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:44.547363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.548310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:44.556329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.557549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.558538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.559529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.567235 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-033ee4c9-625a-4054-90da-6d4e12e93cc3 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/de9fb39f-1fa2-4741-8efc-02f847e03f49" status: 200 len: 664 microversion: 2.1 time: 0.061481 Feb 12 21:06:44.568059 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 737/1507] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:06:44 2022] GET /compute/v2.1/os-security-groups/de9fb39f-1fa2-4741-8efc-02f847e03f49 => generated 664 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:44.572933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2128022186", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "579b174f-d572-49b2-8f60-9e0d62cc450e"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:44.631578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:44.722397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:44.730268 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31ac25f8-e507-4851-8d34-e9d064d99d29 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.187660 Feb 12 21:06:44.749061 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 771/1508] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:44 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:44.762841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c538aad-9593-464e-9c95-ebbd10115f3a tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Calling method '.version_select at 0x7fa8fdfc4dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.899758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-1c538aad-9593-464e-9c95-ebbd10115f3a tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:06:44.899758 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-1c538aad-9593-464e-9c95-ebbd10115f3a tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] HTTP exception thrown: Insufficient rights for removing default security group. Feb 12 21:06:44.899758 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-dceafe4f-da31-41d3-86b2-79b34960ebae'] Feb 12 21:06:44.899758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c538aad-9593-464e-9c95-ebbd10115f3a tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Returning 400 to user: Insufficient rights for removing default security group. Feb 12 21:06:44.899758 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-dceafe4f-da31-41d3-86b2-79b34960ebae'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:44.900625 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c538aad-9593-464e-9c95-ebbd10115f3a tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/608693fd-90d6-4dfa-9441-0f11f3f458ca" status: 400 len: 182 microversion: 2.1 time: 0.148938 Feb 12 21:06:44.901339 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 772/1509] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:44 2022] DELETE /compute/v2.1/os-security-groups/608693fd-90d6-4dfa-9441-0f11f3f458ca => generated 182 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:06:44.908920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1cacfd1-3dc6-4deb-bdab-ad727ffe4edf tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe16d8b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:44.912305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:44.912729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:44.913397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:44.913796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:44.914207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:44.924818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.925263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.926107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:44.926542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:44.946000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:44.952798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Getting quotas for user f254086e0c2c4109ae9b92b80cf84c0a and project 2e3d4a23b3dd48a2a3e78818c60bdf5d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:44.965473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:44.968131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:45.267574 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1cacfd1-3dc6-4deb-bdab-ad727ffe4edf tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-group-rules/a709580e-045d-4080-b69b-08872d8e2389" status: 202 len: 0 microversion: 2.1 time: 0.364972 Feb 12 21:06:45.274325 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 773/1510] 10.222.0.31 () {58 vars in 1286 bytes} [Sat Feb 12 21:06:44 2022] DELETE /compute/v2.1/os-security-group-rules/a709580e-045d-4080-b69b-08872d8e2389 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:45.279894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc07232b-557b-418e-b7e5-89061b5b5230 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Calling method '.version_select at 0x7fa8fe16d940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.292333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-889a3088-5c2b-420e-a54c-f202913e39d7 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722918 Feb 12 21:06:45.293743 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 738/1511] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:45.299956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.301568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:45.311370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:45.312043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:45.313248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:45.313873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:45.315848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-cc07232b-557b-418e-b7e5-89061b5b5230 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2fef22e5-bb2b-4c2f-b746-fa99354d1c58 does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:06:45.316769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-cc07232b-557b-418e-b7e5-89061b5b5230 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Neutron security group 2fef22e5-bb2b-4c2f-b746-fa99354d1c58 not found {{(pid=141726) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:06:45.317290 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cc07232b-557b-418e-b7e5-89061b5b5230 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] HTTP exception thrown: Security group 2fef22e5-bb2b-4c2f-b746-fa99354d1c58 does not exist Feb 12 21:06:45.317290 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-3e284c15-dce3-4cd4-bc3b-925b02b0b4d6'] Feb 12 21:06:45.317909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc07232b-557b-418e-b7e5-89061b5b5230 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Returning 404 to user: Security group 2fef22e5-bb2b-4c2f-b746-fa99354d1c58 does not exist Feb 12 21:06:45.317909 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-3e284c15-dce3-4cd4-bc3b-925b02b0b4d6'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:45.319017 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc07232b-557b-418e-b7e5-89061b5b5230 tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/2fef22e5-bb2b-4c2f-b746-fa99354d1c58" status: 404 len: 194 microversion: 2.1 time: 0.043494 Feb 12 21:06:45.326598 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 774/1512] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:06:45 2022] GET /compute/v2.1/os-security-groups/2fef22e5-bb2b-4c2f-b746-fa99354d1c58 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:45.332199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffd80c7b-1aa1-4fc4-8ccf-cf919ad56224 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe1238b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.517572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:45.535438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63aac23e-9464-4f82-a4f4-6e1307acb724 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.240050 Feb 12 21:06:45.537239 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 739/1513] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:45 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:45.542558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8ba04a27-7d86-4257-9c0f-5b60939add71 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.544192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8ba04a27-7d86-4257-9c0f-5b60939add71 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:45.602785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8ba04a27-7d86-4257-9c0f-5b60939add71 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:45.609674 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8ba04a27-7d86-4257-9c0f-5b60939add71 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1217 microversion: 2.1 time: 0.070977 Feb 12 21:06:45.610241 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 740/1514] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:45 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:45.614675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-014a5e94-57c0-4ca6-b8a2-2c46893119db tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Action: 'update', calling method: .version_select at 0x7fa8fea6ac10>, body: {"security_group": {"name": "tempest-sg-520416540", "description": "tempest-description-971913176"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:45.637621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-014a5e94-57c0-4ca6-b8a2-2c46893119db tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 14b05f60-e42f-4518-a1ad-91a0dd82979c does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-014a5e94-57c0-4ca6-b8a2-2c46893119db tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Neutron security group 14b05f60-e42f-4518-a1ad-91a0dd82979c not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-014a5e94-57c0-4ca6-b8a2-2c46893119db tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] HTTP exception thrown: Security group 14b05f60-e42f-4518-a1ad-91a0dd82979c does not exist Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-27fee504-d584-4712-bebe-ac2e1fdda8e7'] Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-014a5e94-57c0-4ca6-b8a2-2c46893119db tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] Returning 404 to user: Security group 14b05f60-e42f-4518-a1ad-91a0dd82979c does not exist Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-27fee504-d584-4712-bebe-ac2e1fdda8e7'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-014a5e94-57c0-4ca6-b8a2-2c46893119db tempest-SecurityGroupsNegativeTestJSON-1339088573 tempest-SecurityGroupsNegativeTestJSON-1339088573-project] 10.222.0.31 "PUT /compute/v2.1/os-security-groups/14b05f60-e42f-4518-a1ad-91a0dd82979c" status: 404 len: 194 microversion: 2.1 time: 0.029123 Feb 12 21:06:45.643981 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 741/1515] 10.222.0.31 () {60 vars in 1289 bytes} [Sat Feb 12 21:06:45 2022] PUT /compute/v2.1/os-security-groups/14b05f60-e42f-4518-a1ad-91a0dd82979c => generated 194 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:45.649458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.649458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:45.653509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:45.653962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:45.654754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:45.655191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:45.687294 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffd80c7b-1aa1-4fc4-8ccf-cf919ad56224 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/de9fb39f-1fa2-4741-8efc-02f847e03f49" status: 202 len: 0 microversion: 2.1 time: 0.359342 Feb 12 21:06:45.692207 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 775/1516] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:45 2022] DELETE /compute/v2.1/os-security-groups/de9fb39f-1fa2-4741-8efc-02f847e03f49 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:45.697949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c500d0bb-4e10-4463-b567-2481e6d5162e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe111ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.757529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-c500d0bb-4e10-4463-b567-2481e6d5162e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 07900337-c064-4f8a-9c4b-c02e43af732a does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:06:45.758087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-c500d0bb-4e10-4463-b567-2481e6d5162e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Neutron security group 07900337-c064-4f8a-9c4b-c02e43af732a not found {{(pid=141726) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:06:45.760841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c500d0bb-4e10-4463-b567-2481e6d5162e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] HTTP exception thrown: Security group 07900337-c064-4f8a-9c4b-c02e43af732a does not exist Feb 12 21:06:45.760841 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-7d0cb9ac-9e2e-4c8d-886f-19ea7def5b4a'] Feb 12 21:06:45.762537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c500d0bb-4e10-4463-b567-2481e6d5162e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Returning 404 to user: Security group 07900337-c064-4f8a-9c4b-c02e43af732a does not exist Feb 12 21:06:45.762537 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-7d0cb9ac-9e2e-4c8d-886f-19ea7def5b4a'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:45.764104 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c500d0bb-4e10-4463-b567-2481e6d5162e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/07900337-c064-4f8a-9c4b-c02e43af732a" status: 404 len: 194 microversion: 2.1 time: 0.070584 Feb 12 21:06:45.766649 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 776/1517] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:45 2022] DELETE /compute/v2.1/os-security-groups/07900337-c064-4f8a-9c4b-c02e43af732a => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:45.771721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:45.772342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:45.780726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:45.781120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:45.781952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:45.782569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:45.869094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:45.879233 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f27945ea-3c9f-483b-8d98-25715282abaf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.236436 Feb 12 21:06:45.879391 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 742/1518] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:45 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:45.887248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e3bb963-1566-434e-8461-a638510d0d1b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fea7bca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:46.006673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:46.014676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-377fa9aa-b474-426d-9997-67efc739500e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.246561 Feb 12 21:06:46.015234 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 777/1519] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:45 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:46.185316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e3bb963-1566-434e-8461-a638510d0d1b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/6721f783-2628-4b35-94c5-2a0980daec2e" status: 202 len: 0 microversion: 2.1 time: 0.304503 Feb 12 21:06:46.188973 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 743/1520] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:45 2022] DELETE /compute/v2.1/os-security-groups/6721f783-2628-4b35-94c5-2a0980daec2e => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:46.197479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffdfa7f5-498e-4c2d-ac09-8e9e200df347 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe0e95e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:46.554776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:46.555688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:46.564056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.565071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:46.566452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.567428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:46.673221 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffdfa7f5-498e-4c2d-ac09-8e9e200df347 tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/18efd3cc-030f-448a-acb2-04cf96a373e0" status: 202 len: 0 microversion: 2.1 time: 0.481492 Feb 12 21:06:46.674066 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 778/1521] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:46 2022] DELETE /compute/v2.1/os-security-groups/18efd3cc-030f-448a-acb2-04cf96a373e0 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:46.694264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:46.701608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:46.714440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.715712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:46.719594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.720985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:46.725382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:46.737617 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f33e811-4b76-4a13-a1dc-87e71ddfd947 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.187444 Feb 12 21:06:46.747189 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 744/1522] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:46 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:46.790383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be003027-fc7e-4e4f-bb5e-99b67af1151b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fec17af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:46.817656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:46.833174 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e8a43f57-bd7b-4d1c-9732-87ff571d4a48 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1221 microversion: 2.1 time: 0.156970 Feb 12 21:06:46.835138 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 779/1523] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:46 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:46.862533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-68ae1a23-4494-40c5-952e-2c2f64b14859 req-cb700601-5d8d-4ed1-ab6a-fb067ae8c3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d50fb4-9ee8-417a-8fc9-0b853c37edbf", "name": "network-vif-plugged", "status": "completed", "tag": "a318a716-17e1-474f-b913-0ba637029c68"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:46.866977 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:46.866977 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:46.884650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-68ae1a23-4494-40c5-952e-2c2f64b14859 req-cb700601-5d8d-4ed1-ab6a-fb067ae8c3fa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.884650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-68ae1a23-4494-40c5-952e-2c2f64b14859 req-cb700601-5d8d-4ed1-ab6a-fb067ae8c3fa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:46.905113 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-68ae1a23-4494-40c5-952e-2c2f64b14859 req-cb700601-5d8d-4ed1-ab6a-fb067ae8c3fa service nova] Creating event network-vif-plugged:a318a716-17e1-474f-b913-0ba637029c68 for instance 33d50fb4-9ee8-417a-8fc9-0b853c37edbf on nch2-master-1 Feb 12 21:06:46.913638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-68ae1a23-4494-40c5-952e-2c2f64b14859 req-cb700601-5d8d-4ed1-ab6a-fb067ae8c3fa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056336 Feb 12 21:06:46.914738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 780/1524] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:06:46.924656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:46.925966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:46.937444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.938279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:46.939842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:46.940892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.184933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:47.192823 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8113da2c-944d-4fef-84b7-f038fd0140c2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.276163 Feb 12 21:06:47.196485 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 781/1525] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:46 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:47.198453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:47.199104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:47.205087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:47.205567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.207539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:47.207855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.220013 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be003027-fc7e-4e4f-bb5e-99b67af1151b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/ebcbdd1e-dd90-4531-bb45-b384add04940" status: 202 len: 0 microversion: 2.1 time: 0.467833 Feb 12 21:06:47.220013 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 745/1526] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:46 2022] DELETE /compute/v2.1/os-security-groups/ebcbdd1e-dd90-4531-bb45-b384add04940 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:47.227218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cc215b33-e3bd-49bc-827c-a80cfb7bf82e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fea6a280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:47.441747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:47.451517 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6d50099-bcc3-4d06-b041-e8573fe2bd8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.257002 Feb 12 21:06:47.452211 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 782/1527] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:47 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:47.538483 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cc215b33-e3bd-49bc-827c-a80cfb7bf82e tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/9482fb68-0c3a-43da-ab1e-c9131db26487" status: 202 len: 0 microversion: 2.1 time: 0.314786 Feb 12 21:06:47.543996 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 746/1528] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:47 2022] DELETE /compute/v2.1/os-security-groups/9482fb68-0c3a-43da-ab1e-c9131db26487 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:06:47.547457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5da0258-2012-4bea-993e-81e3fe35c82b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] Calling method '.version_select at 0x7fa8fe024dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:47.756335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:47.756972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:47.764967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:47.765456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.766332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:47.766775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.860905 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5da0258-2012-4bea-993e-81e3fe35c82b tempest-SecurityGroupRulesTestJSON-1847373849 tempest-SecurityGroupRulesTestJSON-1847373849-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/34f27a0f-5bf1-4284-9c84-dfb6046989b0" status: 202 len: 0 microversion: 2.1 time: 0.310877 Feb 12 21:06:47.860905 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 783/1529] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:06:47 2022] DELETE /compute/v2.1/os-security-groups/34f27a0f-5bf1-4284-9c84-dfb6046989b0 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:06:47.860905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:47.860905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:47.868487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:47.869380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.870691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:47.871791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:47.917664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:47.987842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:48.043605 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19e0da23-43c0-49e8-840d-ee6b7233388a tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1321 microversion: 2.1 time: 0.291982 Feb 12 21:06:48.043843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71fc5c36-33a5-4a7d-8261-f8652ae1cd4c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1269 microversion: 2.1 time: 0.186981 Feb 12 21:06:48.044217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 747/1530] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:47 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:48.044637 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 784/1531] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:47 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:48.210705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:48.215737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:48.217300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:48.218020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:48.219099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:48.219314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:48.471532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:48.472777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:48.480531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:48.481999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:48.482904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:48.483381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:48.494115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:48.502378 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2f380512-b8d6-4b9e-9535-3f9d6dd0de9a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.295061 Feb 12 21:06:48.503002 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 748/1532] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:48 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:48.676149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:48.684917 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e51f25f5-7195-43e5-a75f-1fc8d503db8c tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.218343 Feb 12 21:06:48.695025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 785/1533] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:48 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:49.062600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:49.075313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:49.076593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:49.077580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:49.088677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.106245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.106245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.106245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.106626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.106626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.106626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.106626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.367529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:49.379673 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c96c902a-5ae2-4f83-8ddf-cd001bf7e6cb tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1469 microversion: 2.1 time: 0.323329 Feb 12 21:06:49.381120 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 749/1534] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:49 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:49.513027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:49.522317 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-32c73845-e0a1-4390-bf14-24bf8875ce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.464202 Feb 12 21:06:49.526950 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 786/1535] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:49 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:49.541339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:49.542572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:49.558308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.560350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.562532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.571067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.777788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cdbf63c-5362-4e6e-9fe6-89632806b1b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:49.778888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cdbf63c-5362-4e6e-9fe6-89632806b1b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] [instance: a6491547-8c37-4bae-91a3-ac4c52b7af9a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:49.784676 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7cdbf63c-5362-4e6e-9fe6-89632806b1b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] HTTP exception thrown: Instance a6491547-8c37-4bae-91a3-ac4c52b7af9a could not be found. Feb 12 21:06:49.785226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cdbf63c-5362-4e6e-9fe6-89632806b1b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Returning 404 to user: Instance a6491547-8c37-4bae-91a3-ac4c52b7af9a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:06:49.786359 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7cdbf63c-5362-4e6e-9fe6-89632806b1b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/a6491547-8c37-4bae-91a3-ac4c52b7af9a/action" status: 404 len: 111 microversion: 2.1 time: 0.389674 Feb 12 21:06:49.787464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 750/1536] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:06:49 2022] POST /compute/v2.1/servers/a6491547-8c37-4bae-91a3-ac4c52b7af9a/action => generated 111 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:06:49.811617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:49.813515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:49.830690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.831442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.836198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:49.836198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:49.901852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:49.911710 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c93b8fce-3a81-465e-b5f7-9e443083d27c tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.383026 Feb 12 21:06:49.915542 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 787/1537] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:49 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:49.926795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1359526803", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:50.009630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:50.182699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:50.192729 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb2403ca-ffd5-4946-8e5a-6a792e91ae66 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.390045 Feb 12 21:06:50.195943 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 751/1538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:49 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:50.407357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:50.408512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:50.409206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:50.410118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:50.410998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:50.423284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.424092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.425881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.431329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.447136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Getting quotas for project e182ad91ab97452284bae777d54ec83d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:50.458444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Getting quotas for user 2953a6e295b345d0a7d571a023562671 and project e182ad91ab97452284bae777d54ec83d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:50.474686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:50.478494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:50.544344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:50.544963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:50.556102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.557748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.559777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.560632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.773312 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc84d35c-a6b6-46ad-9be9-9962f16dc496 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851772 Feb 12 21:06:50.777591 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 788/1539] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:50.788260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ed4be55b-b3eb-4e08-a298-35b3862de7da req-6f0085b8-68d7-41f7-93d5-a207c27527d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a28a325-2d79-47b8-824d-719cd96e9007", "tag": "52f67d81-1a0f-47b3-a26d-1d81adc54066"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:50.792439 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:50.792439 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:06:50.799737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ed4be55b-b3eb-4e08-a298-35b3862de7da req-6f0085b8-68d7-41f7-93d5-a207c27527d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.800314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ed4be55b-b3eb-4e08-a298-35b3862de7da req-6f0085b8-68d7-41f7-93d5-a207c27527d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.838749 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ed4be55b-b3eb-4e08-a298-35b3862de7da req-6f0085b8-68d7-41f7-93d5-a207c27527d1 service nova] Creating event network-changed:52f67d81-1a0f-47b3-a26d-1d81adc54066 for instance 5a28a325-2d79-47b8-824d-719cd96e9007 on nch2-master-1 Feb 12 21:06:50.844029 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ed4be55b-b3eb-4e08-a298-35b3862de7da req-6f0085b8-68d7-41f7-93d5-a207c27527d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064931 Feb 12 21:06:50.846471 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 789/1540] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:50.861868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-91f34f1f-d6d4-410b-8cf3-1828a2836de2 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:50.861868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-91f34f1f-d6d4-410b-8cf3-1828a2836de2 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:50.933474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-91f34f1f-d6d4-410b-8cf3-1828a2836de2 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:50.942692 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-91f34f1f-d6d4-410b-8cf3-1828a2836de2 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1222 microversion: 2.1 time: 0.093282 Feb 12 21:06:50.951934 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 790/1541] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:50 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:50.958205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:50.958205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:50.966152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.966892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.967789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:50.968303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:50.992363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:51.017635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1e10dca9-5a17-48ae-bba4-0ca4c697ef61 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.476213 Feb 12 21:06:51.018898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 752/1542] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:50 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:51.149912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:51.158856 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f164c42d-401a-4979-94e7-101c2b918d88 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1533 microversion: 2.1 time: 0.205823 Feb 12 21:06:51.159445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 791/1543] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:50 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1533 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:51.212717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:51.213654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:51.222604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:51.223062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:51.223869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:51.224312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:51.567021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:51.577939 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f16d7a5c-2215-4766-ad43-7be6ff203e49 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.369342 Feb 12 21:06:51.578941 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 753/1544] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:51 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:51.960963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9153e74-c841-4729-9b21-9c6c9603d816 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:51.967127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9153e74-c841-4729-9b21-9c6c9603d816 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:52.038368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:52.040408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:52.050940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:52.051713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:52.053567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:52.054210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:52.266988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9153e74-c841-4729-9b21-9c6c9603d816 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:52.274511 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9153e74-c841-4729-9b21-9c6c9603d816 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1222 microversion: 2.1 time: 0.319000 Feb 12 21:06:52.284622 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 792/1545] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:51 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1222 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:52.289623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:52.290487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:52.297831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:52.298796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:52.300437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:52.301207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:52.302182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:52.310891 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f389ee2e-7f4b-4b2d-bd2d-9ab0bc3c42a1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.278025 Feb 12 21:06:52.314102 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 754/1546] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:52 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:52.440363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:52.447809 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-11f96178-d9f7-4491-9203-a244c4b19c83 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1533 microversion: 2.1 time: 0.161815 Feb 12 21:06:52.448362 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 793/1547] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:52 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1533 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:52.596262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:52.597066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:52.606360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:52.607643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:52.608635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:52.609228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:52.826237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:52.836729 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8909f834-da22-4798-af4f-c6faed49cb19 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.244029 Feb 12 21:06:52.838064 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 755/1548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:52 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:53.291839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:53.292463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:53.300819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:53.301282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:53.302224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:53.302739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:53.332065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:53.332658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:53.348692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:53.349446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:53.350495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:53.351120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:53.783478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:53.789587 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-297c475f-0173-477b-a442-2247132c1735 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1274 microversion: 2.1 time: 0.501397 Feb 12 21:06:53.790878 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 794/1549] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:53 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1274 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:53.799791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:53.800840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:53.815054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:53.816129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:53.817274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:53.818011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:54.093097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:54.104636 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36f8e995-9b9a-40de-a853-e70bf58c9908 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1533 microversion: 2.1 time: 0.312296 Feb 12 21:06:54.105877 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 795/1550] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:53 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1533 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:54.115236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:54.120349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:54.126827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:54.127485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:54.128582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:54.129488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:54.168833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:54.188360 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-caeb7d6b-4abf-4bcd-b049-dbb28d1232c4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.864081 Feb 12 21:06:54.190885 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 756/1551] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:53 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:54.365182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a04af478-07dd-44b1-ac41-5f45430fde66 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fe8aba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-283687624", "description": "tempest-description-577070729"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:54.385153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:54.394943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97d85097-60ec-459c-b8d5-98ea744fc456 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.287821 Feb 12 21:06:54.406205 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 796/1552] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:54 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:54.807329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:54.808155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:54.818208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:54.830219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:54.833345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:54.833345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:54.914369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:54.924229 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9092d7f8-4ab7-4204-b1a6-b6c49b84eb2e tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1280 microversion: 2.1 time: 0.121381 Feb 12 21:06:54.926205 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 797/1553] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:54 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:06:55.117251 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a04af478-07dd-44b1-ac41-5f45430fde66 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.868685 Feb 12 21:06:55.118464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 757/1554] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:06:55.133144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:55.133939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:55.135503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7eb40b0e-2266-4ae5-99a1-37cad74cfafa tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fe8ab700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1003739601", "description": "tempest-description-1816004786"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:55.150412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:55.151047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:55.152007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:55.152776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:55.868427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:55.878461 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eda51462-6f99-452c-aec0-6dd6af71f4b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.751633 Feb 12 21:06:55.893449 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 798/1555] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:55 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:55.902777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:55.905189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:55.918887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:55.921985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:55.927166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:55.927920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.070246 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7eb40b0e-2266-4ae5-99a1-37cad74cfafa tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.943414 Feb 12 21:06:56.080028 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 758/1556] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:06:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:56.083809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:56.084679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:56.099972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.100700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.102797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.103984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.392891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:56.402923 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f8133f1d-461d-47bc-84ba-5282ffbcdd77 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.329825 Feb 12 21:06:56.405516 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 759/1557] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:56 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:56.410227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2181a280-4e95-4f68-ac23-034b128be378 req-13db9c0b-bd9f-4914-8bf9-ea28b763a269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb565b3e-86a6-4ab9-b812-5901d747f049", "name": "network-vif-plugged", "status": "completed", "tag": "ec357ac8-2d34-44cb-8ba8-0821decd9e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:56.414724 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:56.414724 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:56.434284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2181a280-4e95-4f68-ac23-034b128be378 req-13db9c0b-bd9f-4914-8bf9-ea28b763a269 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.438759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2181a280-4e95-4f68-ac23-034b128be378 req-13db9c0b-bd9f-4914-8bf9-ea28b763a269 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.465377 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2181a280-4e95-4f68-ac23-034b128be378 req-13db9c0b-bd9f-4914-8bf9-ea28b763a269 service nova] Creating event network-vif-plugged:ec357ac8-2d34-44cb-8ba8-0821decd9e9a for instance bb565b3e-86a6-4ab9-b812-5901d747f049 on nch2-master-1 Feb 12 21:06:56.479848 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2181a280-4e95-4f68-ac23-034b128be378 req-13db9c0b-bd9f-4914-8bf9-ea28b763a269 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072869 Feb 12 21:06:56.481585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 760/1558] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:56.491305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:56.498200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:56.513115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.514643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.515765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.516900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.677839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:56.703354 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c0b5e01-855a-4a38-9d99-091d3202ac28 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.808569 Feb 12 21:06:56.713768 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 799/1559] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:55 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:56.716202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1506702438", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "500b8539-c5e5-4f3e-8048-ff853db68c9e"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:56.803761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] validate_networks() for [('500b8539-c5e5-4f3e-8048-ff853db68c9e', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:06:56.845801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:56.854102 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e7674cf-b975-41b0-80d5-ec2c1856eccd tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.371098 Feb 12 21:06:56.854747 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 761/1560] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:56 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:56.896368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:56.897193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:56.904487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.908460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:56.910433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:56.910880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.249755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:57.261680 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5fc2fb5-a795-4dc9-8181-0a93806e117f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.369191 Feb 12 21:06:57.272519 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 762/1561] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:56 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:57.428612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:57.429250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:57.446414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:57.451938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.453577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:57.454526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.803381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:57.804571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:06:57.806259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:06:57.806926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:06:57.807745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:06:57.809733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:06:57.816718 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da77cd49-311e-47c3-b047-ed5b9a2c5fbc tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.394969 Feb 12 21:06:57.817608 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 763/1562] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:57 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:57.836554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:57.842808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:57.843569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.844990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:57.845330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:57.846239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.861454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:57.870658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.870658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:57.870658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:57.910694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Getting quotas for project 225507fa1fa946aa9559a89fe27569b3. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:06:57.918734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Getting quotas for user e6167cc3c6664a01adb3a4ac3118fc38 and project 225507fa1fa946aa9559a89fe27569b3. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:06:57.935795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:06:57.939363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:06:58.180907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:58.197008 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45491a05-a1d8-41b9-84f5-aa61b8878b00 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488663 Feb 12 21:06:58.198245 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 800/1563] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:06:58.203989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:58.204816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:58.219826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.220598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:58.222264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.223718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:58.235056 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9fc2221d-2836-4a8c-91e3-45170ff80696 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.401085 Feb 12 21:06:58.247117 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 764/1564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:57 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:58.268268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bde3649e-8b66-42b1-b6ac-02a32184c42d req-00ec67e0-3910-4cbe-832c-829b96ca2f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e945404b-2162-40c7-a141-3290a269d450", "tag": "a0baed29-10f3-48fe-b214-5e1ef2af8973"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:58.281577 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:58.281577 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:58.299329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bde3649e-8b66-42b1-b6ac-02a32184c42d req-00ec67e0-3910-4cbe-832c-829b96ca2f87 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.300036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bde3649e-8b66-42b1-b6ac-02a32184c42d req-00ec67e0-3910-4cbe-832c-829b96ca2f87 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:58.319351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bde3649e-8b66-42b1-b6ac-02a32184c42d req-00ec67e0-3910-4cbe-832c-829b96ca2f87 service nova] Creating event network-changed:a0baed29-10f3-48fe-b214-5e1ef2af8973 for instance e945404b-2162-40c7-a141-3290a269d450 on nch1-master-1 Feb 12 21:06:58.329827 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bde3649e-8b66-42b1-b6ac-02a32184c42d req-00ec67e0-3910-4cbe-832c-829b96ca2f87 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081328 Feb 12 21:06:58.331017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 765/1565] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:58.338365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ead9bec0-0fcc-410c-b70c-a00c8c9d1007 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:58.339410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ead9bec0-0fcc-410c-b70c-a00c8c9d1007 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:58.415034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ead9bec0-0fcc-410c-b70c-a00c8c9d1007 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:58.438240 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ead9bec0-0fcc-410c-b70c-a00c8c9d1007 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1216 microversion: 2.1 time: 0.105738 Feb 12 21:06:58.450961 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 766/1566] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:58 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:58.457812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:58.458266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:58.476938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.477419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:58.481200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.481200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:58.834054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:58.849181 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6b8fb6eb-c74f-4b92-9028-aaf894624e48 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.645814 Feb 12 21:06:58.849952 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 801/1567] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:58 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:58.855883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:58.861178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:58.862059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:58.877863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.880209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63c2d195-782f-438f-b20e-f39858452c8a tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.422470 Feb 12 21:06:58.880930 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 767/1568] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:58 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:58.881942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:58.883407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:58.893603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.220588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-71a994bd-b30c-4b80-9849-8cf5ce28ddeb req-7d9d9884-9660-412e-9cb7-3b645a50eb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a28a325-2d79-47b8-824d-719cd96e9007", "name": "network-vif-plugged", "status": "completed", "tag": "52f67d81-1a0f-47b3-a26d-1d81adc54066"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:06:59.225933 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:06:59.225933 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:06:59.237804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-71a994bd-b30c-4b80-9849-8cf5ce28ddeb req-7d9d9884-9660-412e-9cb7-3b645a50eb8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.238281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-71a994bd-b30c-4b80-9849-8cf5ce28ddeb req-7d9d9884-9660-412e-9cb7-3b645a50eb8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.262920 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-71a994bd-b30c-4b80-9849-8cf5ce28ddeb req-7d9d9884-9660-412e-9cb7-3b645a50eb8b service nova] Creating event network-vif-plugged:52f67d81-1a0f-47b3-a26d-1d81adc54066 for instance 5a28a325-2d79-47b8-824d-719cd96e9007 on nch2-master-1 Feb 12 21:06:59.270945 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-71a994bd-b30c-4b80-9849-8cf5ce28ddeb req-7d9d9884-9660-412e-9cb7-3b645a50eb8b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053790 Feb 12 21:06:59.272590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 768/1569] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:06:59.290285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:59.290285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:59.301388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.301852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.302652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.303276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.442810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:59.468987 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7be3474c-39b0-44dc-b564-f28b51e9f476 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.610409 Feb 12 21:06:59.474543 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 802/1570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:58 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:59.507702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-236954c7-4246-44bb-b81b-20eb1ab6b247 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:59.508344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-236954c7-4246-44bb-b81b-20eb1ab6b247 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:59.776917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:59.790647 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a12e1279-e722-4a61-987a-97791e8cb742 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.516384 Feb 12 21:06:59.802494 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 769/1571] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:59 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:59.812651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-236954c7-4246-44bb-b81b-20eb1ab6b247 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:06:59.827041 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-236954c7-4246-44bb-b81b-20eb1ab6b247 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1216 microversion: 2.1 time: 0.338134 Feb 12 21:06:59.828171 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 803/1572] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:59 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1216 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:06:59.866564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:59.867435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:59.876436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.877169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.879743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.881010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.898148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:06:59.898831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:06:59.920452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.920929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:06:59.921808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:06:59.922253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:00.173631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:00.185832 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3ded6e1-6f2e-4c5f-9403-25ebcd575847 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.322764 Feb 12 21:07:00.186908 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 770/1573] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:59 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:00.491686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:00.492375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:00.499431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:00.500130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:00.501085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:00.501713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:00.751296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:00.751667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:00.771506 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-44717559-6103-470a-88dc-b77105c19f43 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.877034 Feb 12 21:07:00.783601 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 804/1574] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:06:59 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:00.784176 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6435b82-41cf-4ba3-8366-f5cce610b099 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.295511 Feb 12 21:07:00.785538 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 771/1575] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:00 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:00.819786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:00.820795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:00.838391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:00.839479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:00.841448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:00.845708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:00.848960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:00.851642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:00.864188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:00.864654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:00.884665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:00.885672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:01.007465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:01.016638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2d9a2e4d-8dd9-4ff7-bd21-33e0649a55ca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1212 microversion: 2.1 time: 0.175049 Feb 12 21:07:01.018096 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 772/1576] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:00 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:01.209281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:01.211431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:01.230660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:01.233410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:01.233410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:01.233410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:01.568476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:01.576431 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d92bb23f-5d6e-4f58-b44d-33fd97563d39 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.371203 Feb 12 21:07:01.582518 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 773/1577] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:01 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:01.615879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:01.624365 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-63b5fe9f-1287-4066-8364-c4e00bd7568c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1317 microversion: 2.1 time: 0.813626 Feb 12 21:07:01.634387 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 805/1578] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:00 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:01.795890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:01.795890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:01.801652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:01.802303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:01.812972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:01.818614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:01.818758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:01.818758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:01.824699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:01.825170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:01.826837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:01.827481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:02.115296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:02.124362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-74f63d1c-865c-41a5-9ce3-2617ddb8eaab tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.338493 Feb 12 21:07:02.135222 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 774/1579] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:01 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:02.140854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:02.141856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:02.148804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:02.149563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:02.150615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:02.151305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:02.194647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:02.204313 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-425c089c-7923-4204-a13b-b0f30fa724c8 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.407346 Feb 12 21:07:02.206072 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 806/1580] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:01 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:02.250226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:02.259705 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b7fd66ce-9800-460d-a83f-39afd03ee57b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1276 microversion: 2.1 time: 0.122435 Feb 12 21:07:02.266078 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 775/1581] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:02 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:02.327682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4e4dafb-69e1-48f2-9fbe-d5ea0ce5db41 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Action: 'create', calling method: .version_select at 0x7fa8fe161dc0>, body: {"keypair": {"name": "tempest-keypair-134015399"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:02.356010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-c4e4dafb-69e1-48f2-9fbe-d5ea0ce5db41 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for project a19875f98800434db2950efcf23ff3a4. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:02.356010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-c4e4dafb-69e1-48f2-9fbe-d5ea0ce5db41 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for user a3d2b0036a1144a4a385b4c0fd4f9782 and project a19875f98800434db2950efcf23ff3a4. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:02.599401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:02.600067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:02.608109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:02.608564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:02.609383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:02.609828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:02.756453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-c4e4dafb-69e1-48f2-9fbe-d5ea0ce5db41 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for project a19875f98800434db2950efcf23ff3a4. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:02.762522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-c4e4dafb-69e1-48f2-9fbe-d5ea0ce5db41 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for user a3d2b0036a1144a4a385b4c0fd4f9782 and project a19875f98800434db2950efcf23ff3a4. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:02.768762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:02.778047 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-713f022a-419d-4176-b450-333659f55c87 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.181306 Feb 12 21:07:02.780040 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 776/1582] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:02 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:02.792614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:02.794584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:02.796027 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4e4dafb-69e1-48f2-9fbe-d5ea0ce5db41 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.585328 Feb 12 21:07:02.797167 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 807/1583] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:07:02 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:02.820456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:02.821885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:02.824275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:02.825799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.090908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:03.103208 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72d89777-0d4a-48f2-9c1b-26960743543d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1467 microversion: 2.1 time: 0.320618 Feb 12 21:07:03.104093 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 777/1584] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:02 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1467 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:03.120910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:03.122260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:03.132925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.135857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.137407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.140323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.146864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:03.147591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:03.176180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.176822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.177675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.178121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.572326 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d5069f9-55cc-460a-a16b-ff9dc9c05d85 tempest-ServersOnMultiNodesTest-2060924482 tempest-ServersOnMultiNodesTest-2060924482-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1618 microversion: 2.1 time: 0.455241 Feb 12 21:07:03.572996 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 808/1585] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:03 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1618 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:03.587622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:03.587622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:03.605603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.606577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.606878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.607333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.621905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:03.652286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2e49a9c-9784-44ba-ae54-13b1658e8429 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.512334 Feb 12 21:07:03.653492 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 778/1586] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:03 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:03.661173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:03.662319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:03.672028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.675289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.675289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:03.676052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:03.940680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:03.957714 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-66b02c96-cf5a-4aa2-8a3f-81f6ea74c6fd tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.302133 Feb 12 21:07:03.977590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 779/1587] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:03 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:03.993162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:03.997213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:04.010813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:04.019295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.019630 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a2703b1d-1cc3-4a8c-a212-2aa03bac3ab3 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.446104 Feb 12 21:07:04.030007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 809/1588] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:03 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:04.030238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.030238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.030238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.030732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:04.030732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:04.034940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.047854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.047854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.047854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.078087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:04.535832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:04.557201 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86568125-de3b-4cb8-8b23-715d091758e3 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.531513 Feb 12 21:07:04.563399 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 810/1589] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:04 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:04.626212 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98af8686-a264-4e44-b134-cc8d25267cb8 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 204 len: 0 microversion: 2.1 time: 0.645776 Feb 12 21:07:04.629762 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 780/1590] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:03 2022] DELETE /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:04.636534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:04.637861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:04.650378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.651038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.652724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.653441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.671508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:04.672365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:04.685255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.685554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.686561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.692632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.897099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:04.899270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9441c37f-cb9a-4e63-bff0-4c4cab15ae59 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.232976 Feb 12 21:07:04.900358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 781/1591] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:04 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:04.982540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:04.983929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:04.992204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:04.992913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:04.998932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:05.006242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.014096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:05.017058 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40c16bd3-64f1-4876-a5e5-5c23fdee9cc1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1473 microversion: 2.1 time: 0.383930 Feb 12 21:07:05.024163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 811/1592] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:04 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:05.039805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:05.040770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:05.057315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.058864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:05.059906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.060562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:05.351479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:05.362980 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4c2f336d-56ac-4b7e-ae81-6aeb4273d23b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.384380 Feb 12 21:07:05.365405 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 782/1593] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:04 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:05.578062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:05.582256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:05.586641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.587253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:05.588729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.591147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:05.692370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:05.704906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0226e63d-3260-4d69-a49c-77d92f22659a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.668655 Feb 12 21:07:05.708833 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 812/1594] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:05 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:05.894124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:05.903512 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5d588e8-7a25-42b2-a3bd-a8124b48820c tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.329521 Feb 12 21:07:05.904486 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 783/1595] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:05 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:05.922364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:05.924663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:05.964196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.972672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:05.975436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:05.976096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.039899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:06.040531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:06.059079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.060320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.061146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.061621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.312914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:06.323369 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a31fc86-e330-4d19-a4fa-600167a68a96 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.407824 Feb 12 21:07:06.326773 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 813/1596] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:05 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:06.333446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bdf4f577-d9a4-4ee3-8d96-fcfff8258bc2 req-2fd73a5d-5ed0-4835-a308-a7ded8344cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08416797-b31e-4ab0-af14-a13d93df3fb0", "tag": "0e5d31bf-1299-4108-a791-2a97cebb0d4f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:06.339334 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:06.339334 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:06.349162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bdf4f577-d9a4-4ee3-8d96-fcfff8258bc2 req-2fd73a5d-5ed0-4835-a308-a7ded8344cc0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.352842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bdf4f577-d9a4-4ee3-8d96-fcfff8258bc2 req-2fd73a5d-5ed0-4835-a308-a7ded8344cc0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.406111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bdf4f577-d9a4-4ee3-8d96-fcfff8258bc2 req-2fd73a5d-5ed0-4835-a308-a7ded8344cc0 service nova] Creating event network-changed:0e5d31bf-1299-4108-a791-2a97cebb0d4f for instance 08416797-b31e-4ab0-af14-a13d93df3fb0 on nch1-master-1 Feb 12 21:07:06.413744 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bdf4f577-d9a4-4ee3-8d96-fcfff8258bc2 req-2fd73a5d-5ed0-4835-a308-a7ded8344cc0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085283 Feb 12 21:07:06.414589 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 814/1597] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:06.420890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:06.421934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:06.429065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.429770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.430822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.431440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.653370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:06.684865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-619c13d1-430b-40da-992d-c0326628255c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1473 microversion: 2.1 time: 0.648309 Feb 12 21:07:06.692661 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 784/1598] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:06 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1473 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:06.724323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:06.726486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:06.750868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.754434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:06.755893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:06.756372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.060396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:07.064766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:07.077402 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8fd172dc-bcd3-40a2-8416-807355370bbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.661236 Feb 12 21:07:07.083159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5bdee446-ccfc-4f71-8fe3-2b39a4bfab1a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.365094 Feb 12 21:07:07.085379 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 815/1599] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:06 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:07.090148 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 785/1600] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:06 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:07.102213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:07.103128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:07.111903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.112719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.113711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.114329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.416304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2903825d-6d2b-4f75-ad2f-538985ed3745 req-6423b2d1-a2e2-4eb6-985f-32d466a37e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a28a325-2d79-47b8-824d-719cd96e9007", "name": "network-vif-deleted", "tag": "52f67d81-1a0f-47b3-a26d-1d81adc54066"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:07.420206 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:07.420206 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:07.436428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2903825d-6d2b-4f75-ad2f-538985ed3745 req-6423b2d1-a2e2-4eb6-985f-32d466a37e99 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.439819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2903825d-6d2b-4f75-ad2f-538985ed3745 req-6423b2d1-a2e2-4eb6-985f-32d466a37e99 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.469897 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2903825d-6d2b-4f75-ad2f-538985ed3745 req-6423b2d1-a2e2-4eb6-985f-32d466a37e99 service nova] Creating event network-vif-deleted:52f67d81-1a0f-47b3-a26d-1d81adc54066 for instance 5a28a325-2d79-47b8-824d-719cd96e9007 on nch2-master-1 Feb 12 21:07:07.477397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2903825d-6d2b-4f75-ad2f-538985ed3745 req-6423b2d1-a2e2-4eb6-985f-32d466a37e99 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219552 Feb 12 21:07:07.478741 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 786/1601] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:07:07.486390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:07.487671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:07.494730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.496471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.504472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.505250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.759080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:07.770056 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8321d7de-778c-46af-bfa9-9a8055490649 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.289794 Feb 12 21:07:07.773110 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 787/1602] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:07 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:07.796638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:07.796810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:07.818586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.819078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.820537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.820984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.896650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:07.897767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:07.898396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lazy-loading 'fault' on Instance uuid 5a28a325-2d79-47b8-824d-719cd96e9007 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:07.968785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:07.981698 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb366d4c-9a94-4a47-80a6-e109c726e0e4 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 200 len: 1307 microversion: 2.1 time: 0.205482 Feb 12 21:07:07.984169 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 788/1603] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:07 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:08.002718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-403772ed-8b0c-4abb-89a5-f5b0eee94291 req-c5b5e162-aa28-4e13-9c15-4975f2b3937a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e945404b-2162-40c7-a141-3290a269d450", "name": "network-vif-plugged", "status": "completed", "tag": "a0baed29-10f3-48fe-b214-5e1ef2af8973"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:08.026504 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:08.026504 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:08.058963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-403772ed-8b0c-4abb-89a5-f5b0eee94291 req-c5b5e162-aa28-4e13-9c15-4975f2b3937a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.061975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-403772ed-8b0c-4abb-89a5-f5b0eee94291 req-c5b5e162-aa28-4e13-9c15-4975f2b3937a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:08.093842 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-403772ed-8b0c-4abb-89a5-f5b0eee94291 req-c5b5e162-aa28-4e13-9c15-4975f2b3937a service nova] Creating event network-vif-plugged:a0baed29-10f3-48fe-b214-5e1ef2af8973 for instance e945404b-2162-40c7-a141-3290a269d450 on nch1-master-1 Feb 12 21:07:08.094601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:08.103787 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-782624af-bbe2-4c3e-b9ec-82c2436d71ed tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 1.012074 Feb 12 21:07:08.104429 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-403772ed-8b0c-4abb-89a5-f5b0eee94291 req-c5b5e162-aa28-4e13-9c15-4975f2b3937a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105503 Feb 12 21:07:08.106260 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 789/1604] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:08.106418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 816/1605] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:07 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:08.113096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:08.114798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:08.117942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:08.118650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:08.135448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.136157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:08.136840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.137666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.139290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:08.139995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:08.140822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.141456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:08.566487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:08.578964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c4e282ee-0fb8-4e72-ae4f-6a3639169131 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.470677 Feb 12 21:07:08.580131 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 790/1606] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:08 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:08.624801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:08.635903 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c619b46a-8714-4655-a532-53d1b952b8a3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.525339 Feb 12 21:07:08.644442 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 817/1607] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:08 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:08.789679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:08.791947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:08.805218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.806166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:08.807275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:08.807986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.002287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:09.003124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 5a28a325-2d79-47b8-824d-719cd96e9007] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:09.009840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.010297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.011085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.012011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.028880 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance 5a28a325-2d79-47b8-824d-719cd96e9007 could not be found. Feb 12 21:07:09.029555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance 5a28a325-2d79-47b8-824d-719cd96e9007 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:09.030395 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bdbe1afd-d459-4ff5-b67b-9d2d8b30536e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007" status: 404 len: 111 microversion: 2.1 time: 0.032008 Feb 12 21:07:09.031211 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 818/1608] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:08 2022] GET /compute/v2.1/servers/5a28a325-2d79-47b8-824d-719cd96e9007 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:07:09.040421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:09.040957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:09.047811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.048361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.049505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.050016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.077833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:09.102816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:09.114117 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce54824a-25f5-4264-95fb-cd5d3eaceaf4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.328304 Feb 12 21:07:09.114963 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 791/1609] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:08 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:09.127948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:09.128728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:09.135728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.136880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.137699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.138227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.309920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:09.317760 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ebadd8e-0f44-46d7-a05d-58d07b4e5654 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1322 microversion: 2.1 time: 0.194669 Feb 12 21:07:09.320190 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 792/1610] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:09 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:09.601505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:09.602491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:09.609759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.614419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.615517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.616121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.619791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-914ddd82-196e-40e8-ab31-08a44e20d648 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 204 len: 0 microversion: 2.1 time: 0.583744 Feb 12 21:07:09.621807 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 819/1611] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:09 2022] DELETE /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:09.633015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:09.640231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:09.656558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.657339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.658370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.659157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.865090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:09.865090 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2b3e7751-e75b-4775-adc7-d4eb2848723b tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1471 microversion: 2.1 time: 0.238699 Feb 12 21:07:09.865090 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 820/1612] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:09 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:09.869223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:09.870048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:09.877029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:09.881836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.882578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.883895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:09.884491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:09.887093 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c53b64f-684b-4d05-8b46-961f61760709 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1477 microversion: 2.1 time: 0.293632 Feb 12 21:07:09.888127 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 793/1613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:09 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:09.983491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1861659581", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "04e4405d-ac34-418d-b812-924c095df566"}], "block_device_mapping_v2": [{"uuid": "e5b5c656-a8a4-478a-aad0-b56ab96de415", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:10.044138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:10.058621 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e83066d5-a2dc-4648-a8c0-5bf0fb957bf3 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.192691 Feb 12 21:07:10.059753 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 821/1614] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:09 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:10.137615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] validate_networks() for [('04e4405d-ac34-418d-b812-924c095df566', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:07:10.139302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:10.140688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:10.147176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.147634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.148432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.149508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.344173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:10.357171 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-231a1404-f8c1-450f-af92-d8a8b6289cd9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.227881 Feb 12 21:07:10.358347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 822/1615] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:10 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:10.363509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:10.364577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:10.371724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.375479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.375479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.375479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.644992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:10.655878 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6c9d266d-9c1e-4782-bfcf-32f1eb945167 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1471 microversion: 2.1 time: 0.296119 Feb 12 21:07:10.666120 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 823/1616] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:10 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:10.674414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:10.680417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:10.689063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.690474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.691747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.692391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.727886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lazy-loading 'flavor' on Instance uuid e945404b-2162-40c7-a141-3290a269d450 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:10.747286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:07:10.747286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:07:10.747788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:07:10.748205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:07:10.748623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:07:10.770662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.771383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.772472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:10.773177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:10.812556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:10.819458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Getting quotas for user f126f64ca5e64defb9bbcf4c6bab2fd8 and project 97311a1994be45a2b507aedc74f578df. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:10.927132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:07:10.929643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5b5c656-a8a4-478a-aad0-b56ab96de415',volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:07:11.080716 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d55d251-b6b6-4581-bd80-ca445ffc230e tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450/action" status: 202 len: 0 microversion: 2.1 time: 0.410579 Feb 12 21:07:11.084199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 824/1617] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:10 2022] POST /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:07:11.093892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:11.094851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:11.108969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:11.115158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:11.116213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:11.116666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:11.488069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:11.522527 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3246bdac-f26b-4428-85c7-b5114c30e75a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1471 microversion: 2.1 time: 0.438793 Feb 12 21:07:11.523671 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 825/1618] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:11 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:11.531642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:11.532862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:11.560779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:11.561690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:11.562828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:11.563500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:11.628872 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f9a17da7-87ef-47a2-a852-b512c002ccba tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650608 Feb 12 21:07:11.637430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 794/1619] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:07:11.664924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:11.666084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:11.685619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:11.686544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:11.687719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:11.688373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:12.237583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:12.249122 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c0f20f1-c365-4012-ad70-8259c2f7fe44 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1476 microversion: 2.1 time: 0.717590 Feb 12 21:07:12.250132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 826/1620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:11 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1476 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:12.255287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:12.262821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:12.289931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:12.293196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:12.295574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:12.297053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:12.418703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:12.429987 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c77dce62-44bd-42e1-9633-acc6f619cf38 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.792982 Feb 12 21:07:12.430905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 795/1621] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:11 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:12.449224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c0f3edd0-88da-491f-918e-fed63baa37f3 req-6c9819e6-3d63-4048-adc9-5d4c9948397a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "name": "network-vif-unplugged", "status": "completed", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:12.455112 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:12.455112 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:12.476561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c0f3edd0-88da-491f-918e-fed63baa37f3 req-6c9819e6-3d63-4048-adc9-5d4c9948397a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:12.478794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c0f3edd0-88da-491f-918e-fed63baa37f3 req-6c9819e6-3d63-4048-adc9-5d4c9948397a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:12.510318 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c0f3edd0-88da-491f-918e-fed63baa37f3 req-6c9819e6-3d63-4048-adc9-5d4c9948397a service nova] Creating event network-vif-unplugged:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch1-master-1 Feb 12 21:07:12.528277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-c0f3edd0-88da-491f-918e-fed63baa37f3 req-6c9819e6-3d63-4048-adc9-5d4c9948397a service nova] Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:07:12.565430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c0f3edd0-88da-491f-918e-fed63baa37f3 req-6c9819e6-3d63-4048-adc9-5d4c9948397a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128389 Feb 12 21:07:12.566497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 796/1622] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:12.578335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:12.579544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:12.595379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:12.596890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:12.599746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:12.600390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.039953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:13.058785 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07ae7aa0-67ca-4ee4-bdb7-601c9c0401e1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.484583 Feb 12 21:07:13.058785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 797/1623] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:12 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:13.070837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:13.093514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:13.119040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.124497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.128990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.129860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.174189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7ab79e6-cf5b-441c-83bb-f6bedb0bb8b0 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1613 microversion: 2.1 time: 0.922597 Feb 12 21:07:13.174948 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 827/1624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:12 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1613 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:13.194234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:13.199070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:13.216768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.217439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.218641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.220132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.286664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.287816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.289294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lazy-loading 'fault' on Instance uuid 608f3421-9d47-451f-aab9-8b516d566201 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:13.356962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:13.389890 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa30b8a1-24b7-43c9-a204-373c2261ed17 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1103 microversion: 2.1 time: 0.321608 Feb 12 21:07:13.392347 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 798/1625] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:13 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1103 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:13.423417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-94449fa7-b6b3-4194-9c15-6d679054f558 req-0a7d3d40-348e-4ca1-80b2-bee514e5977f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608f3421-9d47-451f-aab9-8b516d566201", "name": "network-vif-deleted", "tag": "d12f9147-b8b3-4cc7-ba78-bc82fb796c36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:13.428784 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:13.428784 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:13.431435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:13.437314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-94449fa7-b6b3-4194-9c15-6d679054f558 req-0a7d3d40-348e-4ca1-80b2-bee514e5977f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.450662 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92a9d327-248e-4451-8e0a-3a5481c5e044 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 200 len: 1305 microversion: 2.1 time: 0.266929 Feb 12 21:07:13.450882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-94449fa7-b6b3-4194-9c15-6d679054f558 req-0a7d3d40-348e-4ca1-80b2-bee514e5977f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.455876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 828/1626] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:13 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 1305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:13.460869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:13.461753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:13.471841 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-94449fa7-b6b3-4194-9c15-6d679054f558 req-0a7d3d40-348e-4ca1-80b2-bee514e5977f service nova] Creating event network-vif-deleted:d12f9147-b8b3-4cc7-ba78-bc82fb796c36 for instance 608f3421-9d47-451f-aab9-8b516d566201 on nch1-master-1 Feb 12 21:07:13.472044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.473601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.477193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.477901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.485104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-94449fa7-b6b3-4194-9c15-6d679054f558 req-0a7d3d40-348e-4ca1-80b2-bee514e5977f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091436 Feb 12 21:07:13.486422 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 799/1627] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:13.495191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:13.497138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:13.511503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.512739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.513849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.514297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.561896 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] HTTP exception thrown: Cannot 'migrate' instance e945404b-2162-40c7-a141-3290a269d450 while it is in vm_state suspended Feb 12 21:07:13.562502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Returning 409 to user: Cannot 'migrate' instance e945404b-2162-40c7-a141-3290a269d450 while it is in vm_state suspended {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:13.563341 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d672c38e-4981-4d3e-98db-70224bc06f82 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450/action" status: 409 len: 148 microversion: 2.1 time: 0.106426 Feb 12 21:07:13.575791 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 829/1628] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:13 2022] POST /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450/action => generated 148 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:07:13.583131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:13.583754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:13.596265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.596712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.602884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.606446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.819459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:13.830035 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f73dde48-004c-491e-868a-22f69c7f84e2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1476 microversion: 2.1 time: 0.342035 Feb 12 21:07:13.835526 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 800/1629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:13 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:13.837941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fed015ca-bfae-4357-a671-c6a64ba334e4 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:13.839108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fed015ca-bfae-4357-a671-c6a64ba334e4 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:13.840574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fed015ca-bfae-4357-a671-c6a64ba334e4 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf/action" status: 400 len: 144 microversion: 2.1 time: 0.008626 Feb 12 21:07:13.841109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 801/1630] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:13 2022] POST /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:07:13.851484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad8fe20a-c582-4dbe-a459-dbec3363b096 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:13.852882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad8fe20a-c582-4dbe-a459-dbec3363b096 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:13.853951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad8fe20a-c582-4dbe-a459-dbec3363b096 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf/action" status: 400 len: 120 microversion: 2.1 time: 0.006834 Feb 12 21:07:13.854718 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 802/1631] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:13 2022] POST /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf/action => generated 120 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:07:13.867361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5145a2d3-909c-46c2-8bab-0f7f0b414604 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:13.868577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5145a2d3-909c-46c2-8bab-0f7f0b414604 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Failed to fetch instance by id 999 {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:07:13.869815 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-5145a2d3-909c-46c2-8bab-0f7f0b414604 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] HTTP exception thrown: Instance 999 could not be found. Feb 12 21:07:13.871086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5145a2d3-909c-46c2-8bab-0f7f0b414604 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:13.872064 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5145a2d3-909c-46c2-8bab-0f7f0b414604 tempest-ServersAdminNegativeTestJSON-2038713950 tempest-ServersAdminNegativeTestJSON-2038713950-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.011550 Feb 12 21:07:13.872763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 803/1632] 10.222.0.31 () {60 vars in 1178 bytes} [Sat Feb 12 21:07:13 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:07:13.889763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:13.890289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:13.907293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.908925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.912004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:13.912496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:13.919608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:13.934344 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a836283-1fb3-44be-86e2-c1231e85baac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.356328 Feb 12 21:07:13.944372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 830/1633] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:13 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:13.955095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:14.071198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:14.072091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:14.080618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.081192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.082142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.082805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.287587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:14.297526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c9ce9b6-063a-406f-8ff3-d264c7411ada tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.230444 Feb 12 21:07:14.298895 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 831/1634] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:14 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:14.407870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:14.408792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:14.416267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.416826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.432953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.432953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.487286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:14.495053 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbe6395e-4f0e-48c2-8df5-7b0bf648e5c5 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1151 microversion: 2.1 time: 0.090995 Feb 12 21:07:14.495660 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 832/1635] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:14 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:14.500079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:14.500694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 608f3421-9d47-451f-aab9-8b516d566201] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:14.507396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.507847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.508631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.509066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.523808 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance 608f3421-9d47-451f-aab9-8b516d566201 could not be found. Feb 12 21:07:14.524398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance 608f3421-9d47-451f-aab9-8b516d566201 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:14.525215 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0b91cc0c-4927-4d8f-a2ff-24babfd00c18 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201" status: 404 len: 111 microversion: 2.1 time: 0.028659 Feb 12 21:07:14.525779 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 833/1636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:14 2022] GET /compute/v2.1/servers/608f3421-9d47-451f-aab9-8b516d566201 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:14.535032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:14.535525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:14.541564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.542029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.542887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.543321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.569593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:14.674441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff9b5699-77de-4f15-8a95-378ef3a63949 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 204 len: 0 microversion: 2.1 time: 0.795479 Feb 12 21:07:14.674977 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 804/1637] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:13 2022] DELETE /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:07:14.679944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d668bdbf-0835-4a26-84a9-25aa5c23039f req-564fb03c-f9e9-46d7-a905-0f9335709c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:14.681531 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:14.681531 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:14.688871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d668bdbf-0835-4a26-84a9-25aa5c23039f req-564fb03c-f9e9-46d7-a905-0f9335709c66 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.689312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d668bdbf-0835-4a26-84a9-25aa5c23039f req-564fb03c-f9e9-46d7-a905-0f9335709c66 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.701846 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d668bdbf-0835-4a26-84a9-25aa5c23039f req-564fb03c-f9e9-46d7-a905-0f9335709c66 service nova] Creating event network-changed:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch1-master-1 Feb 12 21:07:14.707457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-d668bdbf-0835-4a26-84a9-25aa5c23039f req-564fb03c-f9e9-46d7-a905-0f9335709c66 service nova] Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:07:14.718576 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d668bdbf-0835-4a26-84a9-25aa5c23039f req-564fb03c-f9e9-46d7-a905-0f9335709c66 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042319 Feb 12 21:07:14.719173 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 805/1638] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:14.724307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:14.725027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:14.731488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.731968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:14.732758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:14.733215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:15.212211 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-727550dc-4996-4a19-86b9-62479185c92e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 204 len: 0 microversion: 2.1 time: 0.680508 Feb 12 21:07:15.213089 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 834/1639] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:14 2022] DELETE /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:07:15.219469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:15.220199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:15.226718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:15.227419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:15.228433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:15.229071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:15.522484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:15.536012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a74531db-3a80-45c4-a7e0-57e3a430edbd tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1474 microversion: 2.1 time: 0.321656 Feb 12 21:07:15.544779 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 835/1640] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:15 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:15.552017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:15.554931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:15.567978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:15.573220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:15.573220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:15.573220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:15.579341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:15.593404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-acaeb2a6-4af5-41f6-b4e3-42190bfd30d9 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1468 microversion: 2.1 time: 0.872308 Feb 12 21:07:15.607054 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 806/1641] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:14 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1468 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:15.625333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:15.628527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:15.663042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:15.663885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:15.666099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:15.669384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:16.099328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:16.112105 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d1827a3b-1bdb-4d6c-8fc1-7ff03c923ecc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1472 microversion: 2.1 time: 0.501944 Feb 12 21:07:16.113416 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 807/1642] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:15 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:16.125415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:16.133914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:16.153667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:16.154621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:16.155800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:16.156504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:16.279171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:16.293729 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4dcd52c-8c8c-4c9f-8c25-ae370ceb01c0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.747429 Feb 12 21:07:16.294765 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 836/1643] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:15 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:16.300220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:16.301578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:16.314958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:16.316379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:16.317760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:16.318418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:16.676963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:16.689495 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-34143861-fbd7-414a-97a5-f545811e4c50 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1528 microversion: 2.1 time: 0.572612 Feb 12 21:07:16.691183 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 808/1644] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:16 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1528 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:16.713248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3fd53ca2-71d6-4b15-b815-67a61959cba4 req-a7344b9c-2bb9-4964-a58e-7b8996348db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08416797-b31e-4ab0-af14-a13d93df3fb0", "name": "network-vif-plugged", "status": "completed", "tag": "0e5d31bf-1299-4108-a791-2a97cebb0d4f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:16.719182 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:16.719182 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:16.737284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3fd53ca2-71d6-4b15-b815-67a61959cba4 req-a7344b9c-2bb9-4964-a58e-7b8996348db6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:16.738113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3fd53ca2-71d6-4b15-b815-67a61959cba4 req-a7344b9c-2bb9-4964-a58e-7b8996348db6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:16.794057 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3fd53ca2-71d6-4b15-b815-67a61959cba4 req-a7344b9c-2bb9-4964-a58e-7b8996348db6 service nova] Creating event network-vif-plugged:0e5d31bf-1299-4108-a791-2a97cebb0d4f for instance 08416797-b31e-4ab0-af14-a13d93df3fb0 on nch1-master-1 Feb 12 21:07:16.805936 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3fd53ca2-71d6-4b15-b815-67a61959cba4 req-a7344b9c-2bb9-4964-a58e-7b8996348db6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101323 Feb 12 21:07:16.810053 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 809/1645] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:16.822936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-16151834", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "714ff2dc-d317-4a71-9ee6-4e812e6c4f51"}], "block_device_mapping_v2": [{"uuid": "8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:16.936300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] validate_networks() for [('714ff2dc-d317-4a71-9ee6-4e812e6c4f51', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:07:17.015337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:17.031788 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1537c891-8593-4fc2-b00e-0fe0c526fbc8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1211 microversion: 2.1 time: 0.735572 Feb 12 21:07:17.032394 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 837/1646] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:16 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1211 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:17.046770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:17.047458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:17.062004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:17.062467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:17.063276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:17.063715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:17.590713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:17.603024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-119e20cc-8ace-48fe-a68e-40ae1161439e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1471 microversion: 2.1 time: 0.560658 Feb 12 21:07:17.604384 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 838/1647] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:17 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1471 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:17.611737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:17.612831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:17.621941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:17.622786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:17.623832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:17.624910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:17.637139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:07:17.637779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:07:17.638077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:07:17.638493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:07:17.638906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:07:17.668248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:17.668710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:17.682429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:17.682429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:17.728578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:17.736263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Getting quotas for user 3cae3e35c281419b98224db3b8ea1f19 and project 097ba3f98cb348929658959fd4ff31cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:17.809325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:07:17.813112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ee266c6-2e2c-478a-8cea-d6b05f4f3dc5',volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:07:17.901100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:17.911260 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7986eb02-3c61-48c7-a5ce-a460dc8a6b57 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 200 len: 1426 microversion: 2.1 time: 0.303245 Feb 12 21:07:17.912617 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 839/1648] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:17 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 1426 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:17.918935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-755721128", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8a5b2a07-61e9-49f2-a870-d207fbb10adf"}], "security_groups": [{"name": "tempest-securitygroup--989980789"}], "key_name": "tempest-keypair-134015399", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d3c7c811-d95c-47ea-9db2-985a51feb590", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:18.241543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] validate_networks() for [('8a5b2a07-61e9-49f2-a870-d207fbb10adf', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:07:18.336369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5ecad59-0b33-4d19-99ea-4ec9d8655441 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.524801 Feb 12 21:07:18.343688 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 810/1649] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:07:18.349156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:18.349999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:18.357670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:18.358483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:18.359469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:18.360069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:18.468163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:18.478715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f496d7f0-f514-403d-a91b-96eb9f2a1360 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 200 len: 1430 microversion: 2.1 time: 0.133677 Feb 12 21:07:18.479315 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 811/1650] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:18 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 1430 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:18.488827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:18.490831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:18.499520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:18.499978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:18.500993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:18.501512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:18.772739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:18.785131 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c9e83a6-bfe9-4cbd-91bc-d1b3f74010d9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1316 microversion: 2.1 time: 0.304293 Feb 12 21:07:18.785798 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 812/1651] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:18 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:18.790791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:18.791413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:18.800102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:18.800922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:18.802067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:18.802509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.241412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f23c3d9c-eaad-4989-ac49-e45a2941d66d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "POST /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a/action" status: 202 len: 0 microversion: 2.1 time: 0.454007 Feb 12 21:07:19.242145 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 813/1652] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:18 2022] POST /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:19.247505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:19.248272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:19.255177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.256961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.256961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.257172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.468016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:19.475217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd274bc9-5f47-4ae8-84a8-79705895d969 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1510 microversion: 2.1 time: 0.231906 Feb 12 21:07:19.475802 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 814/1653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:19 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:19.521403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for project a19875f98800434db2950efcf23ff3a4. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:19.528563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for user a3d2b0036a1144a4a385b4c0fd4f9782 and project a19875f98800434db2950efcf23ff3a4. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:19.544486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-538dc8eb-d65a-4d13-9667-16539c96b27b req-356092cf-7d2f-4b9f-a182-3c0b56935c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e945404b-2162-40c7-a141-3290a269d450", "name": "network-vif-deleted", "tag": "a0baed29-10f3-48fe-b214-5e1ef2af8973"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:19.546361 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:19.546361 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:19.554542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:07:19.554990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:07:19.555473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:07:19.555890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:07:19.556359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:07:19.560730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-538dc8eb-d65a-4d13-9667-16539c96b27b req-356092cf-7d2f-4b9f-a182-3c0b56935c07 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.561987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-538dc8eb-d65a-4d13-9667-16539c96b27b req-356092cf-7d2f-4b9f-a182-3c0b56935c07 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.568123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.569037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.570084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.571216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.578119 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-538dc8eb-d65a-4d13-9667-16539c96b27b req-356092cf-7d2f-4b9f-a182-3c0b56935c07 service nova] Creating event network-vif-deleted:a0baed29-10f3-48fe-b214-5e1ef2af8973 for instance e945404b-2162-40c7-a141-3290a269d450 on nch1-master-1 Feb 12 21:07:19.584326 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-538dc8eb-d65a-4d13-9667-16539c96b27b req-356092cf-7d2f-4b9f-a182-3c0b56935c07 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107128 Feb 12 21:07:19.585346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 815/1654] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:19.594426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:19.595330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:19.597212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for project a19875f98800434db2950efcf23ff3a4. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:19.607817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Getting quotas for user a3d2b0036a1144a4a385b4c0fd4f9782 and project a19875f98800434db2950efcf23ff3a4. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:19.608268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.608878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.610002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.610651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.739376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:07:19.741862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3c7c811-d95c-47ea-9db2-985a51feb590',volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:07:19.849877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:19.868109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9163f3b0-4e23-40a0-a97a-d139b1157e25 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.280819 Feb 12 21:07:19.869217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 816/1655] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:19 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:19.875210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:19.876040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:19.884690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.885185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.886035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.887044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.948485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:19.957336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:19.958853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:19.959944 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f58110f3-b852-4420-a8fb-25870407a0ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1183 microversion: 2.25 time: 0.089434 Feb 12 21:07:19.960701 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 817/1656] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:19 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:19.965176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:19.966052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: e945404b-2162-40c7-a141-3290a269d450] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:19.976661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.977115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.977954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:19.978390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:19.998890 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] HTTP exception thrown: Instance e945404b-2162-40c7-a141-3290a269d450 could not be found. Feb 12 21:07:19.999921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Returning 404 to user: Instance e945404b-2162-40c7-a141-3290a269d450 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:20.000769 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-225e0919-7e06-422e-a217-e202d23cce4b tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450" status: 404 len: 111 microversion: 2.1 time: 0.039211 Feb 12 21:07:20.001338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 818/1657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:19 2022] GET /compute/v2.1/servers/e945404b-2162-40c7-a141-3290a269d450 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:20.006523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:20.011024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.014119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.014576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.015381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.015825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.160241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:20.168302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e7a926f4-a002-431a-a14d-e40b19911f43 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1470 microversion: 2.1 time: 0.165947 Feb 12 21:07:20.178322 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 819/1658] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:20 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:20.178322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:20.178322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 60f87ab1-85fb-49c2-9720-20ce04a1c7b1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.180617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.181242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.182071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.182525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.197613 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance 60f87ab1-85fb-49c2-9720-20ce04a1c7b1 could not be found. Feb 12 21:07:20.204275 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7bf43b71-9f28-4153-b493-bbf3b45df015 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.290275 Feb 12 21:07:20.205096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 840/1659] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:07:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:07:20.210833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9dc2399f-59dd-4c6e-8808-5fd89563ee17 req-b0706513-47f7-4d15-aab0-f0e5c445b9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "name": "network-vif-plugged", "status": "completed", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:20.213634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance 60f87ab1-85fb-49c2-9720-20ce04a1c7b1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:20.214708 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:20.214708 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:20.215073 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1522df6-6c8c-4e0a-a1f5-20a8b55cd50a tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1" status: 404 len: 111 microversion: 2.1 time: 0.044657 Feb 12 21:07:20.219271 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 820/1660] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:20 2022] GET /compute/v2.1/servers/60f87ab1-85fb-49c2-9720-20ce04a1c7b1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:20.224633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9dc2399f-59dd-4c6e-8808-5fd89563ee17 req-b0706513-47f7-4d15-aab0-f0e5c445b9de service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.225135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:20.225557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9dc2399f-59dd-4c6e-8808-5fd89563ee17 req-b0706513-47f7-4d15-aab0-f0e5c445b9de service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.225954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.234040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.234587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.236062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.236739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.243086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9dc2399f-59dd-4c6e-8808-5fd89563ee17 req-b0706513-47f7-4d15-aab0-f0e5c445b9de service nova] Creating event network-vif-plugged:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch1-master-1 Feb 12 21:07:20.261021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-9dc2399f-59dd-4c6e-8808-5fd89563ee17 req-b0706513-47f7-4d15-aab0-f0e5c445b9de service nova] Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:07:20.279917 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9dc2399f-59dd-4c6e-8808-5fd89563ee17 req-b0706513-47f7-4d15-aab0-f0e5c445b9de service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073268 Feb 12 21:07:20.281336 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 841/1661] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:20.291186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:20.292201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.325772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.326214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.327064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.327501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.397770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:20.422491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:20.431461 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-39583e93-0c01-422f-a25b-c8478fd21c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1503 microversion: 2.1 time: 0.210698 Feb 12 21:07:20.431603 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 821/1662] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:20 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:20.438824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-606ac674-40fc-4a7b-b7eb-58a73d61a5aa tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:20.439626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-606ac674-40fc-4a7b-b7eb-58a73d61a5aa tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.537002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-606ac674-40fc-4a7b-b7eb-58a73d61a5aa tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:20.544539 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-606ac674-40fc-4a7b-b7eb-58a73d61a5aa tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1120 microversion: 2.1 time: 0.111943 Feb 12 21:07:20.545309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 822/1663] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:20 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1120 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:20.549529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:20.549980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.555769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.556220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.557059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.557570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.588161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:20.740545 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d93b574e-d5cb-42e5-afec-c34e7f076aa6 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "DELETE /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 204 len: 0 microversion: 2.1 time: 0.457136 Feb 12 21:07:20.742070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 842/1664] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:20 2022] DELETE /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:20.749483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-283687624"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:20.750816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:20.758890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.759559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.760604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:20.761045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:20.907069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.network.security_group_api [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Adding security group d03fdd0f-8263-425f-9df4-bea560d1f8ee to port 0e5d31bf-1299-4108-a791-2a97cebb0d4f Feb 12 21:07:21.106447 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9aa458ca-be4e-4408-8bfe-24abcdd781fd tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48" status: 204 len: 0 microversion: 2.1 time: 0.559837 Feb 12 21:07:21.107442 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 823/1665] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:20 2022] DELETE /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:21.112828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:21.113570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:21.120091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.120555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.121397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.121826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.280829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:21.288538 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba6348b3-eeb3-45b5-8e0f-7c85f7038f68 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1513 microversion: 2.1 time: 0.179774 Feb 12 21:07:21.289331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 824/1666] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:21 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:21.295333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:21.295954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:21.303348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.307438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.307438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.307438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.449791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a1f1044-4383-49bd-af32-03b638691906 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0/action" status: 202 len: 0 microversion: 2.1 time: 0.704921 Feb 12 21:07:21.450417 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 843/1667] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:20 2022] POST /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:21.458610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:21.459223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:21.470256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.470713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.471529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.471966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.473212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:21.481526 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4b08300e-9cb2-4a1f-bdea-f2a4d8520037 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1475 microversion: 2.1 time: 0.191242 Feb 12 21:07:21.482306 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 825/1668] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:21 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1475 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:21.487571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:21.488807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:21.495244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.496069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.497011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.497381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.581843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:21.591513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:21.593563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:21.594999 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50548ec6-1407-4279-9bde-bc21e2cd5dbe tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1239 microversion: 2.25 time: 0.111341 Feb 12 21:07:21.596110 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 826/1669] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:21 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1239 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:21.600921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:21.601969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:21.608717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.609406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.610448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.611319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.644022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:21.816775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:21.832147 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5876a3c2-d694-4c70-9361-c6e08737e46e tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.377090 Feb 12 21:07:21.833204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 844/1670] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:21 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:21.838978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:21.840455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:21.847865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.848400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:21.849310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:21.849854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.129092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a93fc04-b7be-4a8b-824c-2db95974bfe0 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 204 len: 0 microversion: 2.1 time: 0.531458 Feb 12 21:07:22.130013 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 827/1671] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:21 2022] DELETE /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:22.137731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:22.138661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:22.145340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.145816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.146605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.147036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.159189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:22.167808 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f2a99597-3005-4a5e-9a4a-8993f3184509 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1470 microversion: 2.1 time: 0.332701 Feb 12 21:07:22.179956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 845/1672] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:21 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:22.186346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1003739601"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:22.195373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:22.196717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.197445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.200086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.200814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.347505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:22.355482 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-448a82c9-dd70-439f-a5cf-fe382ad6ccff tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1453 microversion: 2.1 time: 0.223733 Feb 12 21:07:22.378788 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 828/1673] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:22 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1453 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:22.395225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:22.397727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:22.413580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.415139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.416000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.416520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.500667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:22.509763 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db02a3fa-b8d7-49cd-80fd-93ca577315fe tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1218 microversion: 2.1 time: 0.129099 Feb 12 21:07:22.510713 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 829/1674] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:22 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:22.515836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f87ab1-85fb-49c2-9720-20ce04a1c7b1", "name": "network-vif-deleted", "tag": "2cde5d15-d636-49b0-9a4a-067de06e9f91"}, {"name": "network-changed", "server_uuid": "7a074cfc-bc01-4936-ac34-cf31436b706d", "tag": "1402b4b5-4ffe-40e5-b42b-355e4a6d8792"}, {"name": "network-changed", "server_uuid": "08416797-b31e-4ab0-af14-a13d93df3fb0", "tag": "0e5d31bf-1299-4108-a791-2a97cebb0d4f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:22.517953 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.network.security_group_api [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Adding security group dbfab272-2908-4105-a62b-ae7258207b37 to port 0e5d31bf-1299-4108-a791-2a97cebb0d4f Feb 12 21:07:22.518568 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:22.518568 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:22.527582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.528616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.546090 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] Creating event network-vif-deleted:2cde5d15-d636-49b0-9a4a-067de06e9f91 for instance 60f87ab1-85fb-49c2-9720-20ce04a1c7b1 on nch1-master-1 Feb 12 21:07:22.546720 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] Creating event network-changed:1402b4b5-4ffe-40e5-b42b-355e4a6d8792 for instance 7a074cfc-bc01-4936-ac34-cf31436b706d on nch2-master-1 Feb 12 21:07:22.547692 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] Creating event network-changed:0e5d31bf-1299-4108-a791-2a97cebb0d4f for instance 08416797-b31e-4ab0-af14-a13d93df3fb0 on nch1-master-1 Feb 12 21:07:22.557234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-363a6a23-e7ee-4c2c-8dce-0882ed5eb447 req-ff6f3209-9dc1-4b79-9f1b-51ab720d540e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.045111 Feb 12 21:07:22.559092 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 830/1675] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:22.563970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:22.567832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:22.572038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.572743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.573445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.575688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.815557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:22.832312 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-961ef421-2260-463e-9e4e-9c02769ea765 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48" status: 200 len: 1473 microversion: 2.1 time: 0.270299 Feb 12 21:07:22.835765 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 831/1676] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:22 2022] GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48 => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:22.851319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fce1c22f-8710-46e4-8365-0538f257b89a req-bf9619e9-3824-4ffc-a6b5-ad022b28708a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb565b3e-86a6-4ab9-b812-5901d747f049", "name": "network-vif-unplugged", "status": "completed", "tag": "ec357ac8-2d34-44cb-8ba8-0821decd9e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:22.858990 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:22.858990 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:22.898473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fce1c22f-8710-46e4-8365-0538f257b89a req-bf9619e9-3824-4ffc-a6b5-ad022b28708a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.898473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fce1c22f-8710-46e4-8365-0538f257b89a req-bf9619e9-3824-4ffc-a6b5-ad022b28708a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.909658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.server_external_events [req-fce1c22f-8710-46e4-8365-0538f257b89a req-bf9619e9-3824-4ffc-a6b5-ad022b28708a service nova] Unable to find a host for instance bb565b3e-86a6-4ab9-b812-5901d747f049. Dropping event network-vif-unplugged {{(pid=141727) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 21:07:22.911160 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fce1c22f-8710-46e4-8365-0538f257b89a req-bf9619e9-3824-4ffc-a6b5-ad022b28708a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.072697 Feb 12 21:07:22.912348 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 832/1677] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 12 21:07:22.919079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:22.919819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:22.935219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.941703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:22.943514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:22.947409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:23.002492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'flavor' on Instance uuid bb565b3e-86a6-4ab9-b812-5901d747f049 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:23.015582 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'shelve' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state shelved_offloaded Feb 12 21:07:23.016374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'shelve' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state shelved_offloaded {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:23.021043 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb4e3bdc-f81f-4af9-b2b9-dd11d15eb76d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 155 microversion: 2.1 time: 0.103134 Feb 12 21:07:23.021043 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 833/1678] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:22 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:07:23.022722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:23.023331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:23.030054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:23.030559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:23.031624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:23.031787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:23.458672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:23.483084 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa1a255a-cbff-4a4a-a43c-28de506ffede tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1475 microversion: 2.1 time: 0.460640 Feb 12 21:07:23.483084 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 834/1679] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:23 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1475 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:23.488110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:23.489013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:23.504229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:23.505196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:23.506959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:23.511683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:24.017144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:24.030133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:24.033434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:24.036063 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-67441d96-9a1b-449f-9bbf-3b68713dd27e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.553266 Feb 12 21:07:24.037345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 835/1680] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:23 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:24.046452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:24.048224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:24.058515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:24.059676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:24.061841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:24.062790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:24.512452 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbe9afae-b989-4154-aef7-00825c6e5a9e tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0/action" status: 202 len: 0 microversion: 2.1 time: 2.330498 Feb 12 21:07:24.513888 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 846/1681] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:22 2022] POST /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0/action => generated 0 bytes in 2333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:24.523682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:24.524535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:24.535972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:24.536873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:24.538910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:24.539638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:24.994942 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c1db115-eb0d-4f12-9cd3-ccb4c450e6db tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 202 len: 0 microversion: 2.1 time: 0.479626 Feb 12 21:07:24.997618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:25.003280 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 847/1682] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:24 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:25.009023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1bcab33f-421d-414d-bf29-dcf7e1e3b8a9 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.969808 Feb 12 21:07:25.010309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 836/1683] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:24 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:25.015109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:25.017021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:25.024129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:25.024129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:25.025493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.026254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.027255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.027821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.035929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.036390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.037337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.037772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.110344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:25.118706 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0ce78b4e-be35-4b6d-9b58-e3b5c4d46992 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1236 microversion: 2.1 time: 0.106947 Feb 12 21:07:25.129954 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 837/1684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:25 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1236 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:25.138528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:25.144579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:25.153802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.154402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.155418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.155958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.501231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:25.506391 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6d2bc0e1-6ff0-4d49-9270-5412b512b185 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1470 microversion: 2.1 time: 0.498733 Feb 12 21:07:25.506991 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 848/1685] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:25 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:25.524546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:25.529891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:25.543413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.548628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.549735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.550342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.621788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.621951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.622427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lazy-loading 'fault' on Instance uuid 33d50fb4-9ee8-417a-8fc9-0b853c37edbf {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:25.641747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:25.656711 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d163d211-09b4-49c6-b3bf-2197e0e28d77 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48" status: 200 len: 1431 microversion: 2.1 time: 0.518181 Feb 12 21:07:25.657529 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 838/1686] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:25 2022] GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48 => generated 1431 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:25.664801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:25.665577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:25.684701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2953a6e295b345d0a7d571a023562671', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e182ad91ab97452284bae777d54ec83d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:25.692149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.693968 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f1ac2fb9-037b-4dfc-9b0d-2f6370017e6d tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 200 len: 1311 microversion: 2.1 time: 0.172678 Feb 12 21:07:25.694792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.695657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.697149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.705003 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 849/1687] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:25 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:25.711492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a18f2895-567e-4c6e-9331-07fafa889583 req-1cc40fd1-be99-4cf5-a24e-ae91cfa1f3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08416797-b31e-4ab0-af14-a13d93df3fb0", "tag": "0e5d31bf-1299-4108-a791-2a97cebb0d4f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:25.718132 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:25.718132 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:25.732585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a18f2895-567e-4c6e-9331-07fafa889583 req-1cc40fd1-be99-4cf5-a24e-ae91cfa1f3a8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.736628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a18f2895-567e-4c6e-9331-07fafa889583 req-1cc40fd1-be99-4cf5-a24e-ae91cfa1f3a8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.759784 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a18f2895-567e-4c6e-9331-07fafa889583 req-1cc40fd1-be99-4cf5-a24e-ae91cfa1f3a8 service nova] Creating event network-changed:0e5d31bf-1299-4108-a791-2a97cebb0d4f for instance 08416797-b31e-4ab0-af14-a13d93df3fb0 on nch1-master-1 Feb 12 21:07:25.771541 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a18f2895-567e-4c6e-9331-07fafa889583 req-1cc40fd1-be99-4cf5-a24e-ae91cfa1f3a8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065071 Feb 12 21:07:25.772360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 850/1688] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:25.782928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-48c4ce05-4a74-4e20-9152-f85c1980a06f req-10a4f09e-9b02-43e5-ad4d-a60461487090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "name": "network-vif-unplugged", "status": "completed", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:25.784676 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:25.784676 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:25.792747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-48c4ce05-4a74-4e20-9152-f85c1980a06f req-10a4f09e-9b02-43e5-ad4d-a60461487090 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.794467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-48c4ce05-4a74-4e20-9152-f85c1980a06f req-10a4f09e-9b02-43e5-ad4d-a60461487090 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.806080 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-48c4ce05-4a74-4e20-9152-f85c1980a06f req-10a4f09e-9b02-43e5-ad4d-a60461487090 service nova] Creating event network-vif-unplugged:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch2-master-1 Feb 12 21:07:25.812741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-48c4ce05-4a74-4e20-9152-f85c1980a06f req-10a4f09e-9b02-43e5-ad4d-a60461487090 service nova] Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:07:25.829879 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-48c4ce05-4a74-4e20-9152-f85c1980a06f req-10a4f09e-9b02-43e5-ad4d-a60461487090 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050842 Feb 12 21:07:25.831030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 851/1689] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:25.837207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:25.838158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:25.846637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.847680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:25.848550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:25.849091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:26.603997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:26.610099 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b74b79cf-6f7a-4a0f-b274-d0a8a817b6af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1461 microversion: 2.1 time: 0.777657 Feb 12 21:07:26.610715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e73b6eb-5d88-4f9a-a109-e32f255d9167 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.951630 Feb 12 21:07:26.611500 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 839/1690] 10.222.0.31 () {58 vars in 1292 bytes} [Sat Feb 12 21:07:25 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0/os-security-groups => generated 1157 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:26.612135 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 852/1691] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:25 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1461 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:26.616124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:26.622144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:26.634205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:26.637041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:26.637958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:26.638588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:26.639038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:26.639588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:26.647830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:26.648460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:26.649493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:26.650089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:26.997390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:27.008973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:27.015467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:27.017440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:27.018391 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48c1d705-71e0-48ea-b816-3d649153ccb1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.403490 Feb 12 21:07:27.019562 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0c1b180-05f2-4e83-ac27-aec9a7098054 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.407086 Feb 12 21:07:27.019818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 853/1692] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:26 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:27.024505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:27.029236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:27.039721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 840/1693] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:26 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:27.040211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.041841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.042870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.045918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.298464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:27.300156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:27.308922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.318561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.321075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.321763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.364977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:27.377505 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ac736059-b210-41f7-9cae-78b595dd2a0f tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.356134 Feb 12 21:07:27.389794 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 854/1694] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:27 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:27.396836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77a03541-5b82-43f7-b5d6-dcad74b23a62 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa9044ba160>, body: {"security_group": {"name": " tempest-securitygroup -44304880 ", "description": "tempest-description-812249478"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:27.813178 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77a03541-5b82-43f7-b5d6-dcad74b23a62 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.421956 Feb 12 21:07:27.817934 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 855/1695] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:07:27 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:27.818675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:27.819277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 99e01316-e5b8-4cf6-b921-313a90bc4a48] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:27.825701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.826157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.826946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.827414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.841457 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance 99e01316-e5b8-4cf6-b921-313a90bc4a48 could not be found. Feb 12 21:07:27.842053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance 99e01316-e5b8-4cf6-b921-313a90bc4a48 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:27.842881 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70a45cc1-5842-40f7-87cb-4e14638200e1 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48" status: 404 len: 111 microversion: 2.1 time: 0.027978 Feb 12 21:07:27.843434 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 856/1696] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:27 2022] GET /compute/v2.1/servers/99e01316-e5b8-4cf6-b921-313a90bc4a48 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:27.847901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:27.848511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] [instance: 33d50fb4-9ee8-417a-8fc9-0b853c37edbf] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:27.854532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.855659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.856446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.856995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.876365 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] HTTP exception thrown: Instance 33d50fb4-9ee8-417a-8fc9-0b853c37edbf could not be found. Feb 12 21:07:27.876965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] Returning 404 to user: Instance 33d50fb4-9ee8-417a-8fc9-0b853c37edbf could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:27.877821 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dde0a668-51ca-4599-82c3-2b359c9edce0 tempest-ServersAdminNegativeTestJSON-1997003342 tempest-ServersAdminNegativeTestJSON-1997003342-project] 10.222.0.31 "GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf" status: 404 len: 111 microversion: 2.1 time: 0.033497 Feb 12 21:07:27.878384 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 857/1697] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:27 2022] GET /compute/v2.1/servers/33d50fb4-9ee8-417a-8fc9-0b853c37edbf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:27.883658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:27.884517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:27.891149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.891851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.892644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.893244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.945210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:27.955315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e1703f1-8e67-439f-bc55-f35a31f0dff0 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1470 microversion: 2.1 time: 0.914362 Feb 12 21:07:27.957595 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 841/1698] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:27 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1470 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:27.962377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d50fb4-9ee8-417a-8fc9-0b853c37edbf", "name": "network-vif-deleted", "tag": "a318a716-17e1-474f-b913-0ba637029c68"}, {"server_uuid": "99e01316-e5b8-4cf6-b921-313a90bc4a48", "name": "network-vif-deleted", "tag": "343f7369-bd4a-4c45-bac6-12a12a82d733"}, {"name": "network-changed", "server_uuid": "c8d5abda-386d-4eb8-ab12-caf696303db0", "tag": "d6102892-165a-4568-bed4-24217882b194"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:27.964457 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:27.964457 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:27.973463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:27.974183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:27.991568 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] Creating event network-vif-deleted:a318a716-17e1-474f-b913-0ba637029c68 for instance 33d50fb4-9ee8-417a-8fc9-0b853c37edbf on nch2-master-1 Feb 12 21:07:27.992351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] Creating event network-vif-deleted:343f7369-bd4a-4c45-bac6-12a12a82d733 for instance 99e01316-e5b8-4cf6-b921-313a90bc4a48 on nch2-master-1 Feb 12 21:07:27.992855 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] Creating event network-changed:d6102892-165a-4568-bed4-24217882b194 for instance c8d5abda-386d-4eb8-ab12-caf696303db0 on nch1-master-1 Feb 12 21:07:28.007422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0dec5fca-66fa-4ed9-8f74-27d5026ee4b7 req-bcd23025-e832-4c38-8828-1ab338602858 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.048397 Feb 12 21:07:28.008487 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 842/1699] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:28.016127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-39a216cb-3749-4358-abbe-b1ca9c102c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe87e0d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:28.082874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:28.095600 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5beb9984-29ee-442e-b9ec-51ec601cf609 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1463 microversion: 2.1 time: 0.215597 Feb 12 21:07:28.096189 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 858/1700] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:27 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1463 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:28.104365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:28.105717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: c506a05b-2643-47fa-a737-ef76cf15e0e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:28.111966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.112420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.113379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.113883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.129116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance c506a05b-2643-47fa-a737-ef76cf15e0e9 could not be found. Feb 12 21:07:28.130017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance c506a05b-2643-47fa-a737-ef76cf15e0e9 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:28.130862 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4bbe53f4-fab9-4b86-b6d6-51742a7dbb96 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9" status: 404 len: 111 microversion: 2.1 time: 0.030143 Feb 12 21:07:28.131420 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 859/1701] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:28 2022] GET /compute/v2.1/servers/c506a05b-2643-47fa-a737-ef76cf15e0e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:28.141730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c506a05b-2643-47fa-a737-ef76cf15e0e9", "name": "network-vif-deleted", "tag": "5bafff40-3831-43c8-81dd-8619fc446d2e"}, {"name": "network-changed", "server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:28.143332 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:28.143332 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:28.150863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.151523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.164749 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] Creating event network-vif-deleted:5bafff40-3831-43c8-81dd-8619fc446d2e for instance c506a05b-2643-47fa-a737-ef76cf15e0e9 on nch1-master-1 Feb 12 21:07:28.165588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] Creating event network-changed:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch2-master-1 Feb 12 21:07:28.171546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:07:28.184579 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b6962cee-e744-490b-9d44-6cf0eb28eaec req-24e63560-0169-41ba-8d0c-194635aa5b32 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046542 Feb 12 21:07:28.185323 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 860/1702] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:28.190218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:28.190925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:28.197322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.197807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.199158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.201310 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-39a216cb-3749-4358-abbe-b1ca9c102c12 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a" status: 200 len: 221 microversion: 2.1 time: 0.191292 Feb 12 21:07:28.207449 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 843/1703] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:07:28 2022] GET /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a => generated 221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:28.210238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.214537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:28.214537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:28.220394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.221046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.222102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:28.222717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:28.508210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:28.518414 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a995f2cd-29e7-4528-a32b-8fec1deb6eb2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.331842 Feb 12 21:07:28.529608 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 861/1704] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:28 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:28.529608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a0df0002-6ec2-4479-9847-8134c7db95a9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:28.672691 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a0df0002-6ec2-4479-9847-8134c7db95a9 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/da7a162c-2879-4f24-bb04-7051dc36b643" status: 204 len: 0 microversion: 2.1 time: 0.149848 Feb 12 21:07:28.673425 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 862/1705] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:07:28 2022] DELETE /compute/v2.1/os-server-groups/da7a162c-2879-4f24-bb04-7051dc36b643 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:28.680924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-036cb327-0ca6-460c-a646-28ad0081b767 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa904075310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:29.161542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:29.172734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:29.174292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:29.178996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b89dcad-cde2-4069-b6c2-05fe77b582a8 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.970222 Feb 12 21:07:29.179578 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 844/1706] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:28 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:29.194370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:29.195280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:29.204946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:29.205805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:29.210763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:29.210763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:29.730988 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-036cb327-0ca6-460c-a646-28ad0081b767 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a" status: 202 len: 0 microversion: 2.1 time: 1.055370 Feb 12 21:07:29.737146 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 863/1707] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:07:28 2022] DELETE /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:29.739686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:29.740220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:29.742611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:29.750220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:29.751409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:29.752422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:29.753058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:29.765626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36c93ab5-77cc-473b-80fc-ceecac905c7c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.577975 Feb 12 21:07:29.775990 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 845/1708] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:29 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:29.781875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:29.786609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:29.806049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:29.809097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:29.810362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:29.813843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:29.823385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:30.264653 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71e3b94e-45e9-456c-b25f-095d486856f3 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 204 len: 0 microversion: 2.1 time: 0.530141 Feb 12 21:07:30.265260 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 864/1709] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:29 2022] DELETE /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:30.273434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:30.285927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4518bf9c-83c1-435f-b943-e58223328fb2 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1470 microversion: 2.1 time: 0.506616 Feb 12 21:07:30.287118 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 846/1710] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:29 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:30.295704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:30.296532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:30.306056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.306539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.307401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.307753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.425019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9ef133e3-caaf-4297-94af-3c8840a51947 req-ae6c9ef7-d647-4ff2-a66e-8435d57bd318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a074cfc-bc01-4936-ac34-cf31436b706d", "name": "network-vif-plugged", "status": "completed", "tag": "1402b4b5-4ffe-40e5-b42b-355e4a6d8792"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:30.426671 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:30.426671 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:30.437042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9ef133e3-caaf-4297-94af-3c8840a51947 req-ae6c9ef7-d647-4ff2-a66e-8435d57bd318 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.437907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9ef133e3-caaf-4297-94af-3c8840a51947 req-ae6c9ef7-d647-4ff2-a66e-8435d57bd318 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.451496 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9ef133e3-caaf-4297-94af-3c8840a51947 req-ae6c9ef7-d647-4ff2-a66e-8435d57bd318 service nova] Creating event network-vif-plugged:1402b4b5-4ffe-40e5-b42b-355e4a6d8792 for instance 7a074cfc-bc01-4936-ac34-cf31436b706d on nch2-master-1 Feb 12 21:07:30.458358 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9ef133e3-caaf-4297-94af-3c8840a51947 req-ae6c9ef7-d647-4ff2-a66e-8435d57bd318 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191319 Feb 12 21:07:30.465029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 865/1711] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:30.482831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:30.484293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:30.491753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.492502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.493621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.494422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.688015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:30.706725 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e2b2ffe-c44d-48d4-a57a-4575fbe170b6 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.418366 Feb 12 21:07:30.717598 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 847/1712] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:30 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:30.725019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbb0801a-f277-4765-86e8-7b9edf331cd9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe8740d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:30.725254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:30.739410 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5610e78-a6a3-4409-8f84-a68d743767e4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.272817 Feb 12 21:07:30.741613 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 866/1713] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:30 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:30.758440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:30.759373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:30.771363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-fbb0801a-f277-4765-86e8-7b9edf331cd9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:07:30.777639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-fbb0801a-f277-4765-86e8-7b9edf331cd9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:07:30.777639 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-fbb0801a-f277-4765-86e8-7b9edf331cd9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a does not exist Feb 12 21:07:30.777639 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-dfe258a9-a2cd-41dc-8158-9bd2eaa87d97'] Feb 12 21:07:30.778071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbb0801a-f277-4765-86e8-7b9edf331cd9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a does not exist Feb 12 21:07:30.778071 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-dfe258a9-a2cd-41dc-8158-9bd2eaa87d97'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:30.779913 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fbb0801a-f277-4765-86e8-7b9edf331cd9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a" status: 404 len: 194 microversion: 2.1 time: 0.059814 Feb 12 21:07:30.781302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 848/1714] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:07:30 2022] GET /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:30.794140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e99c7eb5-82fc-4d8a-9f38-a299b68bd53b req-77d29c4b-cb94-442b-9758-9478c70331d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960de3e9-1389-4350-bc25-24153c9bcff3", "tag": "48198fe1-46cc-4c9a-9c32-4aa850f6426a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:30.796693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.801013 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:30.801013 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:30.805726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.807884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.807884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.828597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e99c7eb5-82fc-4d8a-9f38-a299b68bd53b req-77d29c4b-cb94-442b-9758-9478c70331d8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.829847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e99c7eb5-82fc-4d8a-9f38-a299b68bd53b req-77d29c4b-cb94-442b-9758-9478c70331d8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.842767 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e99c7eb5-82fc-4d8a-9f38-a299b68bd53b req-77d29c4b-cb94-442b-9758-9478c70331d8 service nova] Creating event network-changed:48198fe1-46cc-4c9a-9c32-4aa850f6426a for instance 960de3e9-1389-4350-bc25-24153c9bcff3 on nch1-master-1 Feb 12 21:07:30.848398 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e99c7eb5-82fc-4d8a-9f38-a299b68bd53b req-77d29c4b-cb94-442b-9758-9478c70331d8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065174 Feb 12 21:07:30.848993 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 849/1715] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:30.856166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:30.857078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:30.867393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.871309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.871309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:30.871965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:30.906042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:31.054466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:31.064747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:31.074203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:31.076794 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f8d7e3f-a234-4459-b6ce-fd6a0e4bef8c tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.332860 Feb 12 21:07:31.080240 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 867/1716] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:30 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:31.085165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:31.097229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:31.115353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:31.122602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:31.122602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:31.122862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:31.448232 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-768389cb-9ddc-42a0-b5f8-bcbf955bce35 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 204 len: 0 microversion: 2.1 time: 0.596727 Feb 12 21:07:31.452292 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 850/1717] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:30 2022] DELETE /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:31.455683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5a88637-b4e7-44fc-b87d-18225497454a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fe87e8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1936632401", "description": "tempest-description-476307490"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:31.492030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:31.500997 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db7f81ee-b0f9-4ca5-b5af-b0a51e1e0344 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.419373 Feb 12 21:07:31.501643 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 868/1718] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:31 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:31.508144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:31.508956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:31.517151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:31.517882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:31.518886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:31.528139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:31.782086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:31.793807 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e579abfd-060b-414b-83cf-c1623a2111b6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1470 microversion: 2.1 time: 0.289525 Feb 12 21:07:31.803448 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 869/1719] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:31 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:31.812647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:31.813787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:31.823332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:31.824028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:31.825205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:31.825839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.035515 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5a88637-b4e7-44fc-b87d-18225497454a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.578697 Feb 12 21:07:32.035515 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 851/1720] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:07:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:32.035971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:32.037221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:32.045120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.045864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.047020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.047680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.156783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.166457 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5570bf2a-7b3c-476c-a538-1e9a1ad38244 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1474 microversion: 2.1 time: 0.366672 Feb 12 21:07:32.173562 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 870/1721] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:31 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:32.182666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:32.187374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:32.204689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.205406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.207736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.210190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.267054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.279488 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-373973d3-1d86-4a21-ba7d-7283c310c733 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.243239 Feb 12 21:07:32.279488 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 852/1722] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:32 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:32.280969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80e63f98-3887-47cd-841a-28dc2e1f93e4 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fe87edc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-473569857", "description": "tempest-description-1275428744"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:32.422819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.432086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-01038811-c67a-45af-acbb-24711964e920 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.257134 Feb 12 21:07:32.434528 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 871/1723] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:32 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:32.445375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:32.449971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:32.453583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.453583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.454575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.454575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.675271 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80e63f98-3887-47cd-841a-28dc2e1f93e4 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.398594 Feb 12 21:07:32.679868 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 853/1724] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:07:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:32.682026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:32.682631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:32.690643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.692076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.692607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.693520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:32.694028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:32.700121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.710319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.712137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2f1bfc5-c6f0-4635-92e7-ac049e0c2f83 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.276289 Feb 12 21:07:32.725365 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 872/1725] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:32 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:32.731730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c59d32dd-a626-43fd-a5fb-5cfdb317eec6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fdea00d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1377054330", "description": "tempest-description-1706789125"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:32.969080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:32.980638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cead6eae-d38e-4452-bf9c-6be7f865f270 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.302058 Feb 12 21:07:32.981253 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 854/1726] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:32 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:32.996620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:32.996620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:33.003127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.003646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.004747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.005322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.189139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:33.197752 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-af02048c-b2bd-436d-beb0-f732132d3b7e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1463 microversion: 2.1 time: 0.205337 Feb 12 21:07:33.198970 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 855/1727] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:32 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1463 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:33.203899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-05f1687a-66d3-4880-b01f-87b028ec3245 req-b8f93ee9-ba1e-45b9-bde2-0cd26ba80058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "name": "network-vif-plugged", "status": "completed", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:33.205574 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:33.205574 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:33.212748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-05f1687a-66d3-4880-b01f-87b028ec3245 req-b8f93ee9-ba1e-45b9-bde2-0cd26ba80058 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.213195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-05f1687a-66d3-4880-b01f-87b028ec3245 req-b8f93ee9-ba1e-45b9-bde2-0cd26ba80058 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.227601 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-05f1687a-66d3-4880-b01f-87b028ec3245 req-b8f93ee9-ba1e-45b9-bde2-0cd26ba80058 service nova] Creating event network-vif-plugged:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch2-master-1 Feb 12 21:07:33.234245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-05f1687a-66d3-4880-b01f-87b028ec3245 req-b8f93ee9-ba1e-45b9-bde2-0cd26ba80058 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Feb 12 21:07:33.235303 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 856/1728] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:33.240835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:33.242180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:33.250742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.252166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.253308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.253910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.283550 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c59d32dd-a626-43fd-a5fb-5cfdb317eec6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.551759 Feb 12 21:07:33.283550 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 873/1729] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:07:32 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:33.289145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:33.290619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:33.323242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.331755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.340993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.341847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.440686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:33.450375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee9c69ea-0cff-48dd-8632-930a14d610f2 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1474 microversion: 2.1 time: 0.213755 Feb 12 21:07:33.465223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 857/1730] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:33 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:33.477107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c173522c-7302-4cf5-9c54-c9fe232fb0bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe9e9430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:33.535699 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8d3b0ebb-076c-4e3d-a3ad-51be73feb2c2 tempest-MigrationsAdminTest-852035181 tempest-MigrationsAdminTest-852035181-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1614 microversion: 2.1 time: 0.255103 Feb 12 21:07:33.547596 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 874/1731] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:33 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1614 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:33.547596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:33.547596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:33.563870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.565128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.566033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.566469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.824344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:33.833919 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bc52e1f4-4134-4a0d-b351-fe908892d2da tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.294582 Feb 12 21:07:33.839593 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 875/1732] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:33 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:33.863631 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c173522c-7302-4cf5-9c54-c9fe232fb0bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.401978 Feb 12 21:07:33.865135 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 858/1733] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:07:33 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:33.871997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:33.872833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:33.888766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.889627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.891563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:33.894250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:33.955206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:34.225261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:34.225979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:34.236873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.237761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.238846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.241451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.270638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a39cd9a-db66-4f44-b1d2-432cacb52e47 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 204 len: 0 microversion: 2.1 time: 0.403855 Feb 12 21:07:34.271658 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 859/1734] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:33 2022] DELETE /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:34.279217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:34.279975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:34.308591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.309080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.313778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.322485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.506416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:34.517458 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c13a451-c631-4b9c-8072-1720465a4298 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1199 microversion: 2.1 time: 0.676450 Feb 12 21:07:34.518797 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 876/1735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:33 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1199 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:34.524300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b9f969f-433e-4182-b70e-8ad9a5d5fe49 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa9043f0790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:34.707007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:34.722621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:34.724187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:34.725329 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ef5446d-cb57-4faa-ac90-c4896579cb4b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.452226 Feb 12 21:07:34.734428 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 860/1736] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:34 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:34.736064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:34.736686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:34.742790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.743251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.744048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.745163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.878173 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b9f969f-433e-4182-b70e-8ad9a5d5fe49 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/cc5a716a-e685-4d55-80f5-35855cc4f479" status: 202 len: 0 microversion: 2.1 time: 0.356463 Feb 12 21:07:34.878173 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 877/1737] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:07:34 2022] DELETE /compute/v2.1/os-security-groups/cc5a716a-e685-4d55-80f5-35855cc4f479 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:34.883299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:34.884164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:34.899380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.899856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:34.900682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:34.901121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.026327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:35.038405 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f097977e-aaac-4de0-949b-b225627d3a89 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.305627 Feb 12 21:07:35.045505 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 861/1738] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:34 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:35.056382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:35.058351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:35.071522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.074209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.077094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.077251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.113790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:35.123012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5630a130-cea0-4ddd-807e-5b8ecc5a1439 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1469 microversion: 2.1 time: 0.243744 Feb 12 21:07:35.125871 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 878/1739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:34 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:35.281731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1333740846", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:35.313156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:35.323686 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-def7aa56-babf-488a-b7ba-0650622d0cff tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1474 microversion: 2.1 time: 0.282026 Feb 12 21:07:35.325331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 862/1740] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:35 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:35.330032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:35.330962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:35.355185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.355657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.356477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.356920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.364697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:07:35.617695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:07:35.618683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:07:35.618943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:07:35.619606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:07:35.620777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:07:35.633828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.634526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.635563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.636804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.658188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Getting quotas for project faa00c6b01804208ae04a7174e6de8d4. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:35.660538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:35.664537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Getting quotas for user 710b728c93884345880ac8350d76e915 and project faa00c6b01804208ae04a7174e6de8d4. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:35.679812 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f04d8ee-b704-42c1-8129-6f2aee83fd1d tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.353158 Feb 12 21:07:35.681097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:07:35.685309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:07:35.685533 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 863/1741] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:35 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:35.736834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3375b344-879e-4e9a-b556-1f48899cf4f8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe9e9ee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:35.824806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-3375b344-879e-4e9a-b556-1f48899cf4f8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc5a716a-e685-4d55-80f5-35855cc4f479 does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:07:35.825440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-3375b344-879e-4e9a-b556-1f48899cf4f8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group cc5a716a-e685-4d55-80f5-35855cc4f479 not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:07:35.826186 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3375b344-879e-4e9a-b556-1f48899cf4f8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group cc5a716a-e685-4d55-80f5-35855cc4f479 does not exist Feb 12 21:07:35.826186 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-a241feab-10e9-4d53-bc9c-ef28266cc20f'] Feb 12 21:07:35.827333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3375b344-879e-4e9a-b556-1f48899cf4f8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group cc5a716a-e685-4d55-80f5-35855cc4f479 does not exist Feb 12 21:07:35.827333 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-a241feab-10e9-4d53-bc9c-ef28266cc20f'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:35.830408 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3375b344-879e-4e9a-b556-1f48899cf4f8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/cc5a716a-e685-4d55-80f5-35855cc4f479" status: 404 len: 194 microversion: 2.1 time: 0.140901 Feb 12 21:07:35.831895 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 864/1742] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:07:35 2022] GET /compute/v2.1/os-security-groups/cc5a716a-e685-4d55-80f5-35855cc4f479 => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:35.845224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:35.846118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:35.865467 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2d27f8b-8552-4217-9826-d4ee20979879 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740366 Feb 12 21:07:35.871110 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 879/1743] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:07:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:07:35.880806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.884862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.888622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.888778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:35.889559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.891007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:35.907704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.908178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:35.909082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:35.909556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:36.204475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:36.216032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:36.217754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:36.223612 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98c3b519-5527-4609-97c7-f30056d7d1ca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.341437 Feb 12 21:07:36.235519 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 880/1744] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:35 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:36.241520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f20269b3-980f-4ab5-bd08-c7a9080b88dc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe6f34c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:36.625656 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f20269b3-980f-4ab5-bd08-c7a9080b88dc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/105f1518-12ca-4571-885b-4d90fab2abe0" status: 202 len: 0 microversion: 2.1 time: 0.399692 Feb 12 21:07:36.626984 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 881/1745] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:07:36 2022] DELETE /compute/v2.1/os-security-groups/105f1518-12ca-4571-885b-4d90fab2abe0 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:36.635693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7ee7f72-2c9f-4af4-ab5b-c70fe2fbf466 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:36.637655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7ee7f72-2c9f-4af4-ab5b-c70fe2fbf466 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:36.758260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7ee7f72-2c9f-4af4-ab5b-c70fe2fbf466 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:36.764073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:36.768033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7ee7f72-2c9f-4af4-ab5b-c70fe2fbf466 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1214 microversion: 2.1 time: 0.139438 Feb 12 21:07:36.777998 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-019b03da-2a85-41b1-b4b6-c887cb3735c8 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1382 microversion: 2.1 time: 0.941468 Feb 12 21:07:36.778851 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 865/1747] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:35 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1382 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:36.778989 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 882/1747] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:36 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:36.784013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b125db20-9611-4383-8088-06ccbdcfa204 req-a366b0ec-9961-44a2-8903-6c740f594e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d5abda-386d-4eb8-ab12-caf696303db0", "name": "network-vif-plugged", "status": "completed", "tag": "d6102892-165a-4568-bed4-24217882b194"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:36.784303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:36.786542 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:36.786542 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:36.790654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:36.795917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b125db20-9611-4383-8088-06ccbdcfa204 req-a366b0ec-9961-44a2-8903-6c740f594e25 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:36.796663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b125db20-9611-4383-8088-06ccbdcfa204 req-a366b0ec-9961-44a2-8903-6c740f594e25 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:36.809028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:36.809923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:36.810960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:36.813500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:36.819627 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b125db20-9611-4383-8088-06ccbdcfa204 req-a366b0ec-9961-44a2-8903-6c740f594e25 service nova] Creating event network-vif-plugged:d6102892-165a-4568-bed4-24217882b194 for instance c8d5abda-386d-4eb8-ab12-caf696303db0 on nch1-master-1 Feb 12 21:07:36.826610 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b125db20-9611-4383-8088-06ccbdcfa204 req-a366b0ec-9961-44a2-8903-6c740f594e25 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 Feb 12 21:07:36.827728 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 883/1748] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:36.834565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:36.835638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:36.853606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:36.854184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:36.855840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:36.856573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.069670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.082624 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c1ddddf-d458-4e3d-8595-368b2c361851 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1469 microversion: 2.1 time: 0.252802 Feb 12 21:07:37.083667 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 884/1749] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:36 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:37.091996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.092848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:37.100570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.101326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.102456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.103291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.145072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.156790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a3dbe3f-d54e-4b2c-88b0-b9330ef9577c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.376214 Feb 12 21:07:37.158154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 866/1750] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:36 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:37.162640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcc1f411-bd46-4f08-9a55-aaaaf1c5f475 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe871160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.205082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.215003 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d69fea5d-cfca-4ef7-a9e6-18cc6985e81d tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1432 microversion: 2.1 time: 0.129709 Feb 12 21:07:37.226537 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 885/1751] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:37 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1432 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:37.231668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.231852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-bcc1f411-bd46-4f08-9a55-aaaaf1c5f475 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 105f1518-12ca-4571-885b-4d90fab2abe0 does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:07:37.232352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:37.232833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-bcc1f411-bd46-4f08-9a55-aaaaf1c5f475 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group 105f1518-12ca-4571-885b-4d90fab2abe0 not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:07:37.233182 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bcc1f411-bd46-4f08-9a55-aaaaf1c5f475 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group 105f1518-12ca-4571-885b-4d90fab2abe0 does not exist Feb 12 21:07:37.233182 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-427d5fa8-b6d2-483f-8570-7ab7a5b88071'] Feb 12 21:07:37.233902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcc1f411-bd46-4f08-9a55-aaaaf1c5f475 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group 105f1518-12ca-4571-885b-4d90fab2abe0 does not exist Feb 12 21:07:37.233902 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-427d5fa8-b6d2-483f-8570-7ab7a5b88071'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:37.234838 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcc1f411-bd46-4f08-9a55-aaaaf1c5f475 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/105f1518-12ca-4571-885b-4d90fab2abe0" status: 404 len: 194 microversion: 2.1 time: 0.075587 Feb 12 21:07:37.235466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 867/1752] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:07:37 2022] GET /compute/v2.1/os-security-groups/105f1518-12ca-4571-885b-4d90fab2abe0 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:37.240480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.241324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.242304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.242553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.242909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:37.243291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.267013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.267782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.269042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.270091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.506964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-17412eb6-53a8-4acc-a030-49c2cc57c5ae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1533 microversion: 2.1 time: 0.270204 Feb 12 21:07:37.515284 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 868/1753] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:37 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1533 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:37.525433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.526347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:37.532309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.535853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.536306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.537543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.538765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.540085 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cb440434-2822-40d6-bd5b-bea2e772fea8 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.312250 Feb 12 21:07:37.546459 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 886/1754] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:37 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:37.551601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd1358e4-d8fa-4465-8cd0-27068b27724f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa9042fd3a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.836300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.878403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.890956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:37.897585 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ec5fe66e-4eab-4b83-89ee-fcb250cf3bb4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1279 microversion: 2.25 time: 0.378572 Feb 12 21:07:37.897585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 869/1755] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:37 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1279 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:37.909615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-28e99960-a23d-4f63-a988-e8573b4f0fc7 req-a49fd1b8-aa05-45f0-b5dc-1d9fe91e962b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0ea6f0a-e322-4f50-8683-2511dce11a6b", "name": "network-vif-deleted", "tag": "1dcd7742-1914-4434-a268-34bdc3f688d2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:37.913266 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:37.913266 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:37.936306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-28e99960-a23d-4f63-a988-e8573b4f0fc7 req-a49fd1b8-aa05-45f0-b5dc-1d9fe91e962b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.937922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-28e99960-a23d-4f63-a988-e8573b4f0fc7 req-a49fd1b8-aa05-45f0-b5dc-1d9fe91e962b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.955738 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-28e99960-a23d-4f63-a988-e8573b4f0fc7 req-a49fd1b8-aa05-45f0-b5dc-1d9fe91e962b service nova] Creating event network-vif-deleted:1dcd7742-1914-4434-a268-34bdc3f688d2 for instance b0ea6f0a-e322-4f50-8683-2511dce11a6b on nch2-master-1 Feb 12 21:07:37.961170 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-28e99960-a23d-4f63-a988-e8573b4f0fc7 req-a49fd1b8-aa05-45f0-b5dc-1d9fe91e962b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059406 Feb 12 21:07:37.962042 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 870/1756] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:37.972746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:37.973965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:37.981563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.983695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:37.984860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:37.985677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.146074 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd1358e4-d8fa-4465-8cd0-27068b27724f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/d0afa1e6-7836-49e2-b02c-3c6e480e9239" status: 202 len: 0 microversion: 2.1 time: 0.598159 Feb 12 21:07:38.150030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 887/1757] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:07:37 2022] DELETE /compute/v2.1/os-security-groups/d0afa1e6-7836-49e2-b02c-3c6e480e9239 => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:38.155336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:38.159890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:38.207632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.209374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.212895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.220770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.374918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:38.392109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd6ac82e-7441-4b79-a202-b60c24387a2d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1210 microversion: 2.1 time: 0.239385 Feb 12 21:07:38.393277 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 888/1758] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:38 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1210 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:38.423884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:38.426803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:38.442283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.445464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.446568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.447273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.480286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d990f36-ca2d-4251-b6ce-629d15ff7bbc tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1533 microversion: 2.1 time: 0.511761 Feb 12 21:07:38.494081 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 871/1759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:37 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1533 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:38.519164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bf06926-e61b-4905-b890-88609fe74d81 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe9e91f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:38.583503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-9bf06926-e61b-4905-b890-88609fe74d81 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:07:38.584084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-9bf06926-e61b-4905-b890-88609fe74d81 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:07:38.584614 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9bf06926-e61b-4905-b890-88609fe74d81 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 does not exist Feb 12 21:07:38.584614 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-f190459d-c21e-46f0-a18d-0420d42df9b7'] Feb 12 21:07:38.585209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bf06926-e61b-4905-b890-88609fe74d81 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 does not exist Feb 12 21:07:38.585209 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-f190459d-c21e-46f0-a18d-0420d42df9b7'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:38.586251 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9bf06926-e61b-4905-b890-88609fe74d81 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/d0afa1e6-7836-49e2-b02c-3c6e480e9239" status: 404 len: 194 microversion: 2.1 time: 0.090835 Feb 12 21:07:38.590740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 872/1760] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:07:38 2022] GET /compute/v2.1/os-security-groups/d0afa1e6-7836-49e2-b02c-3c6e480e9239 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:38.594996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:38.597028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:38.610400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.611019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.613117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.613755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.703291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:38.718357 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3d522a16-9cd6-48b1-a8da-44a7f77db991 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1469 microversion: 2.1 time: 0.323675 Feb 12 21:07:38.720009 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 889/1761] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:38 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:38.725457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:38.728563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:38.748984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.753421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.754125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.759862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.854463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:38.855510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:38.856038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lazy-loading 'fault' on Instance uuid b0ea6f0a-e322-4f50-8683-2511dce11a6b {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:38.925328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:38.940190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a373dea-3751-4279-a4a1-bd8c771ee33e tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 200 len: 1308 microversion: 2.1 time: 0.218329 Feb 12 21:07:38.942708 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 890/1762] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:38 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:38.947331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1573495c-fad9-4190-aca6-8721248bdc5c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:38.991041 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:38.991041 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:39.007409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1573495c-fad9-4190-aca6-8721248bdc5c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.013565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1573495c-fad9-4190-aca6-8721248bdc5c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.018020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:39.019649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1573495c-fad9-4190-aca6-8721248bdc5c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.019789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1573495c-fad9-4190-aca6-8721248bdc5c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.027368 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1bd07d3e-e13e-479d-88d4-0edb4ecc07c3 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.438446 Feb 12 21:07:39.031403 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 873/1763] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:38 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:39.047970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:39.051116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:39.062492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.065662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.065662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.065662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.128200 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1573495c-fad9-4190-aca6-8721248bdc5c tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.183604 Feb 12 21:07:39.129159 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 891/1764] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:07:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:39.142340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-11038b2c-4809-4491-9ffc-2495075a3b8b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe6f3310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:39.481733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:39.499245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-714da063-77af-46b1-9244-139f8b6c25c3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.457165 Feb 12 21:07:39.502884 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 874/1765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:39 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:39.517769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0952341d-3887-4d16-8b4b-461a11b88195 req-3751441a-3c26-4f30-9ca6-25c13f4477b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960de3e9-1389-4350-bc25-24153c9bcff3", "name": "network-vif-plugged", "status": "completed", "tag": "48198fe1-46cc-4c9a-9c32-4aa850f6426a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:39.519421 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:39.519421 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:39.550495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0952341d-3887-4d16-8b4b-461a11b88195 req-3751441a-3c26-4f30-9ca6-25c13f4477b1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.550973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0952341d-3887-4d16-8b4b-461a11b88195 req-3751441a-3c26-4f30-9ca6-25c13f4477b1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.588006 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0952341d-3887-4d16-8b4b-461a11b88195 req-3751441a-3c26-4f30-9ca6-25c13f4477b1 service nova] Creating event network-vif-plugged:48198fe1-46cc-4c9a-9c32-4aa850f6426a for instance 960de3e9-1389-4350-bc25-24153c9bcff3 on nch1-master-1 Feb 12 21:07:39.607597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0952341d-3887-4d16-8b4b-461a11b88195 req-3751441a-3c26-4f30-9ca6-25c13f4477b1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103203 Feb 12 21:07:39.608762 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 875/1766] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:39.619226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:39.621500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:39.640509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.646239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.646239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.646239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.873556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-11038b2c-4809-4491-9ffc-2495075a3b8b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.738694 Feb 12 21:07:39.885226 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 892/1767] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:07:39 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:39.893113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:39.894579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:39.919604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.923423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.924649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:39.926497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:39.962520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lazy-loading 'flavor' on Instance uuid 7a074cfc-bc01-4936-ac34-cf31436b706d {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:39.988320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Going to try to live migrate instance to nch1-master-1 {{(pid=141726) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:07:40.309865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:40.314895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:40.317241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:40.318433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a1702b9-d29a-4414-902b-c1f728535a49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1475 microversion: 2.25 time: 0.707014 Feb 12 21:07:40.330029 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 876/1768] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:39 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1475 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:40.330029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:40.342168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:40.350387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:40.350881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:40.352167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:40.352812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:40.449468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:40.457511 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-763c35bb-00a0-4f3e-a950-8fc181cef292 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1284 microversion: 2.1 time: 0.137460 Feb 12 21:07:40.458527 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 877/1769] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:40 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:40.463086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:40.463750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:40.474180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:40.475242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:40.477693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:40.478372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:40.667471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:40.677041 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0d72492c-9e6f-48c2-82fb-e5fb6855cd27 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 200 len: 1469 microversion: 2.1 time: 0.217582 Feb 12 21:07:40.698057 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 878/1770] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:40 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:40.723341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1511c754-1087-4fce-b363-13bc186563eb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fe8abc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-898411727", "description": "tempest-description-835360345"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:41.482454 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1511c754-1087-4fce-b363-13bc186563eb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.770180 Feb 12 21:07:41.483464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 879/1771] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:07:40 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:41.498140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:41.499206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: b0ea6f0a-e322-4f50-8683-2511dce11a6b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:41.516573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.517786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:41.518928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.519753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:41.570263 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance b0ea6f0a-e322-4f50-8683-2511dce11a6b could not be found. Feb 12 21:07:41.570263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance b0ea6f0a-e322-4f50-8683-2511dce11a6b could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:41.570263 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd725d34-616b-4ef2-a35d-782fdb9cec47 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b" status: 404 len: 111 microversion: 2.1 time: 0.068658 Feb 12 21:07:41.570263 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 880/1772] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:41 2022] GET /compute/v2.1/servers/b0ea6f0a-e322-4f50-8683-2511dce11a6b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:41.570263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:41.570878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:41.570878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.570878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:41.572444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.573110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:41.780844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:41.792807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5470caa1-7394-4bb9-aec7-b1b5e913e164 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1291 microversion: 2.1 time: 0.235726 Feb 12 21:07:41.794757 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 881/1773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:41 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1291 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:41.799940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-10671da6-d44d-4dd6-899b-32a2f297b4e0 req-3537484e-ddd7-4451-8a3b-109e855821be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11cb772b-44b0-4edd-8aa7-c510b2a7211a", "name": "network-vif-deleted", "tag": "00fe00bc-2807-4800-866f-306a75719cca"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:41.801786 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:41.801786 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:41.817779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-10671da6-d44d-4dd6-899b-32a2f297b4e0 req-3537484e-ddd7-4451-8a3b-109e855821be service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.819790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-10671da6-d44d-4dd6-899b-32a2f297b4e0 req-3537484e-ddd7-4451-8a3b-109e855821be service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:41.836636 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-10671da6-d44d-4dd6-899b-32a2f297b4e0 req-3537484e-ddd7-4451-8a3b-109e855821be service nova] Creating event network-vif-deleted:00fe00bc-2807-4800-866f-306a75719cca for instance 11cb772b-44b0-4edd-8aa7-c510b2a7211a on nch2-master-1 Feb 12 21:07:41.845889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-10671da6-d44d-4dd6-899b-32a2f297b4e0 req-3537484e-ddd7-4451-8a3b-109e855821be service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048573 Feb 12 21:07:41.850525 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 882/1774] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:41.852201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:41.853131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:41.860716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.861187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:41.862206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:41.862674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:42.192688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid c8d5abda-386d-4eb8-ab12-caf696303db0 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:42.231292 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b6b9929-9735-486b-ac6d-a7b6d7c62f6f tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1966 microversion: 2.25 time: 0.368111 Feb 12 21:07:42.231292 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 883/1775] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:41 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1966 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:42.231564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:42.233823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:42.251757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:42.252235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:42.253124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:42.253655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:42.565156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:42.572750 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-438b75dd-b2a7-4752-888f-64313de6c525 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.355037 Feb 12 21:07:42.573518 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 884/1776] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:42 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:42.578991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6af604f2-b2b2-4406-9173-abd6ac2ce212 req-50db0532-9104-43d9-8a5f-a7212413f3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797b169-2b9f-4af0-a818-0caa7d2ed40a", "name": "network-vif-deleted", "tag": "b5cbc34b-0e81-4b41-9709-0fdcadb7ac77"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:42.580693 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:42.580693 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:42.587793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6af604f2-b2b2-4406-9173-abd6ac2ce212 req-50db0532-9104-43d9-8a5f-a7212413f3a5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:42.588257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6af604f2-b2b2-4406-9173-abd6ac2ce212 req-50db0532-9104-43d9-8a5f-a7212413f3a5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:42.600048 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6af604f2-b2b2-4406-9173-abd6ac2ce212 req-50db0532-9104-43d9-8a5f-a7212413f3a5 service nova] Creating event network-vif-deleted:b5cbc34b-0e81-4b41-9709-0fdcadb7ac77 for instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a on nch2-master-1 Feb 12 21:07:42.605571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6af604f2-b2b2-4406-9173-abd6ac2ce212 req-50db0532-9104-43d9-8a5f-a7212413f3a5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029954 Feb 12 21:07:42.606488 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 885/1777] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:42.612060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:42.612520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:42.623108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:42.623740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:42.624595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:42.625038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:42.781720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:42.789209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6da09948-75f7-4d9a-875c-d1058a4b97ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1314 microversion: 2.1 time: 0.181581 Feb 12 21:07:42.799301 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 886/1778] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:42 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:42.799301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-372b1f20-999e-4853-a3c6-4073ec12b067 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8fe871280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1145447129", "description": "tempest-description-1429366145"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:44.082552 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-372b1f20-999e-4853-a3c6-4073ec12b067 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.289374 Feb 12 21:07:44.082552 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 887/1779] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:07:42 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:44.085312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.085960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 11cb772b-44b0-4edd-8aa7-c510b2a7211a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.092681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.093133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.094073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.094790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.109385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance 11cb772b-44b0-4edd-8aa7-c510b2a7211a could not be found. Feb 12 21:07:44.110070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance 11cb772b-44b0-4edd-8aa7-c510b2a7211a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:44.111058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d913fd1-9ad9-46ea-8eab-7c1e45994949 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a" status: 404 len: 111 microversion: 2.1 time: 0.029260 Feb 12 21:07:44.111984 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 888/1780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:44 2022] GET /compute/v2.1/servers/11cb772b-44b0-4edd-8aa7-c510b2a7211a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:44.118970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.118970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 4797b169-2b9f-4af0-a818-0caa7d2ed40a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.123667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.124164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.125057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.125536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.146675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] HTTP exception thrown: Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a could not be found. Feb 12 21:07:44.146675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Returning 404 to user: Instance 4797b169-2b9f-4af0-a818-0caa7d2ed40a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:44.146675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2f1ea0c7-f10f-45ba-8587-b7fe5b1ba96b tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a" status: 404 len: 111 microversion: 2.1 time: 0.029521 Feb 12 21:07:44.146675 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 889/1781] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:44 2022] GET /compute/v2.1/servers/4797b169-2b9f-4af0-a818-0caa7d2ed40a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:44.148298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.149468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.156337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.156794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.157670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.158107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.294521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid c8d5abda-386d-4eb8-ab12-caf696303db0 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:44.307702 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c6d878eb-7939-43c7-847a-e293d0e5311e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1966 microversion: 2.25 time: 0.163476 Feb 12 21:07:44.308409 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 890/1782] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:44 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1966 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:44.312662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.313270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.319341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.320419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.321245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.321740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.326025 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ed26788-739f-46a9-aeb9-9f81bb41fa13 tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d/action" status: 202 len: 0 microversion: 2.1 time: 4.438743 Feb 12 21:07:44.326649 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 893/1783] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:39 2022] POST /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d/action => generated 0 bytes in 4441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:44.331320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.331936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.339816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.340560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.341404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.341849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.474642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:44.488788 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-18a32a48-91c8-49b9-b40b-6ec6cc0a1fe4 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1482 microversion: 2.1 time: 0.179164 Feb 12 21:07:44.489235 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 891/1784] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:44 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1482 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:44.491544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:44.499822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3b8b1b8-b8b7-4c8b-ada8-1bc21fd6d0dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.172162 Feb 12 21:07:44.500654 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 894/1785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:44 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:44.514897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.514897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.515121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ccc9c0a7-5e05-4b88-acfa-6fffa55d71c4 req-b8defa0c-6141-4ae3-b6ac-354dba34010a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956a366a-cf37-4899-bfe1-0a1753a49e8f", "tag": "4626eaa8-b36f-4ef5-9cd4-400d59ca0c31"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:44.515121 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:44.515121 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:44.515363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.515363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.515363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.515363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.515653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ccc9c0a7-5e05-4b88-acfa-6fffa55d71c4 req-b8defa0c-6141-4ae3-b6ac-354dba34010a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.515653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ccc9c0a7-5e05-4b88-acfa-6fffa55d71c4 req-b8defa0c-6141-4ae3-b6ac-354dba34010a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.528349 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ccc9c0a7-5e05-4b88-acfa-6fffa55d71c4 req-b8defa0c-6141-4ae3-b6ac-354dba34010a service nova] Creating event network-changed:4626eaa8-b36f-4ef5-9cd4-400d59ca0c31 for instance 956a366a-cf37-4899-bfe1-0a1753a49e8f on nch2-master-1 Feb 12 21:07:44.533713 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ccc9c0a7-5e05-4b88-acfa-6fffa55d71c4 req-b8defa0c-6141-4ae3-b6ac-354dba34010a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031796 Feb 12 21:07:44.534334 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 895/1786] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:44.539420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4154e654-c1c8-4bcd-8201-cc24cd353ad6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.619395 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4154e654-c1c8-4bcd-8201-cc24cd353ad6 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/a4c5058a-b9f6-4e1c-93ce-b85566e53690" status: 204 len: 0 microversion: 2.1 time: 0.083816 Feb 12 21:07:44.623683 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 896/1787] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:07:44 2022] DELETE /compute/v2.1/os-server-groups/a4c5058a-b9f6-4e1c-93ce-b85566e53690 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:44.627640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:44.628268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:44.635364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.636578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.637261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:44.637724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:44.663122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:44.753741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:44.762830 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d6d8c7c-879f-45e9-9020-18a1558fdcd2 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1314 microversion: 2.1 time: 0.263417 Feb 12 21:07:44.763540 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 892/1788] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:44 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:44.769116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-925162781", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "500b8539-c5e5-4f3e-8048-ff853db68c9e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:44.826236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] validate_networks() for [('500b8539-c5e5-4f3e-8048-ff853db68c9e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:07:45.002647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-12298dce-e535-4dc0-b036-bc15f12b6d33 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 204 len: 0 microversion: 2.1 time: 0.380517 Feb 12 21:07:45.003263 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 897/1789] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:44 2022] DELETE /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:45.009196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bdff0b0b-8cfc-4aff-bc22-20a108479f25 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:45.010853 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:45.010853 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:45.012647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdff0b0b-8cfc-4aff-bc22-20a108479f25 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.013198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdff0b0b-8cfc-4aff-bc22-20a108479f25 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.014131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdff0b0b-8cfc-4aff-bc22-20a108479f25 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.014640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdff0b0b-8cfc-4aff-bc22-20a108479f25 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.039415 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bdff0b0b-8cfc-4aff-bc22-20a108479f25 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034909 Feb 12 21:07:45.040156 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 898/1790] 10.222.0.31 () {60 vars in 1216 bytes} [Sat Feb 12 21:07:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:07:45.045722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:45.046469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:45.053233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.053739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.054551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.055049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.205779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:45.213916 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7076d39-4b79-4dc7-b3ee-84f740dee1b0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1392 microversion: 2.1 time: 0.172643 Feb 12 21:07:45.214582 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 899/1791] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:45 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:45.226256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:45.226761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:45.233855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.235789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.235789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.235789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.328174 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68b317be-6f45-4680-a8a2-6237cd07b410 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105825 Feb 12 21:07:45.329821 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 900/1792] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:07:45 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:45.334124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:45.334726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:45.341426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.343844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.343844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.343844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.377092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:45.681876 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a8bb2cf6-a8c1-4eb7-8820-b8749645798c tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 204 len: 0 microversion: 2.1 time: 0.351148 Feb 12 21:07:45.685876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 901/1793] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:45 2022] DELETE /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:45.692109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:45.692925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:45.710385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.710385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.710385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.710385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.945760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:45.956167 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4fb37481-806a-4dac-8c78-8246d9e7b301 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1532 microversion: 2.1 time: 0.268551 Feb 12 21:07:45.966364 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 902/1794] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:45 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1532 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:45.966364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:45.966364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:45.972465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.973003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.973920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:45.974423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:45.999141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'flavor' on Instance uuid c8d5abda-386d-4eb8-ab12-caf696303db0 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:46.013263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Going to try to live migrate instance to nch2-master-1 {{(pid=141726) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:07:46.089411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:07:46.091191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:07:46.091934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:07:46.092549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:07:46.093177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:07:46.105004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:46.105529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:46.108558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:46.108558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:46.123975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Getting quotas for project 225507fa1fa946aa9559a89fe27569b3. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:07:46.129275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Getting quotas for user e6167cc3c6664a01adb3a4ac3118fc38 and project 225507fa1fa946aa9559a89fe27569b3. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:07:46.142409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:07:46.144744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:07:46.284657 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c32fda1a-7041-41b1-9b62-5f37b56042bb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519704 Feb 12 21:07:46.286004 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 893/1795] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:07:46.291000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:46.292012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:46.298715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:46.299220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:46.300028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:46.301456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:46.515602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:46.533022 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-59835e48-a8a9-4867-ad5d-8ec070bb6963 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.245536 Feb 12 21:07:46.534088 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 894/1796] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:46 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:46.548734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:46.549647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:46.565913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:46.566798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:46.567895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:46.571632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:47.095337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:47.109744 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7cfe2c68-7a0b-4d3b-9893-5c37f5ebe806 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1473 microversion: 2.1 time: 0.571176 Feb 12 21:07:47.113911 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 895/1797] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:46 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1473 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:47.127777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:47.128417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:47.142317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:47.143046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:47.144353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:47.147362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:47.610224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:47.614237 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4265b94-908e-42af-97ca-ae98e41a3b7c tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1314 microversion: 2.1 time: 0.498907 Feb 12 21:07:47.624872 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 896/1798] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:47 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:47.630752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:47.631757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:47.644841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:47.644841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:47.644841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:47.644841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.017808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:48.038562 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84f305d1-2ce8-4bb4-bdc7-694949311cd4 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1392 microversion: 2.1 time: 0.411794 Feb 12 21:07:48.048364 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 897/1799] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:47 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1392 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:48.060422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:48.061053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:48.069897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.070364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.071237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.071705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.216473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:48.228722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dde12d5f-f461-495c-8ea4-4ba03dc1b3d5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1267 microversion: 2.1 time: 0.182006 Feb 12 21:07:48.231511 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 898/1800] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:48 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:48.238158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:48.239088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:48.246994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.247450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.248270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.248895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.561402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:48.575671 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-28f0a526-0493-484f-be76-c340b066a6ea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1482 microversion: 2.1 time: 0.343996 Feb 12 21:07:48.580592 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 899/1801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:48 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1482 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:48.599879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-09d93602-ece7-4ff7-acd9-668878e4dde6 req-938ab2e9-a96b-470f-8b25-55c820cb9ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960de3e9-1389-4350-bc25-24153c9bcff3", "tag": "48198fe1-46cc-4c9a-9c32-4aa850f6426a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:48.601910 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:48.601910 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:48.610395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-09d93602-ece7-4ff7-acd9-668878e4dde6 req-938ab2e9-a96b-470f-8b25-55c820cb9ff4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.611307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-09d93602-ece7-4ff7-acd9-668878e4dde6 req-938ab2e9-a96b-470f-8b25-55c820cb9ff4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.644024 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-09d93602-ece7-4ff7-acd9-668878e4dde6 req-938ab2e9-a96b-470f-8b25-55c820cb9ff4 service nova] Creating event network-changed:48198fe1-46cc-4c9a-9c32-4aa850f6426a for instance 960de3e9-1389-4350-bc25-24153c9bcff3 on nch1-master-1 Feb 12 21:07:48.656480 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-09d93602-ece7-4ff7-acd9-668878e4dde6 req-938ab2e9-a96b-470f-8b25-55c820cb9ff4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073963 Feb 12 21:07:48.657084 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 900/1802] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:48.664012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:48.664753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:48.680447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.683148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.685058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.685976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.735751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.746725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.748533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lazy-loading 'fault' on Instance uuid b7ce5b10-468f-4fe9-a928-1e6e44e99c9d {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:48.842675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:48.860017 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a5ede71-ebb1-49f8-8cb3-fec8a50c171a tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 200 len: 1367 microversion: 2.1 time: 0.193859 Feb 12 21:07:48.861106 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 901/1803] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:48 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:48.866223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-162f2ae5-c58f-40ab-b390-752abe85c28b req-7bc69344-2c4c-4c28-9d85-8f9b47266f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb565b3e-86a6-4ab9-b812-5901d747f049", "name": "network-vif-plugged", "status": "completed", "tag": "ec357ac8-2d34-44cb-8ba8-0821decd9e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:48.882284 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:48.882284 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:48.890181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-162f2ae5-c58f-40ab-b390-752abe85c28b req-7bc69344-2c4c-4c28-9d85-8f9b47266f53 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.890680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-162f2ae5-c58f-40ab-b390-752abe85c28b req-7bc69344-2c4c-4c28-9d85-8f9b47266f53 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.911359 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-162f2ae5-c58f-40ab-b390-752abe85c28b req-7bc69344-2c4c-4c28-9d85-8f9b47266f53 service nova] Creating event network-vif-plugged:ec357ac8-2d34-44cb-8ba8-0821decd9e9a for instance bb565b3e-86a6-4ab9-b812-5901d747f049 on nch2-master-1 Feb 12 21:07:48.917607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-162f2ae5-c58f-40ab-b390-752abe85c28b req-7bc69344-2c4c-4c28-9d85-8f9b47266f53 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054738 Feb 12 21:07:48.918220 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 902/1804] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:48.923710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:48.926408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:48.930920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.931698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:48.933527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:48.935009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:49.420329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:49.428354 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0e5cb37-54f0-4ef2-a5c9-6abb8c6906f5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.508740 Feb 12 21:07:49.429308 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 903/1805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:48 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:49.434714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:49.435560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:49.441671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:49.447191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:49.447191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:49.447191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:49.484275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:49.484741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:49.485274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lazy-loading 'fault' on Instance uuid 579b174f-d572-49b2-8f60-9e0d62cc450e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:49.580224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f254086e0c2c4109ae9b92b80cf84c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3d4a23b3dd48a2a3e78818c60bdf5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:49.588209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b37d7443-33e1-4c0c-ab12-fd73b535dacc tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 200 len: 1307 microversion: 2.1 time: 0.157660 Feb 12 21:07:49.589634 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 904/1806] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:49 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:49.594955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-74405634-7648-44b8-8f27-9e2848589168 req-14d23f04-5a76-4afb-af8e-a816c413dedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7ce5b10-468f-4fe9-a928-1e6e44e99c9d", "name": "network-vif-deleted", "tag": "5108ec57-74ec-48c9-a568-d34d61f1a3f8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:49.596472 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:49.596472 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:49.605909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-74405634-7648-44b8-8f27-9e2848589168 req-14d23f04-5a76-4afb-af8e-a816c413dedb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:49.610014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-74405634-7648-44b8-8f27-9e2848589168 req-14d23f04-5a76-4afb-af8e-a816c413dedb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:49.620704 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-74405634-7648-44b8-8f27-9e2848589168 req-14d23f04-5a76-4afb-af8e-a816c413dedb service nova] Creating event network-vif-deleted:5108ec57-74ec-48c9-a568-d34d61f1a3f8 for instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d on nch1-master-1 Feb 12 21:07:49.625744 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-74405634-7648-44b8-8f27-9e2848589168 req-14d23f04-5a76-4afb-af8e-a816c413dedb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034866 Feb 12 21:07:49.626451 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 905/1807] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:49.631854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:49.632654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:49.640686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:49.640686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:49.641740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:49.642251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.180096 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-edaf7547-b5ae-491d-8fd2-cb6de4c0d66e tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0/action" status: 202 len: 0 microversion: 2.25 time: 4.221124 Feb 12 21:07:50.180812 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 903/1808] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:07:45 2022] POST /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0/action => generated 0 bytes in 4223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:50.186126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.196031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.196031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.196031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.196373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.196747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.235084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.243619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-12ffc4b2-96eb-434f-a405-65b67f509dd4 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1314 microversion: 2.1 time: 0.615837 Feb 12 21:07:50.244542 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 906/1809] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:49 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:50.252902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.259641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.271548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.272110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.273004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.273561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.346764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.354920 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a652a6c-670d-46c4-ab1d-9163c8982c9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1392 microversion: 2.1 time: 0.172585 Feb 12 21:07:50.355738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 904/1810] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:50.360111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.360718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: b7ce5b10-468f-4fe9-a928-1e6e44e99c9d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.366951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.369520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.369520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.369520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.385469 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] HTTP exception thrown: Instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d could not be found. Feb 12 21:07:50.386133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Returning 404 to user: Instance b7ce5b10-468f-4fe9-a928-1e6e44e99c9d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:50.386990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c468bb4-6623-48f0-b019-6ba64ae925a6 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d" status: 404 len: 111 microversion: 2.1 time: 0.030281 Feb 12 21:07:50.388083 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 905/1811] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/b7ce5b10-468f-4fe9-a928-1e6e44e99c9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:50.392915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.393961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.398823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.403997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.403997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.403997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.403997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.420550 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-64a3e025-a256-4cf2-a5fe-efcafed63f72 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1273 microversion: 2.1 time: 0.171543 Feb 12 21:07:50.423361 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 907/1812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:50.435850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.435850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.445241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.446806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.447632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.448204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.485148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:50.577835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.588526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.590887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.592355 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-420cd277-d697-4035-8efa-66e1e93719f1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1485 microversion: 2.25 time: 0.203109 Feb 12 21:07:50.593452 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 906/1813] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1485 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:50.599200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.600876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.608886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.609473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.611257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.611773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.842561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:50.847265 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3d4a8de-7d58-4d5d-a2ac-1a362a15c520 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 204 len: 0 microversion: 2.1 time: 0.422434 Feb 12 21:07:50.848279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 908/1814] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:50 2022] DELETE /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:50.853693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.854956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] [instance: 579b174f-d572-49b2-8f60-9e0d62cc450e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.866300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb0a13e2-eef0-4f81-b7d0-3af589fb8a93 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.271490 Feb 12 21:07:50.867133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 907/1815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:50.883973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.885314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:50.886558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.887389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:50.890672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.891477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.906046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.906371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.907151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.907668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.926461 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] HTTP exception thrown: Instance 579b174f-d572-49b2-8f60-9e0d62cc450e could not be found. Feb 12 21:07:50.935728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] Returning 404 to user: Instance 579b174f-d572-49b2-8f60-9e0d62cc450e could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:50.935728 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6def977e-3521-47f3-87bc-ee0a5db6c166 tempest-ServersOnMultiNodesTest-468751139 tempest-ServersOnMultiNodesTest-468751139-project] 10.222.0.31 "GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e" status: 404 len: 111 microversion: 2.1 time: 0.085510 Feb 12 21:07:50.935728 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 909/1816] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/579b174f-d572-49b2-8f60-9e0d62cc450e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:50.960578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-700b95e0-7dcd-400e-a84b-2e9b3bcfd45e req-dc29f243-588e-435b-948d-640811dc1419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956a366a-cf37-4899-bfe1-0a1753a49e8f", "name": "network-vif-plugged", "status": "completed", "tag": "4626eaa8-b36f-4ef5-9cd4-400d59ca0c31"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:50.971295 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:50.971295 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:50.975156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-700b95e0-7dcd-400e-a84b-2e9b3bcfd45e req-dc29f243-588e-435b-948d-640811dc1419 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:50.976139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-700b95e0-7dcd-400e-a84b-2e9b3bcfd45e req-dc29f243-588e-435b-948d-640811dc1419 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:50.991116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-700b95e0-7dcd-400e-a84b-2e9b3bcfd45e req-dc29f243-588e-435b-948d-640811dc1419 service nova] Creating event network-vif-plugged:4626eaa8-b36f-4ef5-9cd4-400d59ca0c31 for instance 956a366a-cf37-4899-bfe1-0a1753a49e8f on nch2-master-1 Feb 12 21:07:50.999560 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-700b95e0-7dcd-400e-a84b-2e9b3bcfd45e req-dc29f243-588e-435b-948d-640811dc1419 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042539 Feb 12 21:07:51.000706 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 910/1817] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:51.272631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:51.272631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:51.282941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.283529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.284429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.285078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.512676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:51.521117 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ff06346-6477-4a38-be44-e848d9912e9d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1314 microversion: 2.1 time: 0.262760 Feb 12 21:07:51.521861 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 911/1818] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:51 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:51.527692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:51.528640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:51.543832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.544934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.545997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.546567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.559326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:51.567424 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e0691e94-b287-4f20-bff9-cc2a27c766fe tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1468 microversion: 2.1 time: 0.692975 Feb 12 21:07:51.568018 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 908/1819] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:50 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1468 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:51.576530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:51.577250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:51.584452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.584986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.585913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.586433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.869378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:51.886617 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a04729a5-0b47-45db-a751-975d9b1e7103 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1392 microversion: 2.1 time: 0.363366 Feb 12 21:07:51.888572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:51.889596 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 912/1820] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:51 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:51.899683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:51.902326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:51.903053 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbb41d7f-cda9-4451-9a12-1dd0d48b792f tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.331517 Feb 12 21:07:51.905002 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 909/1821] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:51 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:51.911766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:51.912472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:51.915294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.915759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.916569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.919011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.925440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.926210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:51.927061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:51.928077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.168024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:52.178101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d5cca2d4-a40a-4acc-ad2f-e533b4b71f92 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1519 microversion: 2.1 time: 0.272399 Feb 12 21:07:52.178698 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 910/1822] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:51 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:52.194464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-85681efe-9acc-4bcb-ac72-bfecd7f926cd req-43636545-db2f-4a6d-b6ca-b7cfa733dcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579b174f-d572-49b2-8f60-9e0d62cc450e", "name": "network-vif-deleted", "tag": "d06b235b-99a9-4368-972a-9fb7e1fd2de3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:52.196496 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:52.196496 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:52.204784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-85681efe-9acc-4bcb-ac72-bfecd7f926cd req-43636545-db2f-4a6d-b6ca-b7cfa733dcab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.205247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-85681efe-9acc-4bcb-ac72-bfecd7f926cd req-43636545-db2f-4a6d-b6ca-b7cfa733dcab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.221157 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-85681efe-9acc-4bcb-ac72-bfecd7f926cd req-43636545-db2f-4a6d-b6ca-b7cfa733dcab service nova] Creating event network-vif-deleted:d06b235b-99a9-4368-972a-9fb7e1fd2de3 for instance 579b174f-d572-49b2-8f60-9e0d62cc450e on nch2-master-1 Feb 12 21:07:52.226530 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-85681efe-9acc-4bcb-ac72-bfecd7f926cd req-43636545-db2f-4a6d-b6ca-b7cfa733dcab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Feb 12 21:07:52.227231 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 911/1823] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:52.231410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:52.241341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:52.243314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:52.244501 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89f25a5c-aad6-4b25-bb60-890d0cc7dee5 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1485 microversion: 2.25 time: 0.353083 Feb 12 21:07:52.245723 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 913/1824] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:51 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1485 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:52.542696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:52.543823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:52.563873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.563873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.564657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.565007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.587791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:52.591564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:52.606432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.607361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.608427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.609306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.831527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:52.840687 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7dc66f2-7f08-4689-a1fe-dba2a7ae98b9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1314 microversion: 2.1 time: 0.305211 Feb 12 21:07:52.852693 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 912/1825] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:52 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:52.906545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:52.907171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:52.925396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.925870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:52.926688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:52.927163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.127933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.146782 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea6e4948-0395-4c02-9db5-616d5a1f7530 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1468 microversion: 2.1 time: 0.565380 Feb 12 21:07:53.157639 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 914/1826] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:52 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:53.171531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:53.172797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:53.192887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.195375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.198820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.198820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.232635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.242111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15f4df8e-9068-4853-90fd-467b1bdeaf35 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1382 microversion: 2.1 time: 0.338735 Feb 12 21:07:53.244361 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 913/1827] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:52 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1382 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:53.267745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:53.269653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:53.285327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.286352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.287409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.288695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.552092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.555344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.564970 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-42905869-0814-4ae0-9dc0-b841f82251fb tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.404459 Feb 12 21:07:53.565578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6e76a15-aaa9-42b7-b0e7-c53fd8e2e8b7 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.317650 Feb 12 21:07:53.575268 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 915/1828] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:53 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:53.576687 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 914/1829] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:53 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:53.584637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:53.585254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:53.601068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.602084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.602385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.604941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.837082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41cd330a-fe63-4a09-8528-193fd982eaae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '.version_select at 0x7fa8fea3c790>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:53.838472 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:53.838472 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:53.841213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41cd330a-fe63-4a09-8528-193fd982eaae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.841707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41cd330a-fe63-4a09-8528-193fd982eaae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.856159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41cd330a-fe63-4a09-8528-193fd982eaae tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 3873 microversion: 2.1 time: 0.279650 Feb 12 21:07:53.857119 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 916/1830] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:07:53 2022] GET /compute/v2.1/os-migrations => generated 3873 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:53.866283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:53.867332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:53.887719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.889738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.889738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:53.889738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:53.956161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.964938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.968252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:53.968252 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-079d05c0-d5b2-4fc6-84b9-59e54a602751 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1485 microversion: 2.25 time: 0.387484 Feb 12 21:07:53.968525 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 915/1831] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:53 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:53.994216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7c001015-3b12-43e9-8000-9d303c908d9c req-c5a8b526-f5e6-4f2c-836b-922c0ceff788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8e14fe-6904-44f4-a8bf-c1e9b349e419", "name": "network-vif-deleted", "tag": "e68c6c44-abe5-4ce9-ab41-24f9c4276607"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:53.997310 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:53.997310 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:54.007263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7c001015-3b12-43e9-8000-9d303c908d9c req-c5a8b526-f5e6-4f2c-836b-922c0ceff788 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.007964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7c001015-3b12-43e9-8000-9d303c908d9c req-c5a8b526-f5e6-4f2c-836b-922c0ceff788 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.020422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7c001015-3b12-43e9-8000-9d303c908d9c req-c5a8b526-f5e6-4f2c-836b-922c0ceff788 service nova] Creating event network-vif-deleted:e68c6c44-abe5-4ce9-ab41-24f9c4276607 for instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 on nch1-master-1 Feb 12 21:07:54.026669 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7c001015-3b12-43e9-8000-9d303c908d9c req-c5a8b526-f5e6-4f2c-836b-922c0ceff788 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042628 Feb 12 21:07:54.027985 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 916/1832] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:54.035167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.036147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:54.043745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.045162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.046363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.047060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.143667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:54.156042 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2cee3a6d-9ce4-4a60-8c86-3edbdf98f282 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.297565 Feb 12 21:07:54.157111 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 917/1833] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:53 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:54.176205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.177288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:54.189248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.190775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.191893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.192345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.289464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:54.298152 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-589532d5-0cb9-4634-81c1-493ddae1d735 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1464 microversion: 2.1 time: 0.268786 Feb 12 21:07:54.298734 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 917/1834] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:54 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1464 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:54.304059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.304868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:54.312564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.313312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.314299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.314932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.349792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.350251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.350705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lazy-loading 'fault' on Instance uuid 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:54.404631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:54.410629 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c21c3cad-0f87-42f2-ac62-b77f3a0fd399 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 200 len: 1302 microversion: 2.1 time: 0.110688 Feb 12 21:07:54.411214 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 918/1835] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:54 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:54.417539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.418583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:54.420237 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4413d03b-a6ac-4a7b-9a64-75478bcf23ee tempest-LiveMigrationTest-1966938337 tempest-LiveMigrationTest-1966938337-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1533 microversion: 2.1 time: 0.260682 Feb 12 21:07:54.421399 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 918/1836] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:54 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1533 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:54.429447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-69c25f27-0c99-4ea9-8e8a-12f0476ae225 req-8f4f906b-75bb-4eeb-bf15-758f8b2e7132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed452a1-947c-4a63-8f67-8af1f1554c12", "tag": "5d4270d9-08bc-4f23-9b42-c85ca86d6e30"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:54.431011 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:54.431011 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:54.435246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.435717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.436679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.437132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.440408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-69c25f27-0c99-4ea9-8e8a-12f0476ae225 req-8f4f906b-75bb-4eeb-bf15-758f8b2e7132 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.440869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-69c25f27-0c99-4ea9-8e8a-12f0476ae225 req-8f4f906b-75bb-4eeb-bf15-758f8b2e7132 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.453926 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-69c25f27-0c99-4ea9-8e8a-12f0476ae225 req-8f4f906b-75bb-4eeb-bf15-758f8b2e7132 service nova] Creating event network-changed:5d4270d9-08bc-4f23-9b42-c85ca86d6e30 for instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 on nch2-master-1 Feb 12 21:07:54.460369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-69c25f27-0c99-4ea9-8e8a-12f0476ae225 req-8f4f906b-75bb-4eeb-bf15-758f8b2e7132 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036491 Feb 12 21:07:54.461027 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 919/1837] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:54.598323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:54.610641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e81e4e42-58cc-4a16-bab7-c10c974638a2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.198394 Feb 12 21:07:54.611519 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 919/1838] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:54 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:54.617187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.618098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:54.625848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.626434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.627365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.627921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.657233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:54.735355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ed7002eb-6d13-478a-9a25-9bc9c08421d4 tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Calling method '.version_select at 0x7fa8fe89d1f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.749453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed7002eb-6d13-478a-9a25-9bc9c08421d4 tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.749960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed7002eb-6d13-478a-9a25-9bc9c08421d4 tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.770855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed7002eb-6d13-478a-9a25-9bc9c08421d4 tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.771318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed7002eb-6d13-478a-9a25-9bc9c08421d4 tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.795902 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ed7002eb-6d13-478a-9a25-9bc9c08421d4 tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] 10.222.0.31 "GET /compute/v2.1/os-simple-tenant-usage/faa00c6b01804208ae04a7174e6de8d4?start=2022-02-11T21%3A07%3A54.308696&end=2022-02-13T21%3A07%3A54.308696" status: 200 len: 695 microversion: 2.1 time: 0.327937 Feb 12 21:07:54.795902 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 920/1839] 10.222.0.31 () {58 vars in 1411 bytes} [Sat Feb 12 21:07:54 2022] GET /compute/v2.1/os-simple-tenant-usage/faa00c6b01804208ae04a7174e6de8d4?start=2022-02-11T21%3A07%3A54.308696&end=2022-02-13T21%3A07%3A54.308696 => generated 695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:54.799907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:54.801955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:54.806821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.807292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:54.808799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:54.809189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.041646 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-63fc283e-2a64-48cd-918e-4b33ab726ef0 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "DELETE /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 204 len: 0 microversion: 2.1 time: 0.428501 Feb 12 21:07:55.044195 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 920/1840] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:54 2022] DELETE /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:55.048755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-17bb521a-35f0-4d57-a150-80ca5b45e38b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:55.054637 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-17bb521a-35f0-4d57-a150-80ca5b45e38b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 3ff261bb-e7d9-4666-a267-5eb19a9870c9 has no mapping to a cell. Feb 12 21:07:55.055398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-17bb521a-35f0-4d57-a150-80ca5b45e38b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 3ff261bb-e7d9-4666-a267-5eb19a9870c9 has no mapping to a cell. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:55.056254 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-17bb521a-35f0-4d57-a150-80ca5b45e38b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/3ff261bb-e7d9-4666-a267-5eb19a9870c9/action" status: 404 len: 117 microversion: 2.1 time: 0.012037 Feb 12 21:07:55.056825 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 921/1841] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:55 2022] POST /compute/v2.1/servers/3ff261bb-e7d9-4666-a267-5eb19a9870c9/action => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:55.062727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:55.067131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c046e1cd-9b1a-4274-8a7e-e397cc6fbacf tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '.version_select at 0x7fa8fe579f70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.071790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8eb3004a-089f-455d-9232-d22f9e1eda5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.275871 Feb 12 21:07:55.072574 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 921/1842] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:54 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:55.077724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.078576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.085087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.085844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.086209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c046e1cd-9b1a-4274-8a7e-e397cc6fbacf tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.086641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.086757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c046e1cd-9b1a-4274-8a7e-e397cc6fbacf tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.087083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.118933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c046e1cd-9b1a-4274-8a7e-e397cc6fbacf tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.122095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c046e1cd-9b1a-4274-8a7e-e397cc6fbacf tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.143769 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c046e1cd-9b1a-4274-8a7e-e397cc6fbacf tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/os-simple-tenant-usage/faa00c6b01804208ae04a7174e6de8d4?start=2022-02-11T21%3A07%3A54.308696&end=2022-02-13T21%3A07%3A54.308696" status: 200 len: 695 microversion: 2.1 time: 0.085751 Feb 12 21:07:55.144365 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 922/1843] 10.222.0.31 () {58 vars in 1411 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/os-simple-tenant-usage/faa00c6b01804208ae04a7174e6de8d4?start=2022-02-11T21%3A07%3A54.308696&end=2022-02-13T21%3A07%3A54.308696 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:55.148858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.149785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.157131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.157617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.158414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.158849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.277742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:55.287350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:55.288997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:55.290434 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-69e87444-5b28-4949-b669-93fda81e7eda tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1485 microversion: 2.25 time: 0.216141 Feb 12 21:07:55.301920 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 922/1844] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1485 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:55.307296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.308026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.314219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.314991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.316012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.316622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.322141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:55.332253 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-07a61717-135b-406d-bf30-b3b9643b1f08 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1388 microversion: 2.1 time: 0.184577 Feb 12 21:07:55.332253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 923/1845] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1388 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:55.335756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7900fa7-5d2f-4882-8094-39218aad4fbe tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Calling method '.version_select at 0x7fa904566c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.337579 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:55.337579 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:55.349562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7900fa7-5d2f-4882-8094-39218aad4fbe tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.350349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7900fa7-5d2f-4882-8094-39218aad4fbe tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.372690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7900fa7-5d2f-4882-8094-39218aad4fbe tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.373144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7900fa7-5d2f-4882-8094-39218aad4fbe tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.458421 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7900fa7-5d2f-4882-8094-39218aad4fbe tempest-TenantUsagesTestJSON-814656266 tempest-TenantUsagesTestJSON-814656266-project-admin] 10.222.0.31 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-11T21%3A07%3A54.308696&end=2022-02-13T21%3A07%3A54.308696&detailed=1" status: 200 len: 22401 microversion: 2.1 time: 0.126611 Feb 12 21:07:55.458966 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 924/1846] 10.222.0.31 () {58 vars in 1334 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-11T21%3A07%3A54.308696&end=2022-02-13T21%3A07%3A54.308696&detailed=1 => generated 22401 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:07:55.469389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.469389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: 3d8e14fe-6904-44f4-a8bf-c1e9b349e419] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.475342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.475342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.475342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.475342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.476427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:55.486158 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4df8dbb5-1cbe-4063-bf70-a7623f2c7f45 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.182907 Feb 12 21:07:55.487036 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 923/1847] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:55.492223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.494587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.496707 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] HTTP exception thrown: Instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 could not be found. Feb 12 21:07:55.497250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Returning 404 to user: Instance 3d8e14fe-6904-44f4-a8bf-c1e9b349e419 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:55.498150 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76e15690-1acf-44cd-8281-b4c373285e8d tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419" status: 404 len: 111 microversion: 2.1 time: 0.038265 Feb 12 21:07:55.501840 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 925/1848] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/servers/3d8e14fe-6904-44f4-a8bf-c1e9b349e419 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:55.502669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.502669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.502669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.502669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.516879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.517418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.525078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.525424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.527035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.527477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.535073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:55.564110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:07:55.956214 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1812d884-bad5-46a2-8fbb-744c8fe47bc9 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "DELETE /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 204 len: 0 microversion: 2.1 time: 0.448911 Feb 12 21:07:55.960871 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 926/1849] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:55 2022] DELETE /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:55.967102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.968002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:55.974666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.975172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.976018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:55.976510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:55.985504 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a4511203-1cbc-4fb2-bb52-642b62361822 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "DELETE /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 204 len: 0 microversion: 2.1 time: 0.496520 Feb 12 21:07:55.986220 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 924/1850] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:07:55 2022] DELETE /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:07:55.992563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:55.993301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.000772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.001703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.002913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.003684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.169429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.177053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.177585 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6d6e7969-bb88-48e7-bf2e-115969abd9dd tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.215117 Feb 12 21:07:56.178132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 927/1851] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:56.186657 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddafe5a8-2e71-4448-b530-1f7a0d476618 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1466 microversion: 2.1 time: 0.198597 Feb 12 21:07:56.187392 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 925/1852] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:55 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1466 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:56.188838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.189795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.194046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.194981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.207534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.208185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.208359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.208916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.209171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.209729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.210361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.210857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.390827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.394747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.403495 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5662002d-b897-429a-b4e7-9614ff3eb20c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.213950 Feb 12 21:07:56.404744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 926/1853] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:56.405388 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-37fced84-cfd9-4134-87e3-7a3ab8a7c35d tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1470 microversion: 2.1 time: 0.226092 Feb 12 21:07:56.406336 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 928/1854] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:56.410173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a51a4c85-2d11-4a86-89ca-57e81380dd00 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:56.410968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a51a4c85-2d11-4a86-89ca-57e81380dd00 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: eea0c152-8f83-4983-91c9-c05b4f7751d6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.417522 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a51a4c85-2d11-4a86-89ca-57e81380dd00 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance eea0c152-8f83-4983-91c9-c05b4f7751d6 could not be found. Feb 12 21:07:56.418317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a51a4c85-2d11-4a86-89ca-57e81380dd00 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance eea0c152-8f83-4983-91c9-c05b4f7751d6 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:56.419549 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a51a4c85-2d11-4a86-89ca-57e81380dd00 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/eea0c152-8f83-4983-91c9-c05b4f7751d6/action" status: 404 len: 111 microversion: 2.1 time: 0.013384 Feb 12 21:07:56.420572 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 927/1855] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:56 2022] POST /compute/v2.1/servers/eea0c152-8f83-4983-91c9-c05b4f7751d6/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:07:56.421112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.421815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.428557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.429428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.433477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.434298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.435213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.435639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.439322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.439953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.440895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.441546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.610111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.618951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4c0a90b3-4b6d-465e-937f-e738abd29435 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1388 microversion: 2.1 time: 0.195914 Feb 12 21:07:56.629593 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 928/1856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1388 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:56.630237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.630380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.630380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.634723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.635531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.635996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.637328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.638050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.638171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.639413 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9d73815b-193f-4535-9a57-579ec05bb733 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1485 microversion: 2.25 time: 0.232021 Feb 12 21:07:56.641620 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 929/1857] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1485 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:56.786050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e38d984b-b8ca-48dc-a110-75c0ff225f07 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.787613 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:56.787613 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:56.789217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e38d984b-b8ca-48dc-a110-75c0ff225f07 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.789708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e38d984b-b8ca-48dc-a110-75c0ff225f07 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.790538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e38d984b-b8ca-48dc-a110-75c0ff225f07 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.791084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e38d984b-b8ca-48dc-a110-75c0ff225f07 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.793485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:56.801221 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a2b83de-05ae-4a50-a62b-9484c3c6a492 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.180113 Feb 12 21:07:56.814002 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 929/1858] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:56.818581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e38d984b-b8ca-48dc-a110-75c0ff225f07 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.177185 Feb 12 21:07:56.819170 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 930/1859] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:56.819938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.820409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:56.828077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.828925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.829305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.829800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.829922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc6454a3-df3c-48a8-8c08-fabfd2b22ffb tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.831286 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:56.831286 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:56.833024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc6454a3-df3c-48a8-8c08-fabfd2b22ffb tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.833586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc6454a3-df3c-48a8-8c08-fabfd2b22ffb tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.836205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc6454a3-df3c-48a8-8c08-fabfd2b22ffb tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.836205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc6454a3-df3c-48a8-8c08-fabfd2b22ffb tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.859644 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc6454a3-df3c-48a8-8c08-fabfd2b22ffb tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.033454 Feb 12 21:07:56.860257 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 931/1860] 10.222.0.31 () {58 vars in 1173 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:07:56.871784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a29918c-ce48-4b3d-ac8d-8d8f4ebf0102 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.873491 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:56.873491 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:56.875208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a29918c-ce48-4b3d-ac8d-8d8f4ebf0102 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.875670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a29918c-ce48-4b3d-ac8d-8d8f4ebf0102 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.876677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a29918c-ce48-4b3d-ac8d-8d8f4ebf0102 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.877121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a29918c-ce48-4b3d-ac8d-8d8f4ebf0102 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.903100 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a29918c-ce48-4b3d-ac8d-8d8f4ebf0102 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034868 Feb 12 21:07:56.903923 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 932/1861] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:56.916656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6daedc9-9327-47ca-bda7-540c2c7ebf75 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:56.919211 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:56.919211 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:56.920144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6daedc9-9327-47ca-bda7-540c2c7ebf75 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.920606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6daedc9-9327-47ca-bda7-540c2c7ebf75 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.921462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6daedc9-9327-47ca-bda7-540c2c7ebf75 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:56.921906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6daedc9-9327-47ca-bda7-540c2c7ebf75 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:56.951862 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a6daedc9-9327-47ca-bda7-540c2c7ebf75 tempest-ServicesAdminTestJSON-674596776 tempest-ServicesAdminTestJSON-674596776-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040442 Feb 12 21:07:56.952487 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 933/1862] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:56.999245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:57.007922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a647dc9-3d5d-4b2e-a410-fdde64800a21 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.191677 Feb 12 21:07:57.008678 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 930/1863] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:56 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:57.028232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:57.028232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:57.034577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.035156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.036086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.036654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.063796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'flavor' on Instance uuid bb565b3e-86a6-4ab9-b812-5901d747f049 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:57.212085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:57.212836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:57.223331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.223792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.224600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.225042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.406732 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27131346-20a2-4d99-bfc4-cd97192ea3e2 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 202 len: 0 microversion: 2.1 time: 0.384775 Feb 12 21:07:57.408799 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 934/1864] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:57 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:07:57.420175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:57.421164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:57.432858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.434230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.436306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.437023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.520428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:57.533983 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70378fad-0cc3-4de7-86fc-67bee5045f1e tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1466 microversion: 2.1 time: 0.325711 Feb 12 21:07:57.534649 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 931/1865] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:57 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:57.540535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:57.541474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:57.555825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.555825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.555825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.555825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.757113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:57.765195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6678ec3a-5a3c-49a1-bb26-9cf4d82e9003 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1514 microversion: 2.1 time: 0.349149 Feb 12 21:07:57.766597 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 935/1866] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:57 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:57.779912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:57.780837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:57.788373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.789479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.790970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.792302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.854096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:57.862162 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6bba95be-f88b-4788-a7ef-6f918597d252 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1470 microversion: 2.1 time: 0.326421 Feb 12 21:07:57.872691 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 932/1867] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:57 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:57.872691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:57.872691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:57.874802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.875323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:57.876177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:57.876680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.116549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:58.126358 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-43ddeb43-633d-40c4-a60c-e42026994aa1 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1388 microversion: 2.1 time: 0.261952 Feb 12 21:07:58.127541 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 933/1868] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:57 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1388 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:58.141845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:58.143563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:58.148941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.149661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.150715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.151317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.162375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:58.178263 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1712977b-7fca-40c4-9881-b57672d65a31 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.410101 Feb 12 21:07:58.180057 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 936/1869] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:57 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:58.199092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4e3c326a-85b5-4dd1-bd31-a5dec0f4af3f req-148361b1-7b8d-4b99-ac4f-70876e2ff1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a074cfc-bc01-4936-ac34-cf31436b706d", "name": "network-vif-deleted", "tag": "1402b4b5-4ffe-40e5-b42b-355e4a6d8792"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:58.202467 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:58.202467 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:58.232312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4e3c326a-85b5-4dd1-bd31-a5dec0f4af3f req-148361b1-7b8d-4b99-ac4f-70876e2ff1eb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.233331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4e3c326a-85b5-4dd1-bd31-a5dec0f4af3f req-148361b1-7b8d-4b99-ac4f-70876e2ff1eb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.253044 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4e3c326a-85b5-4dd1-bd31-a5dec0f4af3f req-148361b1-7b8d-4b99-ac4f-70876e2ff1eb service nova] Creating event network-vif-deleted:1402b4b5-4ffe-40e5-b42b-355e4a6d8792 for instance 7a074cfc-bc01-4936-ac34-cf31436b706d on nch2-master-1 Feb 12 21:07:58.264817 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4e3c326a-85b5-4dd1-bd31-a5dec0f4af3f req-148361b1-7b8d-4b99-ac4f-70876e2ff1eb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082774 Feb 12 21:07:58.266430 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 937/1870] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:58.552600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:58.553551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:58.562379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.563044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.564074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.564857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.726175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:58.736444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:58.738700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:58.739874 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88b261cc-e380-438b-9395-3d93a518bcca tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1475 microversion: 2.25 time: 0.611159 Feb 12 21:07:58.740608 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 934/1871] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:58 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1475 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:58.759470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a6f3e6ee-feed-4b4e-8d93-b483c118a535 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '.version_select at 0x7fa8fea24040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:58.761195 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:58.761195 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:07:58.762633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6f3e6ee-feed-4b4e-8d93-b483c118a535 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.763087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6f3e6ee-feed-4b4e-8d93-b483c118a535 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.775648 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a6f3e6ee-feed-4b4e-8d93-b483c118a535 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/os-migrations" status: 200 len: 3796 microversion: 2.25 time: 0.019842 Feb 12 21:07:58.777241 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 935/1872] 10.222.0.31 () {60 vars in 1183 bytes} [Sat Feb 12 21:07:58 2022] GET /compute/v2.1/os-migrations => generated 3796 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:58.820996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:58.820996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:58.827803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.829011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.829862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:58.830308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:58.988931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:59.006706 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f53d30bb-fac3-4174-ab99-2d31c1a96665 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1466 microversion: 2.1 time: 0.458902 Feb 12 21:07:59.008502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 938/1873] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:58 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1466 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:07:59.031158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:59.033544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.047701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.049922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.051260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.051928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.131523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:59.143094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e9768942-0630-44e5-8ce0-26e016c93fc1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1497 microversion: 2.1 time: 0.362696 Feb 12 21:07:59.143094 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 936/1874] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:58 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1497 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:59.147252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:59.147910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.157278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.158305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.159302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.160009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.327686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] Lazy-loading 'services' on Instance uuid c8d5abda-386d-4eb8-ab12-caf696303db0 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:59.341726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:59.342390 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-16108048-84ec-4e66-8322-75437a58d112 tempest-LiveAutoBlockMigrationV225Test-1189065283 tempest-LiveAutoBlockMigrationV225Test-1189065283-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1966 microversion: 2.25 time: 0.331197 Feb 12 21:07:59.342994 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 939/1875] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:07:59 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1966 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:07:59.353715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9d841264-f7de-4ecc-8fa2-88a3dd3e8202 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1470 microversion: 2.1 time: 0.205554 Feb 12 21:07:59.359591 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 937/1876] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:59 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:59.369471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:59.371051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.377327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.377549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:59.378626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.378735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.378835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.379293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.384610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.385275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.386450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.387597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.413123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.414816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.415250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lazy-loading 'flavor' on Instance uuid bb565b3e-86a6-4ab9-b812-5901d747f049 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:59.415532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lazy-loading 'fault' on Instance uuid 7a074cfc-bc01-4936-ac34-cf31436b706d {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:07:59.428551 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'suspend' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state suspended Feb 12 21:07:59.431376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'suspend' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state suspended {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:07:59.431376 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3705a2a5-68f2-4519-b944-79cd51cb16b5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 148 microversion: 2.1 time: 0.069512 Feb 12 21:07:59.435687 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 938/1877] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:59 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 148 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:07:59.443780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:59.444477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.458076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.458076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.458076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.458076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.650518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:59.659462 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-749f030a-0425-4c8f-8663-090d285c3c40 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 200 len: 1295 microversion: 2.1 time: 0.296510 Feb 12 21:07:59.662149 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 940/1878] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:59 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 1295 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:59.663739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:07:59.675793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ae62b928-80dc-467a-bfa6-12bb40bcc1d5 req-36519615-8ca3-4ebc-9f29-c17853532ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed452a1-947c-4a63-8f67-8af1f1554c12", "name": "network-vif-plugged", "status": "completed", "tag": "5d4270d9-08bc-4f23-9b42-c85ca86d6e30"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:59.677413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eaaa81f9-433d-45a8-bf0f-8a5ba7fc319b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.238986 Feb 12 21:07:59.677413 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 939/1879] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:07:59 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:07:59.683199 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:07:59.683199 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:07:59.693444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:07:59.694535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.697492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ae62b928-80dc-467a-bfa6-12bb40bcc1d5 req-36519615-8ca3-4ebc-9f29-c17853532ebd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.697492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ae62b928-80dc-467a-bfa6-12bb40bcc1d5 req-36519615-8ca3-4ebc-9f29-c17853532ebd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.709594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.710061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.710935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.711432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.720872 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ae62b928-80dc-467a-bfa6-12bb40bcc1d5 req-36519615-8ca3-4ebc-9f29-c17853532ebd service nova] Creating event network-vif-plugged:5d4270d9-08bc-4f23-9b42-c85ca86d6e30 for instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 on nch2-master-1 Feb 12 21:07:59.725000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ae62b928-80dc-467a-bfa6-12bb40bcc1d5 req-36519615-8ca3-4ebc-9f29-c17853532ebd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061577 Feb 12 21:07:59.725921 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 941/1880] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:07:59.733382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:07:59.734312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:07:59.740854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.741406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.742316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:07:59.742863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:07:59.746350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:00.039118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-982e22ee-3b64-4c60-a83e-b2c614963f28 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 202 len: 0 microversion: 2.1 time: 0.311686 Feb 12 21:08:00.043461 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 942/1881] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:07:59 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:00.048131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-0847e237-4b81-4825-8c53-5b84c91bd8ba req-11eea15c-514c-43bf-b3c1-ea31d6988d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956a366a-cf37-4899-bfe1-0a1753a49e8f", "name": "network-vif-deleted", "tag": "4626eaa8-b36f-4ef5-9cd4-400d59ca0c31"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:00.050143 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:00.050143 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:00.060799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0847e237-4b81-4825-8c53-5b84c91bd8ba req-11eea15c-514c-43bf-b3c1-ea31d6988d83 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.061548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0847e237-4b81-4825-8c53-5b84c91bd8ba req-11eea15c-514c-43bf-b3c1-ea31d6988d83 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.083062 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-0847e237-4b81-4825-8c53-5b84c91bd8ba req-11eea15c-514c-43bf-b3c1-ea31d6988d83 service nova] Creating event network-vif-deleted:4626eaa8-b36f-4ef5-9cd4-400d59ca0c31 for instance 956a366a-cf37-4899-bfe1-0a1753a49e8f on nch2-master-1 Feb 12 21:08:00.091198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-0847e237-4b81-4825-8c53-5b84c91bd8ba req-11eea15c-514c-43bf-b3c1-ea31d6988d83 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049504 Feb 12 21:08:00.091827 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 943/1882] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:00.097518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:00.098451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:00.106123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.106572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.107483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.108106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.143931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.144362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.144815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lazy-loading 'fault' on Instance uuid cdb70780-dfdd-41df-8b16-34776dae9ee5 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:00.160731 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-06a7f33f-f016-4a41-91c6-78115c9dcc6e tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 204 len: 0 microversion: 2.25 time: 0.482453 Feb 12 21:08:00.164394 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 940/1883] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:07:59 2022] DELETE /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:08:00.174852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:00.175928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:00.183903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.184635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.185989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.186590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.203498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424f5011a4ef40c48465523369eab808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f8176a19e946ee8eecaa5d963d908c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.213247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c83dd922-1c11-4840-81ed-59fe188b6d64 tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 200 len: 1301 microversion: 2.1 time: 0.119935 Feb 12 21:08:00.215192 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 944/1884] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:00 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 1301 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:00.222127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:00.222951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:00.234832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.235380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.236184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.237946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.405685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.414388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d59c011c-ab93-44f1-814b-9208ba94426f tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1503 microversion: 2.1 time: 0.251409 Feb 12 21:08:00.415911 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 941/1885] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:00 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:00.425372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-eb3397d8-de8b-4ca2-b01d-e1d1d63a807d req-96eaf221-ff87-4094-9479-03f8e5915da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb70780-dfdd-41df-8b16-34776dae9ee5", "name": "network-vif-deleted", "tag": "7fe731ff-5471-4420-a35a-07898901b4d0"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:00.426995 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:00.426995 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:00.435774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eb3397d8-de8b-4ca2-b01d-e1d1d63a807d req-96eaf221-ff87-4094-9479-03f8e5915da1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.436225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eb3397d8-de8b-4ca2-b01d-e1d1d63a807d req-96eaf221-ff87-4094-9479-03f8e5915da1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.448702 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-eb3397d8-de8b-4ca2-b01d-e1d1d63a807d req-96eaf221-ff87-4094-9479-03f8e5915da1 service nova] Creating event network-vif-deleted:7fe731ff-5471-4420-a35a-07898901b4d0 for instance cdb70780-dfdd-41df-8b16-34776dae9ee5 on nch2-master-1 Feb 12 21:08:00.455855 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-eb3397d8-de8b-4ca2-b01d-e1d1d63a807d req-96eaf221-ff87-4094-9479-03f8e5915da1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037321 Feb 12 21:08:00.456714 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 942/1886] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:00.462407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:00.463104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:00.469270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.469977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.470835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.471287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.491425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.504303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.506723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.508166 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d33fd033-9596-4c57-bd88-d35e1d71071b tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1481 microversion: 2.25 time: 0.289546 Feb 12 21:08:00.508965 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 945/1887] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:00 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1481 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:00.511058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.512238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.513003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lazy-loading 'fault' on Instance uuid 956a366a-cf37-4899-bfe1-0a1753a49e8f {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:00.563132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b728c93884345880ac8350d76e915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa00c6b01804208ae04a7174e6de8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.570859 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a30718f8-863d-46bf-b216-b2616b74b5ab tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 200 len: 1304 microversion: 2.1 time: 0.112277 Feb 12 21:08:00.571998 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 943/1888] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:00 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:00.684241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:00.684888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 7a074cfc-bc01-4936-ac34-cf31436b706d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:00.693013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.693494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.694285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.694615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:00.694743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.695667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:00.711825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.713123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.718872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:00.720525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:00.727916 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] HTTP exception thrown: Instance 7a074cfc-bc01-4936-ac34-cf31436b706d could not be found. Feb 12 21:08:00.728964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Returning 404 to user: Instance 7a074cfc-bc01-4936-ac34-cf31436b706d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:00.730877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e233aade-8207-46c4-9eb7-deb0b0dfdccb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d" status: 404 len: 111 microversion: 2.1 time: 0.050723 Feb 12 21:08:00.736253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 946/1889] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:00 2022] GET /compute/v2.1/servers/7a074cfc-bc01-4936-ac34-cf31436b706d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:00.896260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:00.910879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0faa0922-4c30-46ba-8de9-6f63a4f55d5d tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1315 microversion: 2.1 time: 0.220407 Feb 12 21:08:00.929510 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 944/1890] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:00 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:01.232890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:01.249715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] [instance: cdb70780-dfdd-41df-8b16-34776dae9ee5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:01.281594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.282574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.285938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.316992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.366960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] HTTP exception thrown: Instance cdb70780-dfdd-41df-8b16-34776dae9ee5 could not be found. Feb 12 21:08:01.366960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] Returning 404 to user: Instance cdb70780-dfdd-41df-8b16-34776dae9ee5 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:01.366960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-326b9ae3-d955-4844-8d26-db67bc211fad tempest-MigrationsAdminTest-611823835 tempest-MigrationsAdminTest-611823835-project] 10.222.0.31 "GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5" status: 404 len: 111 microversion: 2.1 time: 0.134847 Feb 12 21:08:01.366960 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 947/1891] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:01 2022] GET /compute/v2.1/servers/cdb70780-dfdd-41df-8b16-34776dae9ee5 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:01.434591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:01.436641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:01.441784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.442246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.443047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.443522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.527523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:01.528132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:01.534485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.534859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.535883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.536327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.607238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:01.615351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f19c76e7-3851-438f-92a4-e8a0034a750e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1503 microversion: 2.1 time: 0.186963 Feb 12 21:08:01.615941 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 945/1892] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:01 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:01.626479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:01.626479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] [instance: 956a366a-cf37-4899-bfe1-0a1753a49e8f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:01.628208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.628676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.629515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.630282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.650077 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] HTTP exception thrown: Instance 956a366a-cf37-4899-bfe1-0a1753a49e8f could not be found. Feb 12 21:08:01.650077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] Returning 404 to user: Instance 956a366a-cf37-4899-bfe1-0a1753a49e8f could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:01.650077 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77215622-bbef-4580-982d-0843d92a7be9 tempest-TenantUsagesTestJSON-310533714 tempest-TenantUsagesTestJSON-310533714-project] 10.222.0.31 "GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f" status: 404 len: 111 microversion: 2.1 time: 0.031726 Feb 12 21:08:01.650077 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 946/1893] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:01 2022] GET /compute/v2.1/servers/956a366a-cf37-4899-bfe1-0a1753a49e8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:01.708501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:01.718692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:01.720259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:01.721480 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98192362-5a66-406f-91c7-dfb0cd751725 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1481 microversion: 2.25 time: 0.198217 Feb 12 21:08:01.722357 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 948/1894] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:01 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1481 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:01.937101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:01.937747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:01.944416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.945109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:01.945934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:01.946545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:02.193994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:02.201692 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5af6e066-1599-4c04-ae23-342f4947a0b0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1502 microversion: 2.1 time: 0.268389 Feb 12 21:08:02.212397 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 947/1895] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:01 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:02.218931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-898411727"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:02.219470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:02.226185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:02.226636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:02.227870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:02.228495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:02.419313 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.network.security_group_api [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Adding security group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce to port 5d4270d9-08bc-4f23-9b42-c85ca86d6e30 Feb 12 21:08:02.636681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:02.638068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:02.673247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:02.673991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:02.674846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:02.675286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:02.976412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e1378a0f-f271-4cb1-911d-efea942fe7e6 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12/action" status: 202 len: 0 microversion: 2.1 time: 0.761122 Feb 12 21:08:02.978725 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 949/1896] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:02 2022] POST /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:02.984758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:02.985789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:02.998451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:02.998903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.002615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.005764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.034025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:03.047001 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-034d3f15-c807-47e5-9c23-36e5edea397e tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.416876 Feb 12 21:08:03.049225 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 948/1897] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:02 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:03.065151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ab767b4e-54db-419f-82bc-3c40dc1a6f55 req-304b7ac7-b6b3-42ae-9b82-4d375e8bfe01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d5abda-386d-4eb8-ab12-caf696303db0", "name": "network-vif-deleted", "tag": "d6102892-165a-4568-bed4-24217882b194"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:03.067580 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:03.067580 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:03.081309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ab767b4e-54db-419f-82bc-3c40dc1a6f55 req-304b7ac7-b6b3-42ae-9b82-4d375e8bfe01 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.086943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ab767b4e-54db-419f-82bc-3c40dc1a6f55 req-304b7ac7-b6b3-42ae-9b82-4d375e8bfe01 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.121135 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ab767b4e-54db-419f-82bc-3c40dc1a6f55 req-304b7ac7-b6b3-42ae-9b82-4d375e8bfe01 service nova] Creating event network-vif-deleted:d6102892-165a-4568-bed4-24217882b194 for instance c8d5abda-386d-4eb8-ab12-caf696303db0 on nch1-master-1 Feb 12 21:08:03.126612 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ab767b4e-54db-419f-82bc-3c40dc1a6f55 req-304b7ac7-b6b3-42ae-9b82-4d375e8bfe01 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076028 Feb 12 21:08:03.127522 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 949/1898] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:03.132851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de52f512-7a78-4dcb-bd56-99a81a594296 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe934e50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:03.173697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:03.182870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:03.184728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:03.186338 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5410c090-9159-4976-b795-f45d63934f09 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1264 microversion: 2.25 time: 0.205632 Feb 12 21:08:03.186906 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 950/1899] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:02 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:03.191613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-697b3313-0fd8-44a3-853a-6a9fb161f7d3 req-14c312a8-9f04-41e6-bece-5213b26e09cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed452a1-947c-4a63-8f67-8af1f1554c12", "tag": "5d4270d9-08bc-4f23-9b42-c85ca86d6e30"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:03.193788 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:03.193788 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:03.201949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-697b3313-0fd8-44a3-853a-6a9fb161f7d3 req-14c312a8-9f04-41e6-bece-5213b26e09cb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.202485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-697b3313-0fd8-44a3-853a-6a9fb161f7d3 req-14c312a8-9f04-41e6-bece-5213b26e09cb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.214875 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-697b3313-0fd8-44a3-853a-6a9fb161f7d3 req-14c312a8-9f04-41e6-bece-5213b26e09cb service nova] Creating event network-changed:5d4270d9-08bc-4f23-9b42-c85ca86d6e30 for instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 on nch2-master-1 Feb 12 21:08:03.228261 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-697b3313-0fd8-44a3-853a-6a9fb161f7d3 req-14c312a8-9f04-41e6-bece-5213b26e09cb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039907 Feb 12 21:08:03.241118 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 951/1900] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:03.247473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:03.254113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:03.292867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.297344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.298330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.301500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.514701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-de52f512-7a78-4dcb-bd56-99a81a594296 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce in use.", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:03.515557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-de52f512-7a78-4dcb-bd56-99a81a594296 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security Group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce in use. Feb 12 21:08:03.515557 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-421c2156-8455-425c-afe2-efefe9cb5bae'] Feb 12 21:08:03.516179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de52f512-7a78-4dcb-bd56-99a81a594296 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 400 to user: Security Group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce in use. Feb 12 21:08:03.516179 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-421c2156-8455-425c-afe2-efefe9cb5bae'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:03.517502 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de52f512-7a78-4dcb-bd56-99a81a594296 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce" status: 400 len: 185 microversion: 2.1 time: 0.388667 Feb 12 21:08:03.518092 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 950/1901] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:03 2022] DELETE /compute/v2.1/os-security-groups/ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce => generated 185 bytes in 390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:03.528942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:03.530111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:03.555960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.556580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.557632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.559214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.943949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:03.952725 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad9b579c-c42e-41f3-8694-e1c9a9884a94 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.709950 Feb 12 21:08:03.954205 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 952/1902] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:03 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:03.970276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6fefd06-df77-42d0-8074-c35893dfb010 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:03.970963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e6fefd06-df77-42d0-8074-c35893dfb010 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 68e0edf8-dad1-408f-9c59-64bd664fbbed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:03.976852 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e6fefd06-df77-42d0-8074-c35893dfb010 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 68e0edf8-dad1-408f-9c59-64bd664fbbed could not be found. Feb 12 21:08:03.977699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6fefd06-df77-42d0-8074-c35893dfb010 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 68e0edf8-dad1-408f-9c59-64bd664fbbed could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:03.978650 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e6fefd06-df77-42d0-8074-c35893dfb010 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/68e0edf8-dad1-408f-9c59-64bd664fbbed/action" status: 404 len: 111 microversion: 2.1 time: 0.012580 Feb 12 21:08:03.980349 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 953/1903] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:03 2022] POST /compute/v2.1/servers/68e0edf8-dad1-408f-9c59-64bd664fbbed/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:03.988853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:03.989575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:03.998023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:03.998562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:03.999851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.000544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.017106 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49990f0d-001e-4e77-ab23-07994ffe20e5 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12/action" status: 202 len: 0 microversion: 2.1 time: 0.493812 Feb 12 21:08:04.020888 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 951/1904] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:03 2022] POST /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:04.044943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:04.049418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:04.059442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.061022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.067677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.067677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.270055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:04.286602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ef04fe44-d71a-4f87-8b90-3e5bb7d7dd9a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1572 microversion: 2.1 time: 0.264121 Feb 12 21:08:04.288277 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 952/1905] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:04 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1572 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:04.301988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:04.302613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:04.312714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.313536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.314737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.315356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.377134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.377947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.378620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lazy-loading 'fault' on Instance uuid c8d5abda-386d-4eb8-ab12-caf696303db0 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:04.461760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:04.482648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:04.486191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:04.488023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cbb79d5e-c4b0-4bea-be11-931e7850e444 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 200 len: 1375 microversion: 2.25 time: 0.198477 Feb 12 21:08:04.489205 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 953/1906] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:04 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:04.506811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:04.516643 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3943c134-f99c-4964-a863-e9bc67e17d0b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.531962 Feb 12 21:08:04.518636 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 954/1907] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:03 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:04.539226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:04.540560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:04.560508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.563230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.566298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.566961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.818767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:04.830855 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c1830ecc-de0d-4bb0-a541-aded3f8652be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.297250 Feb 12 21:08:04.850564 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 954/1908] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:04 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:04.850715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:04.850715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:04.857314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.857816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.858640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.859068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.886597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'unpause' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active Feb 12 21:08:04.887595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'unpause' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:04.888567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbf05172-44d9-4efa-ae1f-fbe9847d2dd1 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 145 microversion: 2.1 time: 0.042827 Feb 12 21:08:04.889429 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 955/1909] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:04 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 145 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:08:04.898163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:04.899031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:04.905639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.906350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:04.907145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:04.907768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.159457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:05.172393 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b66dc56-dc98-4b1b-9203-054c49ade524 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.278223 Feb 12 21:08:05.173307 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 955/1910] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:04 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:05.195574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:05.196837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:05.205253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.206646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.208179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.209008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.304402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:05.305193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:05.311937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.315494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.315494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.315494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.460705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:05.473281 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fdfc0056-314a-4608-b378-382e5a07dfcb tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.285419 Feb 12 21:08:05.487440 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 956/1911] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:05 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:05.514143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b044a163-87d0-4f47-886c-23d4433a2fa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:05.514782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b044a163-87d0-4f47-886c-23d4433a2fa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 84caa4ae-24bb-4972-b754-d3a84b62552d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:05.528613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b044a163-87d0-4f47-886c-23d4433a2fa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 84caa4ae-24bb-4972-b754-d3a84b62552d could not be found. Feb 12 21:08:05.529219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b044a163-87d0-4f47-886c-23d4433a2fa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 84caa4ae-24bb-4972-b754-d3a84b62552d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:05.530192 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b044a163-87d0-4f47-886c-23d4433a2fa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/84caa4ae-24bb-4972-b754-d3a84b62552d/action" status: 404 len: 111 microversion: 2.1 time: 0.039653 Feb 12 21:08:05.541409 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 957/1912] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:05 2022] POST /compute/v2.1/servers/84caa4ae-24bb-4972-b754-d3a84b62552d/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:05.551212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:05.551850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: c8d5abda-386d-4eb8-ab12-caf696303db0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:05.561207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.562506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.563635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.564293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.584885 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] HTTP exception thrown: Instance c8d5abda-386d-4eb8-ab12-caf696303db0 could not be found. Feb 12 21:08:05.585865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Returning 404 to user: Instance c8d5abda-386d-4eb8-ab12-caf696303db0 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:05.587081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45993087-c82a-43f5-acd6-1414a9f545f4 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0" status: 404 len: 111 microversion: 2.25 time: 0.044024 Feb 12 21:08:05.589759 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 958/1913] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:05 2022] GET /compute/v2.1/servers/c8d5abda-386d-4eb8-ab12-caf696303db0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:05.601004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:05.601004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:05.603657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.606021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.607086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.609006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.788038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:05.797281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b33abb6-16e3-4e56-a709-d02f3e030c20 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1572 microversion: 2.1 time: 0.497035 Feb 12 21:08:05.809822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 956/1914] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:05 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1572 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:05.868764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:05.879155 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-beda415c-1ad7-462d-81c3-a1c2e44c2fb4 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.287944 Feb 12 21:08:05.895460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 959/1915] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:05 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:05.903105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:05.904090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:05.910920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.911895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:05.913751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:05.914423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.285719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:06.309920 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a04ff31f-1b9a-47ff-b377-14b794dcfddf tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.410357 Feb 12 21:08:06.326110 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 957/1916] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:05 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:06.331251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:06.337413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:06.340566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.341197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.342275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.343049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.378949 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Cannot 'unshelve' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active Feb 12 21:08:06.380260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 409 to user: Cannot 'unshelve' instance bb565b3e-86a6-4ab9-b812-5901d747f049 while it is in vm_state active {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:06.381175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a6c839a2-957b-4b2f-be25-d947e6d7a0ca tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action" status: 409 len: 146 microversion: 2.1 time: 0.055877 Feb 12 21:08:06.388659 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 960/1917] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:06 2022] POST /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:08:06.395022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:06.395022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:06.404780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.405244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.406423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.406865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.816735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:06.817368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:06.824504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.825175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.825997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.826540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.846058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:06.855792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-abcc2a2d-305c-4677-89a0-d13013dc2889 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.467243 Feb 12 21:08:06.856891 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 958/1918] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:06 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:06.875605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:06.876437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:06.882792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.883252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:06.884057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:06.884495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:07.021923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:07.028831 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b25f76f-6a55-401a-b62a-fbda7ccb352c tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1570 microversion: 2.1 time: 0.215925 Feb 12 21:08:07.037152 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 961/1919] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:06 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:07.046918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1145447129"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:07.047499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:07.055754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:07.056302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:07.057253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:07.058589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:07.224407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.network.security_group_api [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Adding security group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e to port 5d4270d9-08bc-4f23-9b42-c85ca86d6e30 Feb 12 21:08:07.434922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:07.455337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3c1ee0d2-0d8c-4f51-a7b5-0867e56fd944 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.572984 Feb 12 21:08:07.467480 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 959/1920] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:06 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:07.480906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e39fbee-4619-4088-a7de-a0caa2f6b330 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1286099787_updated"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:07.488871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e39fbee-4619-4088-a7de-a0caa2f6b330 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: c2a5659e-05ab-4e9e-acf2-b82fbced33d4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:07.499546 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9e39fbee-4619-4088-a7de-a0caa2f6b330 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance c2a5659e-05ab-4e9e-acf2-b82fbced33d4 could not be found. Feb 12 21:08:07.500208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e39fbee-4619-4088-a7de-a0caa2f6b330 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance c2a5659e-05ab-4e9e-acf2-b82fbced33d4 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:07.501117 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e39fbee-4619-4088-a7de-a0caa2f6b330 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "PUT /compute/v2.1/servers/c2a5659e-05ab-4e9e-acf2-b82fbced33d4" status: 404 len: 111 microversion: 2.1 time: 0.027480 Feb 12 21:08:07.505429 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 960/1921] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:08:07 2022] PUT /compute/v2.1/servers/c2a5659e-05ab-4e9e-acf2-b82fbced33d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:07.510401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:07.511341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:07.519556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:07.520561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:07.523261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:07.523261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:07.923560 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7f6c052-003b-4fed-ab30-ede739be5aca tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12/action" status: 202 len: 0 microversion: 2.1 time: 0.880867 Feb 12 21:08:07.924841 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 962/1922] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:08:07 2022] POST /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:07.933571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-186d862c-0e10-4089-989e-4d0ea4e67179 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa908042ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:08.084810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-186d862c-0e10-4089-989e-4d0ea4e67179 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e in use.", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:08.085532 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-186d862c-0e10-4089-989e-4d0ea4e67179 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security Group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e in use. Feb 12 21:08:08.085532 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-ec2b2795-5e1d-455f-88ce-d046a032de68'] Feb 12 21:08:08.089813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-186d862c-0e10-4089-989e-4d0ea4e67179 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 400 to user: Security Group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e in use. Feb 12 21:08:08.089813 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-ec2b2795-5e1d-455f-88ce-d046a032de68'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:08.089813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-186d862c-0e10-4089-989e-4d0ea4e67179 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e" status: 400 len: 185 microversion: 2.1 time: 0.158242 Feb 12 21:08:08.089813 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 963/1923] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:07 2022] DELETE /compute/v2.1/os-security-groups/3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e => generated 185 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:08:08.095889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-81d648c8-efc5-4a3d-95ff-684a14bc7833 req-4437ad18-717a-4817-af06-fce09ecef4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed452a1-947c-4a63-8f67-8af1f1554c12", "tag": "5d4270d9-08bc-4f23-9b42-c85ca86d6e30"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:08.097989 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:08.097989 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:08.108425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:08.112611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81d648c8-efc5-4a3d-95ff-684a14bc7833 req-4437ad18-717a-4817-af06-fce09ecef4d3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.112611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81d648c8-efc5-4a3d-95ff-684a14bc7833 req-4437ad18-717a-4817-af06-fce09ecef4d3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.120972 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a4d82092-b7cf-4e62-9224-9a27e92089af tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.612568 Feb 12 21:08:08.121703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 961/1924] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:07 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:08.141638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-81d648c8-efc5-4a3d-95ff-684a14bc7833 req-4437ad18-717a-4817-af06-fce09ecef4d3 service nova] Creating event network-changed:5d4270d9-08bc-4f23-9b42-c85ca86d6e30 for instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 on nch2-master-1 Feb 12 21:08:08.151822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-81d648c8-efc5-4a3d-95ff-684a14bc7833 req-4437ad18-717a-4817-af06-fce09ecef4d3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061924 Feb 12 21:08:08.153467 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 964/1925] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:08.175639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:08.177836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:08.188693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.189659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.193422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.193422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.227585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:08.337861 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eec7ec8c-930c-4cee-b254-48641b3a3d6e tempest-TenantUsagesNegativeTestJSON-1358943006 tempest-TenantUsagesNegativeTestJSON-1358943006-project-admin] 10.222.0.31 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-02-11T21%3A08%3A08.001709&end=2022-02-13T21%3A08%3A08.001709" status: 404 len: 112 microversion: - time: 0.214526 Feb 12 21:08:08.338530 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 962/1926] 10.222.0.31 () {58 vars in 1315 bytes} [Sat Feb 12 21:08:08 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-02-11T21%3A08%3A08.001709&end=2022-02-13T21%3A08%3A08.001709 => generated 112 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 21:08:08.352022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:08.358404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:08.379357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.381568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.386481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.388152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.747704 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d3d830be-10b8-4a88-b1ae-77e52f34dae0 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 204 len: 0 microversion: 2.1 time: 0.591679 Feb 12 21:08:08.748800 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 965/1927] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:08 2022] DELETE /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:08:08.763921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8cf0912d-db01-4c43-8c85-136b5e2ca44a tempest-TenantUsagesNegativeTestJSON-1358943006 tempest-TenantUsagesNegativeTestJSON-1358943006-project-admin] Calling method '.version_select at 0x7fa8fe402040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:08.773504 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8cf0912d-db01-4c43-8c85-136b5e2ca44a tempest-TenantUsagesNegativeTestJSON-1358943006 tempest-TenantUsagesNegativeTestJSON-1358943006-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Feb 12 21:08:08.774053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8cf0912d-db01-4c43-8c85-136b5e2ca44a tempest-TenantUsagesNegativeTestJSON-1358943006 tempest-TenantUsagesNegativeTestJSON-1358943006-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:08.775255 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8cf0912d-db01-4c43-8c85-136b5e2ca44a tempest-TenantUsagesNegativeTestJSON-1358943006 tempest-TenantUsagesNegativeTestJSON-1358943006-project-admin] 10.222.0.31 "GET /compute/v2.1/os-simple-tenant-usage/08bb4df14cdc481f82c272c5258be421?start=2022-02-13T21%3A08%3A08.001709&end=2022-02-11T21%3A08%3A08.001709" status: 400 len: 111 microversion: 2.1 time: 0.024455 Feb 12 21:08:08.782492 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 966/1928] 10.222.0.31 () {58 vars in 1411 bytes} [Sat Feb 12 21:08:08 2022] GET /compute/v2.1/os-simple-tenant-usage/08bb4df14cdc481f82c272c5258be421?start=2022-02-13T21%3A08%3A08.001709&end=2022-02-11T21%3A08%3A08.001709 => generated 111 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:08.785740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:08.786370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:08.810807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.811283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.812135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:08.812580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:08.877806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:08.978161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:08.988536 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-723dd9f6-ac9f-47db-b3ee-f5809e19baa3 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.648750 Feb 12 21:08:08.989816 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 963/1929] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:08 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:08.995895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:08.996762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:09.004281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:09.005412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:09.006447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:09.007099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:09.185438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:09.193639 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5cc5890-5b17-48d1-b8fd-fa2fabff1dbc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1645 microversion: 2.1 time: 0.202226 Feb 12 21:08:09.195054 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 964/1930] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:08 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1645 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:09.368011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-122ad3d3-4e6c-4fc2-9c66-16113d84393c tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "DELETE /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 204 len: 0 microversion: 2.1 time: 0.590172 Feb 12 21:08:09.369612 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 967/1931] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:08 2022] DELETE /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:08:09.375906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c082747c-fbe1-4713-abd8-8b7beaf9f131 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:09.377375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c082747c-fbe1-4713-abd8-8b7beaf9f131 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:09.378453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c082747c-fbe1-4713-abd8-8b7beaf9f131 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "PUT /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 400 len: 619 microversion: 2.1 time: 0.006634 Feb 12 21:08:09.382879 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 968/1932] 10.222.0.31 () {60 vars in 1256 bytes} [Sat Feb 12 21:08:09 2022] PUT /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:09.389033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:09.390073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:09.396146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28c051e7-2d55-421c-be06-ebf6c61de934 tempest-TenantUsagesNegativeTestJSON-1610582834 tempest-TenantUsagesNegativeTestJSON-1610582834-project] Calling method '.version_select at 0x7fa8feada160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:09.397935 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:09.397935 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:09.398902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:09.399303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:09.399798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-28c051e7-2d55-421c-be06-ebf6c61de934 tempest-TenantUsagesNegativeTestJSON-1610582834 tempest-TenantUsagesNegativeTestJSON-1610582834-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'faad4e97d8f449c282f39217d72db6c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bb4df14cdc481f82c272c5258be421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:09.400186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:09.400637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:09.401580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28c051e7-2d55-421c-be06-ebf6c61de934 tempest-TenantUsagesNegativeTestJSON-1610582834 tempest-TenantUsagesNegativeTestJSON-1610582834-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:09.402586 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-28c051e7-2d55-421c-be06-ebf6c61de934 tempest-TenantUsagesNegativeTestJSON-1610582834 tempest-TenantUsagesNegativeTestJSON-1610582834-project] 10.222.0.31 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-11T21%3A08%3A08.001709&end=2022-02-13T21%3A08%3A08.001709&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.206198 Feb 12 21:08:09.403683 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 965/1933] 10.222.0.31 () {58 vars in 1334 bytes} [Sat Feb 12 21:08:09 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-02-11T21%3A08%3A08.001709&end=2022-02-13T21%3A08%3A08.001709&detailed=1 => generated 123 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:09.410259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:09.411055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:09.422886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:09.423702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:09.424787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:09.425435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:09.806321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:09.819487 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4242d2bf-bc00-412e-9c84-5f2f9360eec6 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1497 microversion: 2.1 time: 0.435252 Feb 12 21:08:09.823894 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 969/1934] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:09 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1497 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:09.965866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:09.990108 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e9c32353-8bd1-4cd1-b9ed-14bf7529a29b tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.585112 Feb 12 21:08:09.990823 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 966/1935] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:09 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:10.013703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:10.014426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:10.030290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:10.030992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:10.032008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:10.038046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:10.212084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:10.212918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:10.224415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:10.225110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:10.226244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:10.228238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:10.660146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:10.680526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54ab17bb-7433-449d-9957-106109e68504 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.670938 Feb 12 21:08:10.700927 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 970/1936] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:10 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:10.714558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef080402-2508-430b-9e59-0fbf744af546 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:10.714558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef080402-2508-430b-9e59-0fbf744af546 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:10.715841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef080402-2508-430b-9e59-0fbf744af546 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "PUT /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 400 len: 108 microversion: 2.1 time: 0.013496 Feb 12 21:08:10.716526 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 971/1937] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:08:10 2022] PUT /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:10.726726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:10.727705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:10.739781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:10.740706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:10.741811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:10.742710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:10.986884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:11.008099 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-45f83af5-dff0-4e4f-b0c2-9af0f7fd54ac tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1645 microversion: 2.1 time: 0.799907 Feb 12 21:08:11.024592 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 967/1938] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:10 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1645 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:11.031015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:11.031853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:11.042703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:11.043554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:11.044366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:11.045005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:11.269257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:11.293448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f1139506-6e25-489c-8a3c-2dcc78567b91 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1506 microversion: 2.1 time: 0.571108 Feb 12 21:08:11.298219 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 972/1939] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:10 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:11.666674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:11.706831 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c3df770-a867-4a72-914f-298635baa432 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1497 microversion: 2.1 time: 0.680740 Feb 12 21:08:11.719897 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 968/1940] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:11 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1497 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:12.040042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:12.040675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:12.059471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.063626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.064793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.067208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.082114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5642c164-42c3-48e1-a7d6-fbe97972df7a req-74381bf2-9393-4a48-bee9-c149a67a3a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831a7bdc-edf9-4121-9962-f3ae48b82047", "name": "network-vif-deleted", "tag": "32360a5d-8e56-4c23-9414-36fca780d88e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:12.086397 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:12.086397 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:12.097454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5642c164-42c3-48e1-a7d6-fbe97972df7a req-74381bf2-9393-4a48-bee9-c149a67a3a3c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.118476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5642c164-42c3-48e1-a7d6-fbe97972df7a req-74381bf2-9393-4a48-bee9-c149a67a3a3c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.153182 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5642c164-42c3-48e1-a7d6-fbe97972df7a req-74381bf2-9393-4a48-bee9-c149a67a3a3c service nova] Creating event network-vif-deleted:32360a5d-8e56-4c23-9414-36fca780d88e for instance 831a7bdc-edf9-4121-9962-f3ae48b82047 on nch1-master-1 Feb 12 21:08:12.160608 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5642c164-42c3-48e1-a7d6-fbe97972df7a req-74381bf2-9393-4a48-bee9-c149a67a3a3c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084591 Feb 12 21:08:12.161588 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 969/1941] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:12.172935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-961c22f2-4aff-4d14-9ee6-135b3671fdf9 req-e84b314f-823d-4753-9ac0-d7826ed0bdce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed452a1-947c-4a63-8f67-8af1f1554c12", "name": "network-vif-deleted", "tag": "5d4270d9-08bc-4f23-9b42-c85ca86d6e30"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:12.174959 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:12.174959 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:12.187517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-961c22f2-4aff-4d14-9ee6-135b3671fdf9 req-e84b314f-823d-4753-9ac0-d7826ed0bdce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.188209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-961c22f2-4aff-4d14-9ee6-135b3671fdf9 req-e84b314f-823d-4753-9ac0-d7826ed0bdce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.226104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-961c22f2-4aff-4d14-9ee6-135b3671fdf9 req-e84b314f-823d-4753-9ac0-d7826ed0bdce service nova] Creating event network-vif-deleted:5d4270d9-08bc-4f23-9b42-c85ca86d6e30 for instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 on nch2-master-1 Feb 12 21:08:12.263678 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-961c22f2-4aff-4d14-9ee6-135b3671fdf9 req-e84b314f-823d-4753-9ac0-d7826ed0bdce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099721 Feb 12 21:08:12.265992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 970/1942] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:12.284753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:12.296315 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-19668397-2da2-4c64-9198-912cb312e528 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1466 microversion: 2.1 time: 0.269787 Feb 12 21:08:12.297748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 973/1943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:12 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:12.724907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:12.725663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:12.751494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.751951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.764802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.765278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.837937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:12.838446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:12.839173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lazy-loading 'fault' on Instance uuid 831a7bdc-edf9-4121-9962-f3ae48b82047 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:13.080767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:13.095413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73eebdaa-989a-44b3-bba3-447277afa8c2 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 200 len: 1299 microversion: 2.1 time: 0.372546 Feb 12 21:08:13.116025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 971/1944] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:12 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 1299 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:13.314952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:13.315597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:13.324150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:13.325228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:13.327937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:13.328849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:13.386111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:13.386989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:13.387463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lazy-loading 'fault' on Instance uuid 3ed452a1-947c-4a63-8f67-8af1f1554c12 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:13.500254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:13.508212 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64e89f4c-a6c0-4ba3-a102-02c0334046a8 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 200 len: 1305 microversion: 2.1 time: 0.197243 Feb 12 21:08:13.511780 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 974/1945] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:13 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 1305 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:14.121474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:14.122248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 831a7bdc-edf9-4121-9962-f3ae48b82047] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:14.140865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:14.141472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:14.142596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:14.143245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:14.163008 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] HTTP exception thrown: Instance 831a7bdc-edf9-4121-9962-f3ae48b82047 could not be found. Feb 12 21:08:14.165080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Returning 404 to user: Instance 831a7bdc-edf9-4121-9962-f3ae48b82047 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:14.166073 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79ed3636-8500-4380-8516-4fbea917d208 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047" status: 404 len: 111 microversion: 2.1 time: 0.049459 Feb 12 21:08:14.176909 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 972/1946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:14 2022] GET /compute/v2.1/servers/831a7bdc-edf9-4121-9962-f3ae48b82047 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:14.178861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:14.180037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:14.206513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:14.206513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:14.206513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:14.206513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:14.256310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:14.534807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:14.535519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:14.544163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:14.544625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:14.545651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:14.546277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:14.568491 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 could not be found. Feb 12 21:08:14.569599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:14.570796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1088d79-5942-4aa0-af34-7afdce79e700 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 404 len: 111 microversion: 2.1 time: 0.042194 Feb 12 21:08:14.575426 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 973/1947] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:14 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:14.581148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-715715ad-2726-480c-a782-c9dc76f198c9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fead21f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:15.081119 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-715715ad-2726-480c-a782-c9dc76f198c9 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce" status: 202 len: 0 microversion: 2.1 time: 0.504301 Feb 12 21:08:15.085088 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 974/1948] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:14 2022] DELETE /compute/v2.1/os-security-groups/ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:15.092843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-354bfb53-f910-4786-87e7-ded80348ea03 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fea24280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:15.378551 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3ce3fd7-7b7e-4912-adcc-87daa8217c69 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "DELETE /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 204 len: 0 microversion: 2.1 time: 1.205294 Feb 12 21:08:15.388153 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 975/1949] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:14 2022] DELETE /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:08:15.388962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:15.389723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:15.405072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:15.410881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:15.410881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:15.410881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:15.608807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-354bfb53-f910-4786-87e7-ded80348ea03 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e" status: 202 len: 0 microversion: 2.1 time: 0.518542 Feb 12 21:08:15.608807 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 975/1950] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:15 2022] DELETE /compute/v2.1/os-security-groups/3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:15.618079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddc817cc-0ed3-4fb5-b4ba-72b5f99395df tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'create', calling method: .version_select at 0x7fa8feadadc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-771213800", "description": "tempest-description-371720253"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:15.843338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:15.856476 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cb1cbf1e-3898-4078-ba6d-4301f457302a tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1483 microversion: 2.1 time: 0.469778 Feb 12 21:08:15.869594 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 976/1951] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:15 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1483 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:16.492993 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddc817cc-0ed3-4fb5-b4ba-72b5f99395df tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.877445 Feb 12 21:08:16.495346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 976/1952] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:08:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:16.511719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93cf70b6-cb59-4e52-ad53-3bde1ffa4d43 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Action: 'update', calling method: .version_select at 0x7fa90800cee0>, body: {"security_group": {"name": "tempest-sg-hth-930396582", "description": "tempest-description-hth-2100772453"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:16.876596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:16.877200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:16.887061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:16.888303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:16.889556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:16.890210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:17.221433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93cf70b6-cb59-4e52-ad53-3bde1ffa4d43 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "PUT /compute/v2.1/os-security-groups/72e0d73b-5c4b-4e73-8668-1b14d4544185" status: 200 len: 217 microversion: 2.1 time: 0.717430 Feb 12 21:08:17.222337 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 977/1953] 10.222.0.31 () {60 vars in 1289 bytes} [Sat Feb 12 21:08:16 2022] PUT /compute/v2.1/os-security-groups/72e0d73b-5c4b-4e73-8668-1b14d4544185 => generated 217 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:08:17.233613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad9abed3-5396-4bbf-8f7b-aa8947d8b285 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa90800c310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:17.441879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:17.446977 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6bd39afa-5bdf-4f8d-a79b-e2ddc0a992fb tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1483 microversion: 2.1 time: 0.574695 Feb 12 21:08:17.447768 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 977/1954] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:16 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1483 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:17.452418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-cff405ad-1101-436a-aa83-b98183f448fc req-fe077bb3-6c69-444b-961d-b2e5fc6be87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c8f616-0ac8-49ea-8569-b8e0e83a636a", "name": "network-vif-deleted", "tag": "c3effa86-57bb-42fc-8e61-cc0f745f1657"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:17.454431 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:17.454431 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:17.462871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cff405ad-1101-436a-aa83-b98183f448fc req-fe077bb3-6c69-444b-961d-b2e5fc6be87a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:17.463535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cff405ad-1101-436a-aa83-b98183f448fc req-fe077bb3-6c69-444b-961d-b2e5fc6be87a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:17.483906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad9abed3-5396-4bbf-8f7b-aa8947d8b285 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups/72e0d73b-5c4b-4e73-8668-1b14d4544185" status: 200 len: 217 microversion: 2.1 time: 0.253789 Feb 12 21:08:17.486038 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 978/1955] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:08:17 2022] GET /compute/v2.1/os-security-groups/72e0d73b-5c4b-4e73-8668-1b14d4544185 => generated 217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:08:17.493516 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-cff405ad-1101-436a-aa83-b98183f448fc req-fe077bb3-6c69-444b-961d-b2e5fc6be87a service nova] Creating event network-vif-deleted:c3effa86-57bb-42fc-8e61-cc0f745f1657 for instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a on nch1-master-1 Feb 12 21:08:17.500340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50391278-6991-4f87-ae70-2d1650777001 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa90802dca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:17.507267 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-cff405ad-1101-436a-aa83-b98183f448fc req-fe077bb3-6c69-444b-961d-b2e5fc6be87a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058119 Feb 12 21:08:17.508170 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 978/1956] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:18.404844 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50391278-6991-4f87-ae70-2d1650777001 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/72e0d73b-5c4b-4e73-8668-1b14d4544185" status: 202 len: 0 microversion: 2.1 time: 0.908204 Feb 12 21:08:18.405470 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 979/1957] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:17 2022] DELETE /compute/v2.1/os-security-groups/72e0d73b-5c4b-4e73-8668-1b14d4544185 => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:18.418382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.419086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:18.428096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.428879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.429504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.430047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.449413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 could not be found. Feb 12 21:08:18.450019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.450933 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9fc7633-a2e2-452e-8e7e-041edb9c2381 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 404 len: 111 microversion: 2.1 time: 0.041186 Feb 12 21:08:18.451523 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 979/1958] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:08:18.462896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.464353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 3ed452a1-947c-4a63-8f67-8af1f1554c12] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:18.478814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.482774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.483704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:18.487534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.490460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.492838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.495623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.498041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.499176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.501502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.521550 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 could not be found. Feb 12 21:08:18.522544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Instance 3ed452a1-947c-4a63-8f67-8af1f1554c12 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.523646 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7b3fb13e-ad3b-4510-8dc5-d57c772f4c94 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12" status: 404 len: 111 microversion: 2.1 time: 0.067949 Feb 12 21:08:18.525043 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 980/1959] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:18 2022] GET /compute/v2.1/servers/3ed452a1-947c-4a63-8f67-8af1f1554c12 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:08:18.534274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ced90071-eba4-4eda-a523-13e0a5340885 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa908019430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.571256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.572053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.573570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lazy-loading 'fault' on Instance uuid 19c8f616-0ac8-49ea-8569-b8e0e83a636a {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:18.621729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-ced90071-eba4-4eda-a523-13e0a5340885 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:18.623259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-ced90071-eba4-4eda-a523-13e0a5340885 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e not found {{(pid=141726) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:08:18.623860 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ced90071-eba4-4eda-a523-13e0a5340885 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e does not exist Feb 12 21:08:18.623860 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-8125d658-006e-4731-9cbb-17999102d51f'] Feb 12 21:08:18.625572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ced90071-eba4-4eda-a523-13e0a5340885 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group 3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e does not exist Feb 12 21:08:18.625572 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-8125d658-006e-4731-9cbb-17999102d51f'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.630541 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ced90071-eba4-4eda-a523-13e0a5340885 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e" status: 404 len: 194 microversion: 2.1 time: 0.097341 Feb 12 21:08:18.631506 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 981/1960] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/os-security-groups/3b2a66b0-2f4c-43e5-a4c7-2420ae2f796e => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:08:18.636455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:18.643899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-faff669c-1855-44d7-beb2-edf2602bd08b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa9044a78b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.659980 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03fcc3a1-f902-4a60-b87c-f467d4744e63 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 200 len: 1300 microversion: 2.1 time: 0.194277 Feb 12 21:08:18.663822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 980/1961] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:18 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:18.694340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-faff669c-1855-44d7-beb2-edf2602bd08b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:18.695047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-faff669c-1855-44d7-beb2-edf2602bd08b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce not found {{(pid=141726) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:08:18.701852 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-faff669c-1855-44d7-beb2-edf2602bd08b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce does not exist Feb 12 21:08:18.701852 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-6422bfda-26b6-4d4d-9630-0e4b80c0ccf9'] Feb 12 21:08:18.708633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-faff669c-1855-44d7-beb2-edf2602bd08b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce does not exist Feb 12 21:08:18.708633 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-6422bfda-26b6-4d4d-9630-0e4b80c0ccf9'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.709521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-faff669c-1855-44d7-beb2-edf2602bd08b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce" status: 404 len: 194 microversion: 2.1 time: 0.072152 Feb 12 21:08:18.716832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 982/1962] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/os-security-groups/ebd9ca76-2ab9-42fd-a868-0f3e040cd4ce => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:18.718122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ce54933-267b-4969-9b0e-b5cf55e89827 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fea24040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.764547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-5ce54933-267b-4969-9b0e-b5cf55e89827 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:18.765155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-5ce54933-267b-4969-9b0e-b5cf55e89827 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:08:18.765722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-5ce54933-267b-4969-9b0e-b5cf55e89827 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 does not exist Feb 12 21:08:18.765722 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-822e4c86-af04-4ac1-99d2-554e77f64b6f'] Feb 12 21:08:18.766319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ce54933-267b-4969-9b0e-b5cf55e89827 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group d0afa1e6-7836-49e2-b02c-3c6e480e9239 does not exist Feb 12 21:08:18.766319 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-822e4c86-af04-4ac1-99d2-554e77f64b6f'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.767146 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ce54933-267b-4969-9b0e-b5cf55e89827 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/d0afa1e6-7836-49e2-b02c-3c6e480e9239" status: 404 len: 194 microversion: 2.1 time: 0.052892 Feb 12 21:08:18.768218 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 981/1963] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/os-security-groups/d0afa1e6-7836-49e2-b02c-3c6e480e9239 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:18.777223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cac696b-fe61-45d2-b334-e54176321afe tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa908019430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.811025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-0cac696b-fe61-45d2-b334-e54176321afe tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 105f1518-12ca-4571-885b-4d90fab2abe0 does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-0cac696b-fe61-45d2-b334-e54176321afe tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group 105f1518-12ca-4571-885b-4d90fab2abe0 not found {{(pid=141726) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-0cac696b-fe61-45d2-b334-e54176321afe tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group 105f1518-12ca-4571-885b-4d90fab2abe0 does not exist Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-9fa2ddd6-b599-4e3a-ab51-355e44b66027'] Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cac696b-fe61-45d2-b334-e54176321afe tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group 105f1518-12ca-4571-885b-4d90fab2abe0 does not exist Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-9fa2ddd6-b599-4e3a-ab51-355e44b66027'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0cac696b-fe61-45d2-b334-e54176321afe tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/105f1518-12ca-4571-885b-4d90fab2abe0" status: 404 len: 194 microversion: 2.1 time: 0.041100 Feb 12 21:08:18.817664 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 983/1964] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/os-security-groups/105f1518-12ca-4571-885b-4d90fab2abe0 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:18.825278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1175f1be-14c7-49a8-bdd2-add7595fea11 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fec17670>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.870409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-1175f1be-14c7-49a8-bdd2-add7595fea11 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc5a716a-e685-4d55-80f5-35855cc4f479 does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:18.870746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-1175f1be-14c7-49a8-bdd2-add7595fea11 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group cc5a716a-e685-4d55-80f5-35855cc4f479 not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:08:18.871273 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1175f1be-14c7-49a8-bdd2-add7595fea11 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group cc5a716a-e685-4d55-80f5-35855cc4f479 does not exist Feb 12 21:08:18.871273 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-eeb68ede-fbc1-412c-aad1-5e2be76bc0b5'] Feb 12 21:08:18.871865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1175f1be-14c7-49a8-bdd2-add7595fea11 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group cc5a716a-e685-4d55-80f5-35855cc4f479 does not exist Feb 12 21:08:18.871865 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-eeb68ede-fbc1-412c-aad1-5e2be76bc0b5'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.872700 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1175f1be-14c7-49a8-bdd2-add7595fea11 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/cc5a716a-e685-4d55-80f5-35855cc4f479" status: 404 len: 194 microversion: 2.1 time: 0.054174 Feb 12 21:08:18.874399 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 982/1965] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/os-security-groups/cc5a716a-e685-4d55-80f5-35855cc4f479 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:18.882938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c194ab4e-cf69-4ae4-8090-53c920256f86 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fec17940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.907409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-c194ab4e-cf69-4ae4-8090-53c920256f86 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a does not exist", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:08:18.908037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.security_group_api [None req-c194ab4e-cf69-4ae4-8090-53c920256f86 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Neutron security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a not found {{(pid=141727) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:08:18.908598 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c194ab4e-cf69-4ae4-8090-53c920256f86 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a does not exist Feb 12 21:08:18.908598 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-efe59e3f-407a-49bf-a982-dbb354443d88'] Feb 12 21:08:18.909195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c194ab4e-cf69-4ae4-8090-53c920256f86 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Security group 171e21d4-57b3-4d19-bdd8-97759ef9ed0a does not exist Feb 12 21:08:18.909195 ncdv-master-1 devstack@n-api.service[141727]: Neutron server returns request_ids: ['req-efe59e3f-407a-49bf-a982-dbb354443d88'] {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:18.911030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c194ab4e-cf69-4ae4-8090-53c920256f86 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a" status: 404 len: 194 microversion: 2.1 time: 0.032052 Feb 12 21:08:18.911606 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 983/1966] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/os-security-groups/171e21d4-57b3-4d19-bdd8-97759ef9ed0a => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:18.940321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:18.940846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:18.950543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.951422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.952502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:18.953120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:18.985082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:19.014589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbb58b05-7b17-4521-84bb-40be4fb948ab tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Action: 'create', calling method: .version_select at 0x7fa9080198b0>, body: {"pool": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:19.493397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ead0e6c-9953-46af-8dd0-e55ea4be9cce tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 204 len: 0 microversion: 2.1 time: 0.576755 Feb 12 21:08:19.494010 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 984/1967] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:18 2022] DELETE /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:08:19.503007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:19.503721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:19.515241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:19.516991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:19.517832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:19.521588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:19.785969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:19.796316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de8ad599-7b60-41c5-97ce-5d875de40390 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1646 microversion: 2.1 time: 0.297550 Feb 12 21:08:19.797622 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 985/1968] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:19 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1646 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:19.802852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:19.803814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 19c8f616-0ac8-49ea-8569-b8e0e83a636a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:19.817119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:19.817909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:19.818879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:19.821817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:19.839013 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] HTTP exception thrown: Instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a could not be found. Feb 12 21:08:19.839603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Returning 404 to user: Instance 19c8f616-0ac8-49ea-8569-b8e0e83a636a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:19.840444 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6094afe2-c6ba-4080-862a-a6a1188b9a78 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a" status: 404 len: 111 microversion: 2.1 time: 0.041552 Feb 12 21:08:19.841020 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 986/1969] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:19 2022] GET /compute/v2.1/servers/19c8f616-0ac8-49ea-8569-b8e0e83a636a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:19.850132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:19.851501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:19.859065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:19.859688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:19.860497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:19.860999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:19.904837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:20.327159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d8c9ac6-9e20-4805-a212-506861af9c89 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "DELETE /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 204 len: 0 microversion: 2.1 time: 0.481112 Feb 12 21:08:20.330670 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 987/1970] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:19 2022] DELETE /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:08:20.340196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:20.341441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:20.358580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:20.359692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:20.361347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:20.362003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:20.594618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:20.608853 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-24ef158d-572b-47ea-8e95-e14af480bb58 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1498 microversion: 2.1 time: 0.274512 Feb 12 21:08:20.610337 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 988/1971] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:20 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1498 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:20.815512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:20.816133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:20.830701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:20.832927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:20.834337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:20.835041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:21.465431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:21.482737 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9bbc6b21-3cec-4757-aa50-7c2c78395ff7 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1646 microversion: 2.1 time: 0.671552 Feb 12 21:08:21.484112 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 989/1972] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:20 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1646 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:08:21.509735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:21.512395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:21.533964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:21.537630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:21.543712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:21.543712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:21.675180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:22.304227 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-982e4a4d-47d3-4f70-be12-ce9b868f4f8d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 204 len: 0 microversion: 2.25 time: 0.818502 Feb 12 21:08:22.304821 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 990/1973] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:08:21 2022] DELETE /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:08:22.311560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:22.312267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:22.318425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.318884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.319677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.320109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.412904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f126f64ca5e64defb9bbcf4c6bab2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97311a1994be45a2b507aedc74f578df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:22.440426 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2caee192-e43d-4267-9b7c-9f57e6372a9d tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 200 len: 1456 microversion: 2.1 time: 0.133405 Feb 12 21:08:22.441784 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 991/1974] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:22 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 1456 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:22.472671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5dc8e8b5-f011-45a9-871c-440161d5e352 req-e356d060-2280-465a-a7a3-3de608584fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e82f99-dc16-48b4-987d-d57b003637ff", "name": "network-vif-deleted", "tag": "27c22334-4595-4060-b8ea-dcc1f99639f0"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:22.483644 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:22.483644 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:22.491864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5dc8e8b5-f011-45a9-871c-440161d5e352 req-e356d060-2280-465a-a7a3-3de608584fa8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.492559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5dc8e8b5-f011-45a9-871c-440161d5e352 req-e356d060-2280-465a-a7a3-3de608584fa8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.505657 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5dc8e8b5-f011-45a9-871c-440161d5e352 req-e356d060-2280-465a-a7a3-3de608584fa8 service nova] Creating event network-vif-deleted:27c22334-4595-4060-b8ea-dcc1f99639f0 for instance 77e82f99-dc16-48b4-987d-d57b003637ff on nch1-master-1 Feb 12 21:08:22.512366 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5dc8e8b5-f011-45a9-871c-440161d5e352 req-e356d060-2280-465a-a7a3-3de608584fa8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068527 Feb 12 21:08:22.516368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 992/1975] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:22.519935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:22.520835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:22.528542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.529310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.531187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.531864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.737495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:22.749032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:22.751032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:22.753143 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79df01f6-59f3-45e4-8f20-ac9708287df9 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1564 microversion: 2.25 time: 0.238120 Feb 12 21:08:22.753904 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 993/1976] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:22 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1564 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:22.761076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:22.762278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:22.770895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.771697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.772690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.773327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.869095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:22.889879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-67c75d1f-fba6-4bfa-9db5-7eb06cd31649 tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1467 microversion: 2.1 time: 0.131005 Feb 12 21:08:22.902528 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 994/1977] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:22 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1467 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:22.913032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7c38cc78-f94c-4e45-aa40-8cb385cc52de req-2ce54177-3417-4a95-8c29-0d8f232233ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08416797-b31e-4ab0-af14-a13d93df3fb0", "name": "network-vif-deleted", "tag": "0e5d31bf-1299-4108-a791-2a97cebb0d4f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:22.917535 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:22.917535 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:22.955437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7c38cc78-f94c-4e45-aa40-8cb385cc52de req-2ce54177-3417-4a95-8c29-0d8f232233ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:22.955944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7c38cc78-f94c-4e45-aa40-8cb385cc52de req-2ce54177-3417-4a95-8c29-0d8f232233ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:22.992580 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7c38cc78-f94c-4e45-aa40-8cb385cc52de req-2ce54177-3417-4a95-8c29-0d8f232233ae service nova] Creating event network-vif-deleted:0e5d31bf-1299-4108-a791-2a97cebb0d4f for instance 08416797-b31e-4ab0-af14-a13d93df3fb0 on nch1-master-1 Feb 12 21:08:23.003368 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7c38cc78-f94c-4e45-aa40-8cb385cc52de req-2ce54177-3417-4a95-8c29-0d8f232233ae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098607 Feb 12 21:08:23.008425 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 995/1978] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:23.465739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:23.468278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] [instance: 77e82f99-dc16-48b4-987d-d57b003637ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:23.527491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:23.528159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:23.528988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:23.529515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:23.566113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] HTTP exception thrown: Instance 77e82f99-dc16-48b4-987d-d57b003637ff could not be found. Feb 12 21:08:23.566734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] Returning 404 to user: Instance 77e82f99-dc16-48b4-987d-d57b003637ff could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:23.567592 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce802989-3d0e-443d-93b5-1d61bf6e8469 tempest-LiveMigrationTest-2118604256 tempest-LiveMigrationTest-2118604256-project] 10.222.0.31 "GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff" status: 404 len: 111 microversion: 2.1 time: 0.112422 Feb 12 21:08:23.568173 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 996/1979] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:23 2022] GET /compute/v2.1/servers/77e82f99-dc16-48b4-987d-d57b003637ff => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:23.772024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:23.772688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:23.787417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:23.787836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:23.789246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:23.789890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:23.912794 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbb58b05-7b17-4521-84bb-40be4fb948ab tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 5.079895 Feb 12 21:08:23.916116 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 984/1980] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:08:18 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 5084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:23.932626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:23.934156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:23.955081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:23.957959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:23.959049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:23.959721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:24.023996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:24.025015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:24.026507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lazy-loading 'fault' on Instance uuid 08416797-b31e-4ab0-af14-a13d93df3fb0 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:24.120826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6167cc3c6664a01adb3a4ac3118fc38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225507fa1fa946aa9559a89fe27569b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:24.137444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80d3773d-4f0a-45f4-aa3f-7aaf8dafb2cc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 200 len: 1306 microversion: 2.1 time: 0.218833 Feb 12 21:08:24.147255 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 985/1981] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:23 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 1306 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:24.163177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-728554f3-cfd6-4fbf-93d6-2a5a6cee265f tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Action: 'create', calling method: .version_select at 0x7fa90800cee0>, body: {"pool": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:24.172406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:24.182585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:24.185134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:24.188500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e79804d-d315-4836-a9e4-bf43c3950d99 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1564 microversion: 2.25 time: 0.419765 Feb 12 21:08:24.190099 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 997/1982] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:23 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1564 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:24.783139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1922109882", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2b1697e5-f419-4589-a151-b55b0ebf26eb"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:24.855477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] validate_networks() for [('2b1697e5-f419-4589-a151-b55b0ebf26eb', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:08:25.383936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:08:25.384367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:08:25.384848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:08:25.385551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:08:25.386159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:08:25.401303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.407235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.408374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.409017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.450833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Getting quotas for project 64336eed36cb4beaaf10975e476440c2. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:08:25.459242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Getting quotas for user d4085900934546babc374620183b19fe and project 64336eed36cb4beaaf10975e476440c2. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:08:25.483402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:08:25.488650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:08:25.730288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-87b7ea83-0f04-4f96-806c-6e3fd24951df tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152760 Feb 12 21:08:25.747497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 998/1983] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:08:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:08:25.761914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:25.768294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] [instance: 08416797-b31e-4ab0-af14-a13d93df3fb0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:25.782846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.783502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.785079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.786087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.816061 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] HTTP exception thrown: Instance 08416797-b31e-4ab0-af14-a13d93df3fb0 could not be found. Feb 12 21:08:25.820322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Returning 404 to user: Instance 08416797-b31e-4ab0-af14-a13d93df3fb0 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:25.821558 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00400a06-00dc-41f2-ae03-497002e53c5b tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0" status: 404 len: 111 microversion: 2.1 time: 0.072565 Feb 12 21:08:25.824948 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 999/1984] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:25 2022] GET /compute/v2.1/servers/08416797-b31e-4ab0-af14-a13d93df3fb0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:25.832172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:25.835382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:25.847877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.848326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.853262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.854168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.949284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:25.949859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:25.950344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lazy-loading 'fault' on Instance uuid 1d0d6420-a0c3-4a88-9549-864fdefe2378 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:26.083237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:26.096111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:26.098119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:26.099616 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e4c3489-8128-4ffe-a7a8-4006a25cb2ec tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 200 len: 1351 microversion: 2.25 time: 0.273459 Feb 12 21:08:26.100770 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1000/1985] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:25 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:26.106965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b615e6ba-8415-46bc-9c92-2972da4ca589 req-001f02e3-36c9-4964-9917-0760d04d4cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0d6420-a0c3-4a88-9549-864fdefe2378", "name": "network-vif-deleted", "tag": "76d6d407-e6c3-4fc4-984f-2f18ac7b3009"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:26.108942 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:26.108942 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:26.126263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b615e6ba-8415-46bc-9c92-2972da4ca589 req-001f02e3-36c9-4964-9917-0760d04d4cb1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:26.126757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b615e6ba-8415-46bc-9c92-2972da4ca589 req-001f02e3-36c9-4964-9917-0760d04d4cb1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:26.146928 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b615e6ba-8415-46bc-9c92-2972da4ca589 req-001f02e3-36c9-4964-9917-0760d04d4cb1 service nova] Creating event network-vif-deleted:76d6d407-e6c3-4fc4-984f-2f18ac7b3009 for instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 on nch2-master-1 Feb 12 21:08:26.170758 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b615e6ba-8415-46bc-9c92-2972da4ca589 req-001f02e3-36c9-4964-9917-0760d04d4cb1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064384 Feb 12 21:08:26.174665 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1001/1986] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:26.186824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65b5e3bd-31c3-433c-8b11-6869d9145d3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:26.187699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65b5e3bd-31c3-433c-8b11-6869d9145d3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:26.296562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-65b5e3bd-31c3-433c-8b11-6869d9145d3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:26.304780 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65b5e3bd-31c3-433c-8b11-6869d9145d3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1218 microversion: 2.1 time: 0.128483 Feb 12 21:08:26.305665 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1002/1987] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:26 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:26.317494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cacd07f3-faa6-4c20-b8ea-87e05c3e6ffc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8fe8ab280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:26.853526 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cacd07f3-faa6-4c20-b8ea-87e05c3e6ffc tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/dbfab272-2908-4105-a62b-ae7258207b37" status: 202 len: 0 microversion: 2.1 time: 0.546463 Feb 12 21:08:26.855488 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1003/1988] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:26 2022] DELETE /compute/v2.1/os-security-groups/dbfab272-2908-4105-a62b-ae7258207b37 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:26.866945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-faedfc6c-7b49-43a2-9780-31251817ff0a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] Calling method '.version_select at 0x7fa8febef280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:27.444602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-faedfc6c-7b49-43a2-9780-31251817ff0a tempest-SecurityGroupsTestJSON-531603590 tempest-SecurityGroupsTestJSON-531603590-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/d03fdd0f-8263-425f-9df4-bea560d1f8ee" status: 202 len: 0 microversion: 2.1 time: 0.584909 Feb 12 21:08:27.445873 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1004/1989] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:08:26 2022] DELETE /compute/v2.1/os-security-groups/d03fdd0f-8263-425f-9df4-bea560d1f8ee => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:27.457932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:27.458549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 1d0d6420-a0c3-4a88-9549-864fdefe2378] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:27.469327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:27.478373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:27.479898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:27.480712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:27.506844 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] HTTP exception thrown: Instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 could not be found. Feb 12 21:08:27.511514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Returning 404 to user: Instance 1d0d6420-a0c3-4a88-9549-864fdefe2378 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:27.514845 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa2c64a6-13fb-4abb-bc9c-879a9266700d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378" status: 404 len: 111 microversion: 2.25 time: 0.067589 Feb 12 21:08:27.518448 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1005/1990] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:27 2022] GET /compute/v2.1/servers/1d0d6420-a0c3-4a88-9549-864fdefe2378 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:27.543004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:27.543004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:27.559522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:27.564810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:27.565279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:27.566013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:27.761315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:27.775227 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d0a059c-ea8f-4dd3-865c-edd5cc2ccc95 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1222 microversion: 2.1 time: 0.255562 Feb 12 21:08:27.777451 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1006/1991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:27 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:27.792117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:27.793430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:27.804343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:27.805167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:27.806256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:27.806949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:27.849708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:27.919805 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-728554f3-cfd6-4fbf-93d6-2a5a6cee265f tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.771130 Feb 12 21:08:27.920479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 986/1992] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:08:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:27.937423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f985bf46-9e83-4f91-8718-87ba1b1972f2 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Action: 'create', calling method: .version_select at 0x7fa907fe1820>, body: {"pool": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:28.296011 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee4487c3-3e32-4c22-9966-185435331e8f tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 204 len: 0 microversion: 2.25 time: 0.515179 Feb 12 21:08:28.297414 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1007/1993] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:08:27 2022] DELETE /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:08:28.323160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:28.337933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:28.349120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:28.349774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:28.350601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:28.351053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:28.662543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:28.674928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:28.676609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:28.683094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1b76601-2082-47b2-ba0d-b7d3a254133d tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1550 microversion: 2.25 time: 0.371934 Feb 12 21:08:28.689719 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1008/1994] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:28 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1550 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:08:28.799979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:28.802216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:28.815230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:28.816794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:28.818230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:28.818900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:29.012023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:29.033066 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b816d79a-6749-431f-86a4-1d4fe26beb3c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1278 microversion: 2.1 time: 0.242085 Feb 12 21:08:29.033799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1009/1995] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:28 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:29.703957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:29.709897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:29.723380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:29.731055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:29.732092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:29.732717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:30.440723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:30.451476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:30.458505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:30.460604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36a62233-59fb-40c6-b754-bed7a0fe54b1 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1550 microversion: 2.25 time: 0.762020 Feb 12 21:08:30.476653 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1010/1996] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:29 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1550 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:30.485703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:30.486598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:30.518284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:30.518979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:30.520048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:30.520730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:30.625094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:30.643493 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-780c2503-2edb-4c12-92d1-5cf9869e3664 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1276 microversion: 2.1 time: 0.165207 Feb 12 21:08:30.645019 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1011/1997] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:30 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:30.650358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-054687bf-008f-4c50-b0a3-6100d58978de req-a19804b2-6741-4980-9160-d132026fc5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6adffe64-7deb-47c3-b073-0fc6b684979f", "name": "network-vif-deleted", "tag": "6ab99884-aa16-42e5-9cde-aea1aba07ad2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:30.652475 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:30.652475 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:30.667695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-054687bf-008f-4c50-b0a3-6100d58978de req-a19804b2-6741-4980-9160-d132026fc5de service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:30.668751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-054687bf-008f-4c50-b0a3-6100d58978de req-a19804b2-6741-4980-9160-d132026fc5de service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:30.702983 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-054687bf-008f-4c50-b0a3-6100d58978de req-a19804b2-6741-4980-9160-d132026fc5de service nova] Creating event network-vif-deleted:6ab99884-aa16-42e5-9cde-aea1aba07ad2 for instance 6adffe64-7deb-47c3-b073-0fc6b684979f on nch2-master-1 Feb 12 21:08:30.719845 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-054687bf-008f-4c50-b0a3-6100d58978de req-a19804b2-6741-4980-9160-d132026fc5de service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063426 Feb 12 21:08:30.721791 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1012/1998] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:31.390612 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:08:31.391182 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 21:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:08:31.483581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:31.484435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:31.508793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:31.511814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:31.521518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:31.521518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:31.632311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:31.632767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:31.633240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lazy-loading 'fault' on Instance uuid 6adffe64-7deb-47c3-b073-0fc6b684979f {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:31.726650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:31.735738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:31.744815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:31.754483 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c663a5b-20a3-45ce-ada6-2bb455b01160 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 200 len: 1352 microversion: 2.25 time: 0.277629 Feb 12 21:08:31.756360 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1013/1999] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:31 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 1352 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:31.769661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:31.770287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:31.784752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:31.791379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:31.795076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:31.795960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:32.028731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:32.037321 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d8d22be1-a03a-47dc-a6bb-acac3159958e tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.275952 Feb 12 21:08:32.038204 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1014/2000] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:31 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:32.576696 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f985bf46-9e83-4f91-8718-87ba1b1972f2 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.643210 Feb 12 21:08:32.578208 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 987/2001] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:08:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:32.600040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a2985f1-ad96-40f6-9d4f-ed24fda84542 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Action: 'create', calling method: .version_select at 0x7fa8fea6a820>, body: {"pool": null} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:32.778540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:32.779749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: 6adffe64-7deb-47c3-b073-0fc6b684979f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:32.796644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:32.797127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:32.800519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:32.802558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:32.843488 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] HTTP exception thrown: Instance 6adffe64-7deb-47c3-b073-0fc6b684979f could not be found. Feb 12 21:08:32.844280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Returning 404 to user: Instance 6adffe64-7deb-47c3-b073-0fc6b684979f could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:32.845141 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-911a05d8-17a0-4a87-8299-1e81aaa211d6 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f" status: 404 len: 111 microversion: 2.25 time: 0.072572 Feb 12 21:08:32.845747 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 988/2002] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:32 2022] GET /compute/v2.1/servers/6adffe64-7deb-47c3-b073-0fc6b684979f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:32.854039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:32.854923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:32.862581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:32.869805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:32.869805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:32.869805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:32.904110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:33.469292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-633b0cf0-e33a-44d0-b38b-2b8c5fa8b2fc tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 204 len: 0 microversion: 2.25 time: 0.618759 Feb 12 21:08:33.470258 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 989/2003] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:08:32 2022] DELETE /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:08:33.475824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:33.476540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:33.488762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:33.489225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:33.495011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:33.495686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:34.184800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:34.239335 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-83e304cc-1e64-4df9-a5bf-c69f44f8cea0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.767714 Feb 12 21:08:34.240163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 990/2004] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:33 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:34.263683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:34.264256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:34.299243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:34.299769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:34.300564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:34.301038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:34.361523 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. Feb 12 21:08:34.362490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:34.363743 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4823c94f-d2f4-4e35-8654-e981ba7caa32 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 404 len: 111 microversion: 2.1 time: 0.122679 Feb 12 21:08:34.377879 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 991/2005] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:34 2022] DELETE /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:34.383637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:34.384456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:34.401805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:34.402310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:34.403192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:34.403613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:35.234360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:35.256166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:35.264045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:35.282930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3ffb82e-551d-4a26-9cd7-f54f456f86cd tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1564 microversion: 2.25 time: 0.889219 Feb 12 21:08:35.282930 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 992/2006] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:34 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1564 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:35.282930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7778f868-0368-4f8f-b697-fbcfd4d10cc1 req-596df738-9c19-4657-9202-96b4a43c1df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29bb4ee-486f-48d1-869a-fd43a7d785c9", "tag": "c9859cfe-7f49-4ab1-b5e4-6971a2e42056"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:35.285636 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:35.285636 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:35.305028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7778f868-0368-4f8f-b697-fbcfd4d10cc1 req-596df738-9c19-4657-9202-96b4a43c1df1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:35.305412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7778f868-0368-4f8f-b697-fbcfd4d10cc1 req-596df738-9c19-4657-9202-96b4a43c1df1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:35.340422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7778f868-0368-4f8f-b697-fbcfd4d10cc1 req-596df738-9c19-4657-9202-96b4a43c1df1 service nova] Creating event network-changed:c9859cfe-7f49-4ab1-b5e4-6971a2e42056 for instance d29bb4ee-486f-48d1-869a-fd43a7d785c9 on nch2-master-1 Feb 12 21:08:35.355380 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7778f868-0368-4f8f-b697-fbcfd4d10cc1 req-596df738-9c19-4657-9202-96b4a43c1df1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084957 Feb 12 21:08:35.356329 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 993/2007] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:35.363177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:35.369337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: 2b389ae6-debb-4a3d-9fbb-648307b779ed] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:35.372004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:35.372469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:35.373315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:35.373783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:35.394507 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. Feb 12 21:08:35.395384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance 2b389ae6-debb-4a3d-9fbb-648307b779ed could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:35.396377 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8d9315c-bbe8-4677-b6da-1972dbb9c561 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed" status: 404 len: 111 microversion: 2.1 time: 0.038741 Feb 12 21:08:35.397445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 994/2008] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:35 2022] GET /compute/v2.1/servers/2b389ae6-debb-4a3d-9fbb-648307b779ed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:35.722946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df79243e-13e9-4282-b1ac-073e3c25e4a0 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '.version_select at 0x7fa907fc5d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:35.833666 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df79243e-13e9-4282-b1ac-073e3c25e4a0 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8" status: 200 len: 371 microversion: 2.1 time: 0.434761 Feb 12 21:08:35.835897 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 995/2009] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:08:35 2022] GET /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8 => generated 371 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:35.855177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:35.859899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:35.878192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:35.883978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:35.887425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:35.893879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.141187 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a2985f1-ad96-40f6-9d4f-ed24fda84542 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.556318 Feb 12 21:08:36.141979 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1015/2010] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:08:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:36.151969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:36.151969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:36.167661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.177335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.178714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.179396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.211687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:08:36.356581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:36.371546 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a6fc07d-b357-4342-867e-47be424326d4 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.526239 Feb 12 21:08:36.372436 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 996/2011] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:35 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:36.376985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-73c5d7cd-b3fa-4331-9431-e3cd05c99515 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe7e7310>, body: {"quota_set": {"ram": "5120"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:36.378991 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:36.378991 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:36.502821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73c5d7cd-b3fa-4331-9431-e3cd05c99515 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.503739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73c5d7cd-b3fa-4331-9431-e3cd05c99515 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.504787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73c5d7cd-b3fa-4331-9431-e3cd05c99515 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.505782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73c5d7cd-b3fa-4331-9431-e3cd05c99515 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.636842 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f333eee-cfaa-46d0-9eaf-5b48148dbdc9 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 204 len: 0 microversion: 2.1 time: 0.491788 Feb 12 21:08:36.636842 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1016/2012] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:08:36 2022] DELETE /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:08:36.645767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1dff5cd4-bfed-4b12-8edf-d107b0d9c6ee tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa8fecf0280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:36.685465 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-73c5d7cd-b3fa-4331-9431-e3cd05c99515 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8" status: 200 len: 328 microversion: 2.1 time: 0.311647 Feb 12 21:08:36.692732 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 997/2013] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:08:36 2022] PUT /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8 => generated 328 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:36.703696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:36.711489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:36.725117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.725979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.727304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.727936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.778281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.778829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.779513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lazy-loading 'fault' on Instance uuid ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:36.861082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:36.875625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:36.879932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cae3e35c281419b98224db3b8ea1f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ba3f98cb348929658959fd4ff31cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:36.882270 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ed21570-dd60-4f90-a980-a765f951dd49 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 200 len: 1352 microversion: 2.25 time: 0.187884 Feb 12 21:08:36.889132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 998/2014] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:36 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 1352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:08:36.894276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:36.895852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:36.913496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.916961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:36.918291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:36.918929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:37.049328 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1dff5cd4-bfed-4b12-8edf-d107b0d9c6ee tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips/8704cf96-0408-4ed8-ad95-5f1332223288" status: 200 len: 142 microversion: 2.1 time: 0.410114 Feb 12 21:08:37.050062 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1017/2015] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:08:36 2022] GET /compute/v2.1/os-floating-ips/8704cf96-0408-4ed8-ad95-5f1332223288 => generated 142 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:37.060059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9fb8865-ce04-43de-bfda-ff9deaada71d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:37.061634 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:37.061634 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:37.161526 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9fb8865-ce04-43de-bfda-ff9deaada71d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8" status: 202 len: 0 microversion: 2.1 time: 0.109873 Feb 12 21:08:37.166496 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1018/2016] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:08:37 2022] DELETE /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:37.172057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7bd9fb91-a473-4fe5-8431-d03b0f4367e3 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa8fec91ee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:37.196938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:37.208178 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea68cc2d-467f-43c9-a7ba-4456b9cd2f17 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 0.316498 Feb 12 21:08:37.208962 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 999/2017] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:36 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:37.218630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97773697-427a-46d0-a611-4ec6363683ad tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '.version_select at 0x7fa907fdbaf0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:37.365188 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97773697-427a-46d0-a611-4ec6363683ad tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8" status: 200 len: 371 microversion: 2.1 time: 0.154199 Feb 12 21:08:37.373328 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1000/2018] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:08:37 2022] GET /compute/v2.1/os-quota-sets/dc5f2cdf2c6e45d7b76d5cc1abaa18c8 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:37.403993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7a07951e-0970-43aa-ac7f-10a31b1162b2 req-69ef9dd1-09e9-4bcd-bb6a-74701a83c41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac07934b-e366-4ce9-9d0b-d6f3ee7833f9", "name": "network-vif-deleted", "tag": "692da1ed-6391-4b0f-95c0-4a1ac462850c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:37.412687 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:37.412687 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:37.441224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7a07951e-0970-43aa-ac7f-10a31b1162b2 req-69ef9dd1-09e9-4bcd-bb6a-74701a83c41e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:37.442593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7a07951e-0970-43aa-ac7f-10a31b1162b2 req-69ef9dd1-09e9-4bcd-bb6a-74701a83c41e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:37.481745 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7a07951e-0970-43aa-ac7f-10a31b1162b2 req-69ef9dd1-09e9-4bcd-bb6a-74701a83c41e service nova] Creating event network-vif-deleted:692da1ed-6391-4b0f-95c0-4a1ac462850c for instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 on nch1-master-1 Feb 12 21:08:37.497824 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7a07951e-0970-43aa-ac7f-10a31b1162b2 req-69ef9dd1-09e9-4bcd-bb6a-74701a83c41e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122948 Feb 12 21:08:37.502571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1001/2019] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:37.525909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:37.526671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:37.550808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:37.555871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:37.555871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:37.555871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:37.934187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:37.959453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-acf7e11a-1a23-4ebf-b16b-6cf749deea6c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.455240 Feb 12 21:08:37.977336 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1002/2020] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:37 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:37.989460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38e1195d-fa66-40f4-93f0-838e40ba4734 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '.version_select at 0x7fa8fe402550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:38.438120 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-38e1195d-fa66-40f4-93f0-838e40ba4734 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.451781 Feb 12 21:08:38.463521 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1003/2021] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:08:37 2022] GET /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9/defaults => generated 371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:38.480851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:38.482816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] [instance: ac07934b-e366-4ce9-9d0b-d6f3ee7833f9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:38.571497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:38.571497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:38.571497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:38.571497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:38.638562 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] HTTP exception thrown: Instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 could not be found. Feb 12 21:08:38.639774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] Returning 404 to user: Instance ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:38.641535 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1eb923e0-5cb2-470d-af8a-fbf919199547 tempest-LiveAutoBlockMigrationV225Test-774612202 tempest-LiveAutoBlockMigrationV225Test-774612202-project] 10.222.0.31 "GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9" status: 404 len: 111 microversion: 2.25 time: 0.176044 Feb 12 21:08:38.644854 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1004/2022] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:08:38 2022] GET /compute/v2.1/servers/ac07934b-e366-4ce9-9d0b-d6f3ee7833f9 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:38.658505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:38.659645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:38.669905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:38.670769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:38.672070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:38.672739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:38.886207 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7bd9fb91-a473-4fe5-8431-d03b0f4367e3 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/8704cf96-0408-4ed8-ad95-5f1332223288" status: 202 len: 0 microversion: 2.1 time: 1.720990 Feb 12 21:08:38.891500 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1019/2023] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:08:37 2022] DELETE /compute/v2.1/os-floating-ips/8704cf96-0408-4ed8-ad95-5f1332223288 => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:38.902811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-992d646d-cc78-4542-b115-79d39e37bb64 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa8fe8988b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:39.375234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-992d646d-cc78-4542-b115-79d39e37bb64 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.479082 Feb 12 21:08:39.381113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1020/2024] 10.222.0.31 () {58 vars in 1163 bytes} [Sat Feb 12 21:08:38 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:08:39.389768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:39.391727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:39.415737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:39.415737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:39.415737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:39.415737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:39.759015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:39.772255 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf636082-598a-4e86-a6ae-aff28ef13451 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.387334 Feb 12 21:08:39.792875 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1021/2025] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:39 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:39.805817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56fb9db9-c62b-409c-b759-6c3cdaffdc7d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fea6a3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:39.811951 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:39.811951 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:40.041221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56fb9db9-c62b-409c-b759-6c3cdaffdc7d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:40.042602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56fb9db9-c62b-409c-b759-6c3cdaffdc7d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:40.043692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56fb9db9-c62b-409c-b759-6c3cdaffdc7d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:40.044479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56fb9db9-c62b-409c-b759-6c3cdaffdc7d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:40.221640 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56fb9db9-c62b-409c-b759-6c3cdaffdc7d tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c" status: 200 len: 328 microversion: 2.1 time: 0.426652 Feb 12 21:08:40.223788 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1022/2026] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:08:39 2022] PUT /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c => generated 328 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:40.231710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8b042e4-c1b8-4df0-b9c6-f5a9a49ace80 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa8fec7a4c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:40.324583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:40.350596 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc02fa84-ca1e-47a6-ac92-f230050a7b33 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1512 microversion: 2.1 time: 1.698352 Feb 12 21:08:40.352793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1005/2027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:38 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1512 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:40.361891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03b4ddec-7fdf-49c5-8b75-573c1a5a0d5b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '.version_select at 0x7fa90802df70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:40.510800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b4ddec-7fdf-49c5-8b75-573c1a5a0d5b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:40.526837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b4ddec-7fdf-49c5-8b75-573c1a5a0d5b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:40.526837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b4ddec-7fdf-49c5-8b75-573c1a5a0d5b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:40.526837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b4ddec-7fdf-49c5-8b75-573c1a5a0d5b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:40.585195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03b4ddec-7fdf-49c5-8b75-573c1a5a0d5b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c/detail" status: 200 len: 916 microversion: 2.1 time: 0.228297 Feb 12 21:08:40.586337 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1006/2028] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:08:40 2022] GET /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c/detail => generated 916 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:40.657735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8b042e4-c1b8-4df0-b9c6-f5a9a49ace80 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips" status: 200 len: 395 microversion: 2.1 time: 0.433264 Feb 12 21:08:40.658334 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1023/2029] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:08:40 2022] GET /compute/v2.1/os-floating-ips => generated 395 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:40.674621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-731857fa-3efa-472c-aaa1-e1a5e1a1ffcb tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa8fe402040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:40.798620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:40.799242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:40.808977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:40.809805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:40.811425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:40.812101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.076303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:41.107879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3235251-078c-4d47-bf4c-2ea75b77a2d3 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.312679 Feb 12 21:08:41.109581 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1024/2030] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:40 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:41.116507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fec56e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:41.119311 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:41.119311 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:41.249315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.250142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.254494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.254494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.328030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.328523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.329401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.329883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.523281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb5da217-645c-4589-b7c8-ad4e1ccf521b tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c?user_id=6ba706b1992a4565be08f2b653278782" status: 200 len: 328 microversion: 2.1 time: 0.410508 Feb 12 21:08:41.530637 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1025/2031] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:08:41 2022] PUT /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c?user_id=6ba706b1992a4565be08f2b653278782 => generated 328 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:41.539334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:41.540492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:41.550165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.554684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.554684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.554684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.672642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10910ab3eb3c4b40af57679da421dbb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02d862cc48f14c42ba73c75e882e9c87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:41.685645 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd7222ee-ea2e-438b-a216-12851acd08be tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 200 len: 1470 microversion: 2.1 time: 0.151699 Feb 12 21:08:41.687211 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1026/2032] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:41 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:41.706480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-950e95f5-1260-4daf-85c3-0c61ef03c3a7 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '.version_select at 0x7fa8fec7aee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:41.829196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-950e95f5-1260-4daf-85c3-0c61ef03c3a7 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c?user_id=6ba706b1992a4565be08f2b653278782" status: 200 len: 370 microversion: 2.1 time: 0.140590 Feb 12 21:08:41.830118 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1027/2033] 10.222.0.31 () {58 vars in 1322 bytes} [Sat Feb 12 21:08:41 2022] GET /compute/v2.1/os-quota-sets/14845c0ddc104f1a97ce6d80f97a0d3c?user_id=6ba706b1992a4565be08f2b653278782 => generated 370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:41.835087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e95dce14-9613-4995-8c5d-bc1afb138d13 req-1b23896e-8163-4ea2-9774-b9765b87cf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29bb4ee-486f-48d1-869a-fd43a7d785c9", "name": "network-vif-plugged", "status": "completed", "tag": "c9859cfe-7f49-4ab1-b5e4-6971a2e42056"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:41.837170 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:41.837170 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:41.847199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e95dce14-9613-4995-8c5d-bc1afb138d13 req-1b23896e-8163-4ea2-9774-b9765b87cf7c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.848183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e95dce14-9613-4995-8c5d-bc1afb138d13 req-1b23896e-8163-4ea2-9774-b9765b87cf7c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.863763 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e95dce14-9613-4995-8c5d-bc1afb138d13 req-1b23896e-8163-4ea2-9774-b9765b87cf7c service nova] Creating event network-vif-plugged:c9859cfe-7f49-4ab1-b5e4-6971a2e42056 for instance d29bb4ee-486f-48d1-869a-fd43a7d785c9 on nch2-master-1 Feb 12 21:08:41.870356 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e95dce14-9613-4995-8c5d-bc1afb138d13 req-1b23896e-8163-4ea2-9774-b9765b87cf7c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037972 Feb 12 21:08:41.871680 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1028/2034] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:41.951991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-eacf63dc-8427-4182-99af-7fcc78206c62 req-94e4e657-93b4-4400-a6d4-e61e5cc5e995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb565b3e-86a6-4ab9-b812-5901d747f049", "name": "network-vif-deleted", "tag": "ec357ac8-2d34-44cb-8ba8-0821decd9e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:41.951991 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:41.951991 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:41.971046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eacf63dc-8427-4182-99af-7fcc78206c62 req-94e4e657-93b4-4400-a6d4-e61e5cc5e995 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:41.971856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eacf63dc-8427-4182-99af-7fcc78206c62 req-94e4e657-93b4-4400-a6d4-e61e5cc5e995 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:41.997124 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-eacf63dc-8427-4182-99af-7fcc78206c62 req-94e4e657-93b4-4400-a6d4-e61e5cc5e995 service nova] Creating event network-vif-deleted:ec357ac8-2d34-44cb-8ba8-0821decd9e9a for instance bb565b3e-86a6-4ab9-b812-5901d747f049 on nch2-master-1 Feb 12 21:08:42.002315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-eacf63dc-8427-4182-99af-7fcc78206c62 req-94e4e657-93b4-4400-a6d4-e61e5cc5e995 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068495 Feb 12 21:08:42.004226 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1029/2035] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:42.129607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:42.131116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:42.143743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:42.144941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:42.145935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:42.155239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:42.371582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:42.389394 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1204ade8-402c-4db4-811d-8eb7015706fd tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.258633 Feb 12 21:08:42.399012 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1030/2036] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:42 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:42.614440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9dabe88-7630-4e22-bf99-32a72101f299 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Calling method '.version_select at 0x7fa8fec91700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:42.897947 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9dabe88-7630-4e22-bf99-32a72101f299 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.286958 Feb 12 21:08:42.898898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1031/2037] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:08:42 2022] GET /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9/defaults => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:08:42.910673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:42.911619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] [instance: bb565b3e-86a6-4ab9-b812-5901d747f049] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:42.922161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:42.922954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:42.924083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:42.924675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:42.948950 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] HTTP exception thrown: Instance bb565b3e-86a6-4ab9-b812-5901d747f049 could not be found. Feb 12 21:08:42.955446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] Returning 404 to user: Instance bb565b3e-86a6-4ab9-b812-5901d747f049 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:42.955446 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a1f6ba73-d408-4f07-9129-5dc23d85bfa5 tempest-ServersNegativeTestJSON-1351691899 tempest-ServersNegativeTestJSON-1351691899-project] 10.222.0.31 "GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049" status: 404 len: 111 microversion: 2.1 time: 0.044328 Feb 12 21:08:42.955446 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1032/2038] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:42 2022] GET /compute/v2.1/servers/bb565b3e-86a6-4ab9-b812-5901d747f049 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:08:42.965866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d082db87-7478-463d-83f2-a8a2cc1a3d41 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fec91ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:42.971644 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:42.971644 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:43.075995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d082db87-7478-463d-83f2-a8a2cc1a3d41 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:43.076771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d082db87-7478-463d-83f2-a8a2cc1a3d41 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:43.078485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d082db87-7478-463d-83f2-a8a2cc1a3d41 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:43.079416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d082db87-7478-463d-83f2-a8a2cc1a3d41 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:43.398033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-731857fa-3efa-472c-aaa1-e1a5e1a1ffcb tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/f1fbd763-ef5d-4956-a98a-8186c93e442b" status: 202 len: 0 microversion: 2.1 time: 2.728934 Feb 12 21:08:43.408094 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1007/2039] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:08:40 2022] DELETE /compute/v2.1/os-floating-ips/f1fbd763-ef5d-4956-a98a-8186c93e442b => generated 0 bytes in 2741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:43.427198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:43.437089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:43.464505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:43.465268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:43.466773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:43.467497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:44.049348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:44.071425 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce3124cd-6006-43c0-a2fd-1134011ea696 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1318 microversion: 2.1 time: 0.660779 Feb 12 21:08:44.073998 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1008/2040] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:43 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:44.109857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-842d4443-e477-4b9a-a3ff-87f2cf1357e9 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa90806a160>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:44.917341 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d082db87-7478-463d-83f2-a8a2cc1a3d41 tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9" status: 200 len: 329 microversion: 2.1 time: 1.964383 Feb 12 21:08:44.925705 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1033/2041] 10.222.0.31 () {60 vars in 1262 bytes} [Sat Feb 12 21:08:42 2022] PUT /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9 => generated 329 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:44.933766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62924b84-23fb-4d7d-94d2-85dc71ae90df tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fec56a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:45.277718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62924b84-23fb-4d7d-94d2-85dc71ae90df tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:45.278651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62924b84-23fb-4d7d-94d2-85dc71ae90df tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:45.280433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62924b84-23fb-4d7d-94d2-85dc71ae90df tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:45.281128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62924b84-23fb-4d7d-94d2-85dc71ae90df tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:45.684468 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-842d4443-e477-4b9a-a3ff-87f2cf1357e9 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/0f4ec4bc-efac-47bf-8dcc-9991bec3bb08" status: 202 len: 0 microversion: 2.1 time: 1.593712 Feb 12 21:08:45.685050 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1009/2042] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:08:44 2022] DELETE /compute/v2.1/os-floating-ips/0f4ec4bc-efac-47bf-8dcc-9991bec3bb08 => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:45.689794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:45.690415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:45.707369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:45.708066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:45.709106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:45.709782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:46.012016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:46.024137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d31b1916-ea82-48f4-bfdc-a0ccb8febd7a tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1508 microversion: 2.1 time: 0.338001 Feb 12 21:08:46.037643 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1010/2043] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:45 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:46.053199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b41c51e-d7bb-4fdf-9eee-9c19aeca8ef3 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '.version_select at 0x7fa9080454c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:47.998058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62924b84-23fb-4d7d-94d2-85dc71ae90df tempest-QuotasAdminTestJSON-849682060 tempest-QuotasAdminTestJSON-849682060-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9" status: 200 len: 329 microversion: 2.1 time: 3.070487 Feb 12 21:08:48.001196 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1034/2044] 10.222.0.31 () {60 vars in 1262 bytes} [Sat Feb 12 21:08:44 2022] PUT /compute/v2.1/os-quota-sets/cd2860117613457a8685bcf06060fcc9 => generated 329 bytes in 3075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:48.042805 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b41c51e-d7bb-4fdf-9eee-9c19aeca8ef3 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/9cd18203-17a4-47d9-8944-13a0a6bdc156" status: 202 len: 0 microversion: 2.1 time: 2.003547 Feb 12 21:08:48.043419 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1011/2045] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:08:46 2022] DELETE /compute/v2.1/os-floating-ips/9cd18203-17a4-47d9-8944-13a0a6bdc156 => generated 0 bytes in 2005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:08:49.524592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c760504-b4a2-4f2f-99ea-5ede01f11a08"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:49.527982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:49.539796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:49.540464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:49.542828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:49.543669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:50.748308 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fd2c85d-3c19-47e1-872c-560267a85bb0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "POST /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.230738 Feb 12 21:08:50.754697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1035/2046] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:08:49 2022] POST /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments => generated 194 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:08:52.517997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b41c51e-d7bb-4fdf-9eee-9c19aeca8ef3 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:52.519372 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b41c51e-d7bb-4fdf-9eee-9c19aeca8ef3 tempest-FloatingIPDetailsTestJSON-1997637410 tempest-FloatingIPDetailsTestJSON-1997637410-project] 10.222.0.31 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001833 Feb 12 21:08:52.520286 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1012/2047] 10.222.0.31 () {56 vars in 885 bytes} [Sat Feb 12 21:08:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 12 21:08:53.287038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-817236339", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:53.446697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:08:55.088407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:08:55.091629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:08:55.092168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:08:55.092970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:08:55.094059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:08:55.109652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:55.110471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:55.111785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:55.112406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:55.161926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Getting quotas for project 517a5f8cbeba42f6841e1eccf9c2914d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:08:55.178177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Getting quotas for user 17359f385cb64f9fa0fb079cb3cdae54 and project 517a5f8cbeba42f6841e1eccf9c2914d. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:08:55.225156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:08:55.228288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:08:55.392946 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-482d5e09-f087-428e-9d85-d61649279182 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.535152 Feb 12 21:08:55.396867 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1036/2048] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:08:55.626155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1955324264", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:55.776685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:08:56.279268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:08:56.279632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:08:56.280173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:08:56.280587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:08:56.281013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:08:56.308038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:56.308490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:56.310751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:56.311552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:56.380348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Getting quotas for project 517a5f8cbeba42f6841e1eccf9c2914d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:08:56.400280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Getting quotas for user 17359f385cb64f9fa0fb079cb3cdae54 and project 517a5f8cbeba42f6841e1eccf9c2914d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:08:56.453344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:08:56.470890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:08:56.721422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f825d9f8-1158-4b94-832b-647bc93b328f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098256 Feb 12 21:08:56.727826 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1013/2049] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:08:56.737956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80d3184e-6a89-492e-b4b7-bbf628486218 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:56.737956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80d3184e-6a89-492e-b4b7-bbf628486218 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:57.045133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80d3184e-6a89-492e-b4b7-bbf628486218 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:57.055908 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80d3184e-6a89-492e-b4b7-bbf628486218 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1214 microversion: 2.1 time: 0.323971 Feb 12 21:08:57.058219 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1037/2050] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:56 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:57.603446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55463a6b-e9d2-468a-83c8-c14ea47c4ea3 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Action: 'update', calling method: .version_select at 0x7fa907fe2670>, body: {"quota_set": {"ram": "5120"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:57.604124 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:57.604124 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:08:57.786689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55463a6b-e9d2-468a-83c8-c14ea47c4ea3 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:57.787324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55463a6b-e9d2-468a-83c8-c14ea47c4ea3 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:57.802391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55463a6b-e9d2-468a-83c8-c14ea47c4ea3 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:57.803821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55463a6b-e9d2-468a-83c8-c14ea47c4ea3 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.089748 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55463a6b-e9d2-468a-83c8-c14ea47c4ea3 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1" status: 200 len: 240 microversion: 2.36 time: 0.866209 Feb 12 21:08:58.099007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1014/2051] 10.222.0.31 () {62 vars in 1302 bytes} [Sat Feb 12 21:08:57 2022] PUT /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1 => generated 240 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:08:58.108395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd8da692-de8f-489b-9b37-f30360ed3ca5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:58.113641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd8da692-de8f-489b-9b37-f30360ed3ca5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:58.223858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd8da692-de8f-489b-9b37-f30360ed3ca5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:58.235282 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd8da692-de8f-489b-9b37-f30360ed3ca5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1214 microversion: 2.1 time: 0.134918 Feb 12 21:08:58.235882 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1015/2052] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:58 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:58.250235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81978328-cd3d-49aa-a72e-d86ac7fc0c46 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Calling method '.version_select at 0x7fa90800c9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:58.300342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c46f79ab-e3d7-46ef-b24c-08ff42bde4e5"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:58.303128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:58.323770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:58.324444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.327449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:58.329581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.445554 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:58.445554 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:58.617430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] HTTP exception thrown: Volume c46f79ab-e3d7-46ef-b24c-08ff42bde4e5 could not be found. Feb 12 21:08:58.618330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Returning 400 to user: Volume c46f79ab-e3d7-46ef-b24c-08ff42bde4e5 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:08:58.620438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-452ec0b6-7e5c-4cda-b9b2-66b0be8809f2 tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] 10.222.0.31 "PUT /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments/5c760504-b4a2-4f2f-99ea-5ede01f11a08" status: 400 len: 107 microversion: 2.1 time: 0.746087 Feb 12 21:08:58.621293 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1038/2053] 10.222.0.31 () {60 vars in 1432 bytes} [Sat Feb 12 21:08:57 2022] PUT /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments/5c760504-b4a2-4f2f-99ea-5ede01f11a08 => generated 107 bytes in 748 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:08:58.745387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81978328-cd3d-49aa-a72e-d86ac7fc0c46 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:58.745841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81978328-cd3d-49aa-a72e-d86ac7fc0c46 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.746760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81978328-cd3d-49aa-a72e-d86ac7fc0c46 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:58.747090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81978328-cd3d-49aa-a72e-d86ac7fc0c46 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.794158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:58.794814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:58.810501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:58.811005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.811864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:58.812208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:58.816069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81978328-cd3d-49aa-a72e-d86ac7fc0c46 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1/detail" status: 200 len: 672 microversion: 2.36 time: 0.577304 Feb 12 21:08:58.816705 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1016/2054] 10.222.0.31 () {60 vars in 1303 bytes} [Sat Feb 12 21:08:58 2022] GET /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1/detail => generated 672 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:08:59.253738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:59.254360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:59.275781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:59.276818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:59.277070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lazy-loading 'services' on Instance uuid d29bb4ee-486f-48d1-869a-fd43a7d785c9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:08:59.280486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:59.282220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:59.651448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:08:59.659709 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bbd7f1a0-a996-4202-a5b0-5d8d0bc3d450 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments/5c760504-b4a2-4f2f-99ea-5ede01f11a08" status: 202 len: 0 microversion: 2.1 time: 0.870559 Feb 12 21:08:59.663727 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1039/2055] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:08:58 2022] DELETE /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments/5c760504-b4a2-4f2f-99ea-5ede01f11a08 => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:08:59.687167 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea43aeef-6ddf-4892-a6fc-dc1f0df6df17 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1266 microversion: 2.1 time: 0.437488 Feb 12 21:08:59.690889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1017/2056] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:08:59 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:08:59.694053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fed1cdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:08:59.697532 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:08:59.697532 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:08:59.715289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:08:59.716569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:08:59.751308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:59.761340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:59.765144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:08:59.770716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:08:59.901500 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8f247dc-361f-4c4e-81c3-ad419980e97b tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199703 Feb 12 21:08:59.904818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1018/2057] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:08:59 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:00.065531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.066687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.068113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.068958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.178783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.179500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.180484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.181219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.444536 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ff05b1f-94cf-4d70-90ab-d7440459a685 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1?user_id=e68f62be5a8b4d98b0bb392fca623a8b" status: 200 len: 240 microversion: 2.36 time: 0.778526 Feb 12 21:09:00.451040 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1040/2058] 10.222.0.31 () {62 vars in 1383 bytes} [Sat Feb 12 21:08:59 2022] PUT /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1?user_id=e68f62be5a8b4d98b0bb392fca623a8b => generated 240 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:00.462147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a9ac72b8-d6dd-4b06-8a33-366e4a341789 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] Calling method '.version_select at 0x7fa907ff9dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:00.707257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:00.710220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:00.733303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.734139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.735193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.735858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.910894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:00.928349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dbd37ce2-c9a5-4568-a7bc-7ea566affa62 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1272 microversion: 2.1 time: 0.224631 Feb 12 21:09:00.930588 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1041/2059] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:00 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:09:00.953348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:00.963553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:00.987685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.989089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:00.992561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:00.993272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:01.069265 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a9ac72b8-d6dd-4b06-8a33-366e4a341789 tempest-QuotasAdminTestV236-630321011 tempest-QuotasAdminTestV236-630321011-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1?user_id=e68f62be5a8b4d98b0bb392fca623a8b" status: 200 len: 282 microversion: 2.36 time: 0.612193 Feb 12 21:09:01.078509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1019/2060] 10.222.0.31 () {60 vars in 1363 bytes} [Sat Feb 12 21:09:00 2022] GET /compute/v2.1/os-quota-sets/efac553cd901411cb090da6863c008e1?user_id=e68f62be5a8b4d98b0bb392fca623a8b => generated 282 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:01.090349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-14502669-514b-4434-a918-0225a1684b3d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157285 Feb 12 21:09:01.094882 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1042/2061] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:09:00 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:01.950359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:01.951631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:01.959318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:01.959775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:01.960633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:01.961092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:02.076638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:02.089728 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-16a0843a-5672-4a0c-91bd-6cf5666f51c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1272 microversion: 2.1 time: 0.145384 Feb 12 21:09:02.129412 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1020/2062] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:01 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:03.111528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:03.112279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:03.142118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:03.143195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:03.154879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:03.157792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:03.397194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:03.429618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44120d1a-85ac-46ab-9284-4cb74d801b7a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1272 microversion: 2.1 time: 0.317265 Feb 12 21:09:03.444861 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1043/2063] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:03 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:04.451102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:04.451724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:04.469053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:04.469895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:04.470738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:04.471190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:05.245660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6b00f8b8-d5f8-483f-bd76-bd1ea4c1943c req-303cedb6-5779-475d-89ef-d362f3332ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "098c5b34-4f68-4c9d-a24c-092d1c4b35e9", "tag": "9e9845e9-a042-45ae-b39d-5207ad5eef75"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:05.247925 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:05.247925 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:05.271935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6b00f8b8-d5f8-483f-bd76-bd1ea4c1943c req-303cedb6-5779-475d-89ef-d362f3332ee9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:05.272606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6b00f8b8-d5f8-483f-bd76-bd1ea4c1943c req-303cedb6-5779-475d-89ef-d362f3332ee9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:05.304685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6b00f8b8-d5f8-483f-bd76-bd1ea4c1943c req-303cedb6-5779-475d-89ef-d362f3332ee9 service nova] Creating event network-changed:9e9845e9-a042-45ae-b39d-5207ad5eef75 for instance 098c5b34-4f68-4c9d-a24c-092d1c4b35e9 on nch1-master-1 Feb 12 21:09:05.314699 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6b00f8b8-d5f8-483f-bd76-bd1ea4c1943c req-303cedb6-5779-475d-89ef-d362f3332ee9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076215 Feb 12 21:09:05.316491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1044/2064] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:09:05.773876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4dda4167-6807-4a6e-8064-9e3465a82747"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:05.776404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:05.788845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:05.789312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:05.795266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:05.795972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:05.849569 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:05.849569 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:05.910310 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] HTTP exception thrown: Volume 7c5aa028-f075-4a92-862d-4a35e1b50ed0 could not be found. Feb 12 21:09:05.911226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] Returning 404 to user: Volume 7c5aa028-f075-4a92-862d-4a35e1b50ed0 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:09:05.912768 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3b6beeb-1834-4bc8-9de2-d00adf498ebb tempest-VolumesAdminNegativeTest-330712482 tempest-VolumesAdminNegativeTest-330712482-project-admin] 10.222.0.31 "PUT /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments/7c5aa028-f075-4a92-862d-4a35e1b50ed0" status: 404 len: 109 microversion: 2.1 time: 0.143180 Feb 12 21:09:05.913931 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1045/2065] 10.222.0.31 () {60 vars in 1432 bytes} [Sat Feb 12 21:09:05 2022] PUT /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9/os-volume_attachments/7c5aa028-f075-4a92-862d-4a35e1b50ed0 => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:09:06.109514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:06.132336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce1b9b11-f041-4b9e-a59f-5582d8260e65 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 1.686498 Feb 12 21:09:06.133934 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1021/2066] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:04 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:07.154078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:07.155431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:07.172770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:07.173792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:07.178024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:07.180634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:07.460992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ede53308-b77e-42eb-8cf2-541694aae1f6 req-c14e7481-ba3c-45ef-8396-aff83fe407ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:07.462826 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:07.462826 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:07.498591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ede53308-b77e-42eb-8cf2-541694aae1f6 req-c14e7481-ba3c-45ef-8396-aff83fe407ad service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:07.504975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ede53308-b77e-42eb-8cf2-541694aae1f6 req-c14e7481-ba3c-45ef-8396-aff83fe407ad service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:07.544802 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ede53308-b77e-42eb-8cf2-541694aae1f6 req-c14e7481-ba3c-45ef-8396-aff83fe407ad service nova] Creating event network-changed:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:09:07.568833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ede53308-b77e-42eb-8cf2-541694aae1f6 req-c14e7481-ba3c-45ef-8396-aff83fe407ad service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113506 Feb 12 21:09:07.569546 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1022/2067] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:09:07.928675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:07.952061 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddc86460-f7d7-45a0-b4f0-44036a2dd450 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 0.795814 Feb 12 21:09:07.953663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1046/2068] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:07 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:08.979246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:08.980734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:09.007318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:09.008178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:09.011310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:09.015997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:09.472940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:09.487407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9bcb79d-02f3-4106-9e70-aaffe7665c01 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 0.513712 Feb 12 21:09:09.505161 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1023/2069] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:08 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:10.508595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:10.510793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:10.523882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:10.537070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:10.541869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:10.545463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:11.317631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:11.335345 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e713a57a-b797-48fe-9ab6-efebd73922d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 0.831113 Feb 12 21:09:11.339211 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1047/2070] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:10 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:12.358775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:12.360479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:12.376533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:12.377443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:12.378180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:12.378649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:12.650920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:12.662072 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-276abc96-b6ec-40c7-8ff0-6ea96bde74c8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 0.310755 Feb 12 21:09:12.664477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1024/2071] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:12 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:13.504946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1945997600", "imageRef": "d428e969-3777-49d8-8596-fa1fcbba86d1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b286c5f0-5feb-4edd-8aa1-03636bfd1f8c"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:13.531201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb3da7c1-7166-474d-a7f4-247292f0d78c tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe16dca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:13.532641 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:13.532641 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:13.571793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] validate_networks() for [('b286c5f0-5feb-4edd-8aa1-03636bfd1f8c', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:09:13.605822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3da7c1-7166-474d-a7f4-247292f0d78c tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:13.606330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3da7c1-7166-474d-a7f4-247292f0d78c tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:13.607203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3da7c1-7166-474d-a7f4-247292f0d78c tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:13.607653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3da7c1-7166-474d-a7f4-247292f0d78c tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:13.716336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb3da7c1-7166-474d-a7f4-247292f0d78c tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912" status: 200 len: 148 microversion: 2.57 time: 0.276084 Feb 12 21:09:13.716972 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1025/2072] 10.222.0.31 () {62 vars in 1302 bytes} [Sat Feb 12 21:09:13 2022] PUT /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912 => generated 148 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:13.728584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:13.729971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:13.741892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:13.741892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:13.741892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:13.743128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.213304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:14.224998 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-20bfa7ad-622c-47c5-a558-f4a5b0cd5b61 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 0.501584 Feb 12 21:09:14.226617 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1026/2073] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:13 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:14.236609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48d58ec9-636e-4edc-b60e-9fd7227c3f0f tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Calling method '.version_select at 0x7fa907f82ca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:14.367113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48d58ec9-636e-4edc-b60e-9fd7227c3f0f tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.369649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48d58ec9-636e-4edc-b60e-9fd7227c3f0f tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.370835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48d58ec9-636e-4edc-b60e-9fd7227c3f0f tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.371537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48d58ec9-636e-4edc-b60e-9fd7227c3f0f tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.407840 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48d58ec9-636e-4edc-b60e-9fd7227c3f0f tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912/detail" status: 200 len: 463 microversion: 2.57 time: 0.178582 Feb 12 21:09:14.407840 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1027/2074] 10.222.0.31 () {60 vars in 1303 bytes} [Sat Feb 12 21:09:14 2022] GET /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912/detail => generated 463 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:14.569723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:09:14.570540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:09:14.571499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:09:14.571990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:09:14.572539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:09:14.584042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.589453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.589453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.589453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.619367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Getting quotas for project 2e53bfabce8d42e183bcf495f606b29f. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:14.631688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Getting quotas for user b9de8229c9f54ad18ec20ab5f29fbcf9 and project 2e53bfabce8d42e183bcf495f606b29f. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:14.679113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:09:14.679780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Action: 'update', calling method: .version_select at 0x7fa8fe16d160>, body: {"quota_set": {"ram": "2048"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:14.684667 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:14.684667 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:14.685702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d428e969-3777-49d8-8596-fa1fcbba86d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:09:14.787000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.787000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.787000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.787000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.811464 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-240bc9c3-e67d-4aff-9581-276895c05b89 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763073 Feb 12 21:09:14.812174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1048/2075] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:09:14.828486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7e68fbea-927d-45b6-b0c1-70f5ea5db3b7 req-d52c2d51-ac6a-4980-bc51-495b6ff3debe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c5b34-4f68-4c9d-a24c-092d1c4b35e9", "name": "network-vif-plugged", "status": "completed", "tag": "9e9845e9-a042-45ae-b39d-5207ad5eef75"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:14.836179 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:14.836179 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:14.849216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7e68fbea-927d-45b6-b0c1-70f5ea5db3b7 req-d52c2d51-ac6a-4980-bc51-495b6ff3debe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.850201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7e68fbea-927d-45b6-b0c1-70f5ea5db3b7 req-d52c2d51-ac6a-4980-bc51-495b6ff3debe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.872743 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7e68fbea-927d-45b6-b0c1-70f5ea5db3b7 req-d52c2d51-ac6a-4980-bc51-495b6ff3debe service nova] Creating event network-vif-plugged:9e9845e9-a042-45ae-b39d-5207ad5eef75 for instance 098c5b34-4f68-4c9d-a24c-092d1c4b35e9 on nch1-master-1 Feb 12 21:09:14.881242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7e68fbea-927d-45b6-b0c1-70f5ea5db3b7 req-d52c2d51-ac6a-4980-bc51-495b6ff3debe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063029 Feb 12 21:09:14.881531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.881967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.882698 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1049/2076] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:14.885896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:14.888419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:14.890924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-97fd76f0-fef3-4f72-bfa4-d5bc5b0cc4a8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:14.896357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-97fd76f0-fef3-4f72-bfa4-d5bc5b0cc4a8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:15.160220 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5633c55-c346-433a-97e4-597fefdeb80e tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912?user_id=08f9948c2ef54354bfea317e32a49c53" status: 200 len: 148 microversion: 2.57 time: 0.485482 Feb 12 21:09:15.167961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1028/2077] 10.222.0.31 () {62 vars in 1383 bytes} [Sat Feb 12 21:09:14 2022] PUT /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912?user_id=08f9948c2ef54354bfea317e32a49c53 => generated 148 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:15.174946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4e9dd85f-d4b2-404b-9646-337c58598ab0 tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] Calling method '.version_select at 0x7fa907ff9a60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:15.309455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-97fd76f0-fef3-4f72-bfa4-d5bc5b0cc4a8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:15.322886 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4e9dd85f-d4b2-404b-9646-337c58598ab0 tempest-QuotasAdminTestV257-1802954642 tempest-QuotasAdminTestV257-1802954642-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912?user_id=08f9948c2ef54354bfea317e32a49c53" status: 200 len: 190 microversion: 2.57 time: 0.152617 Feb 12 21:09:15.324712 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1029/2078] 10.222.0.31 () {60 vars in 1363 bytes} [Sat Feb 12 21:09:15 2022] GET /compute/v2.1/os-quota-sets/e06060cdfa8d4734a3a38faf87a39912?user_id=08f9948c2ef54354bfea317e32a49c53 => generated 190 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:15.331058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-97fd76f0-fef3-4f72-bfa4-d5bc5b0cc4a8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1222 microversion: 2.1 time: 0.444010 Feb 12 21:09:15.331058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1050/2079] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:14 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1222 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:15.345211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:15.346153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:15.355287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:15.355871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:15.356818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:15.357319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:15.693040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:15.711147 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a61c31e-db3a-412a-abf3-1477c341805b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1314 microversion: 2.1 time: 0.370382 Feb 12 21:09:15.714079 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1051/2080] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:15 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:16.347500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-46e91f65-8a4b-4dc4-8de4-527e1c68054c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:16.348274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-46e91f65-8a4b-4dc4-8de4-527e1c68054c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:16.436186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-46e91f65-8a4b-4dc4-8de4-527e1c68054c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:16.449555 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-46e91f65-8a4b-4dc4-8de4-527e1c68054c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1222 microversion: 2.1 time: 0.103454 Feb 12 21:09:16.450748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1030/2081] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:16 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:16.731871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:16.732738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:16.752018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:16.756383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:16.757086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:16.757556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:16.950473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:16.968092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-26867ab8-097d-452a-89a2-7d9c63c175d2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1463 microversion: 2.1 time: 0.240787 Feb 12 21:09:16.969091 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1052/2082] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:16 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1463 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:16.986563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:16.987484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:16.997178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:16.997938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:16.999069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:16.999753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:17.153125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a46f47d0-b2c4-422c-8eb7-d8512c90a04d req-38d35295-502f-4aa6-a785-acbbe92b0020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "name": "network-vif-plugged", "status": "completed", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:17.158287 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:17.158287 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:17.175908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a46f47d0-b2c4-422c-8eb7-d8512c90a04d req-38d35295-502f-4aa6-a785-acbbe92b0020 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:17.177003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a46f47d0-b2c4-422c-8eb7-d8512c90a04d req-38d35295-502f-4aa6-a785-acbbe92b0020 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:17.210247 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a46f47d0-b2c4-422c-8eb7-d8512c90a04d req-38d35295-502f-4aa6-a785-acbbe92b0020 service nova] Creating event network-vif-plugged:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:09:17.226829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a46f47d0-b2c4-422c-8eb7-d8512c90a04d req-38d35295-502f-4aa6-a785-acbbe92b0020 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087827 Feb 12 21:09:17.230735 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1053/2083] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:17.471177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:17.473283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:17.491254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:17.502433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2dc2c3c-5c96-4330-ac15-82132f25461b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1313 microversion: 2.1 time: 0.520668 Feb 12 21:09:17.505103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:17.507688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:17.511803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:17.514165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:17.515227 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1031/2084] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:16 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:17.599916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:17.609871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d149f28c-1fa1-49f1-bd2c-0017fc13e67f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1274 microversion: 2.1 time: 0.147406 Feb 12 21:09:17.613966 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1054/2085] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:17 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:18.530011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:18.531809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:18.550131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:18.550939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:18.552440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:18.553189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:18.815380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-660754a2-b81b-4256-994c-1bfc570e2761 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'create', calling method: .version_select at 0x7fa8fec91700>, body: {"keypair": {"name": "tempest-keypair-1829506185"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:18.835932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-660754a2-b81b-4256-994c-1bfc570e2761 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:18.844353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-660754a2-b81b-4256-994c-1bfc570e2761 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for user d856ca6f15d74ea483e6c02dee0e0dc9 and project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:19.295264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:19.311982 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-707ec565-9825-4903-876f-e8ad129303b1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1313 microversion: 2.1 time: 0.786484 Feb 12 21:09:19.325025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1032/2086] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:18 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:19.332544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-660754a2-b81b-4256-994c-1bfc570e2761 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:19.336197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:19.341519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:19.344431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-660754a2-b81b-4256-994c-1bfc570e2761 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for user d856ca6f15d74ea483e6c02dee0e0dc9 and project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:19.367294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:19.372604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-660754a2-b81b-4256-994c-1bfc570e2761 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.756782 Feb 12 21:09:19.373488 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1055/2087] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:09:18 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 758 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:09:19.374832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:19.376040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:19.377667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:19.537542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:19.553213 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-02e7e91d-0b2f-4e5d-b62a-0e660ba1336f tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1280 microversion: 2.1 time: 0.226681 Feb 12 21:09:19.554596 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1033/2088] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:19 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:20.334374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:20.343198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:20.359655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:20.360123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:20.363864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:20.364332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:20.571253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:20.573214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:20.585128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:20.586302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:20.587338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:20.588675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:20.877317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:20.894834 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2f79959a-028d-48bc-8f70-e06a81347690 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1280 microversion: 2.1 time: 0.327451 Feb 12 21:09:20.896011 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1034/2089] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:20 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:09:20.990187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:21.008430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0be2f3a4-3e4d-40a6-adff-c53d3e1a8484 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1463 microversion: 2.1 time: 0.682544 Feb 12 21:09:21.011583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1056/2090] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:20 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1463 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:21.298457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1340162663", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "fa7e1aca-9785-4119-a180-49e60318243e"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:21.439601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:09:21.912382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:21.913722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:21.931863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:21.939619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:21.941254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:21.947545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:22.354935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:22.365606 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-938d7409-f42f-4efe-9d6b-a18be607dc13 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.457078 Feb 12 21:09:22.367007 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1057/2091] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:21 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:22.797847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:09:22.799811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:09:22.799811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:09:22.800740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:09:22.801695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:09:22.820709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:22.823012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:22.851206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:22.855512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:22.936511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Getting quotas for project 517a5f8cbeba42f6841e1eccf9c2914d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:22.958192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Getting quotas for user 17359f385cb64f9fa0fb079cb3cdae54 and project 517a5f8cbeba42f6841e1eccf9c2914d. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:23.008373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:09:23.019550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:09:23.208081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2feba1c8-d4fc-4126-9b10-a113ee77d77c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913307 Feb 12 21:09:23.222883 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1035/2092] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:09:23.228829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c699ed5a-08b4-4291-ba43-805e1b495de4 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:23.262895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c699ed5a-08b4-4291-ba43-805e1b495de4 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:23.291704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4bb17ef-36a8-45dc-97df-55e4593b22d4 tempest-FloatingIPDetailsNegativeTestJSON-1863831638 tempest-FloatingIPDetailsNegativeTestJSON-1863831638-project] Calling method '.version_select at 0x7fa8fed1cc10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:23.463615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-c4bb17ef-36a8-45dc-97df-55e4593b22d4 tempest-FloatingIPDetailsNegativeTestJSON-1863831638 tempest-FloatingIPDetailsNegativeTestJSON-1863831638-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 621475d0-41df-44d9-b78e-0e8dfbf50da9 could not be found", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:09:23.464282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c4bb17ef-36a8-45dc-97df-55e4593b22d4 tempest-FloatingIPDetailsNegativeTestJSON-1863831638 tempest-FloatingIPDetailsNegativeTestJSON-1863831638-project] HTTP exception thrown: Floating IP not found for ID 621475d0-41df-44d9-b78e-0e8dfbf50da9 Feb 12 21:09:23.464977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4bb17ef-36a8-45dc-97df-55e4593b22d4 tempest-FloatingIPDetailsNegativeTestJSON-1863831638 tempest-FloatingIPDetailsNegativeTestJSON-1863831638-project] Returning 404 to user: Floating IP not found for ID 621475d0-41df-44d9-b78e-0e8dfbf50da9 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:09:23.465828 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c4bb17ef-36a8-45dc-97df-55e4593b22d4 tempest-FloatingIPDetailsNegativeTestJSON-1863831638 tempest-FloatingIPDetailsNegativeTestJSON-1863831638-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips/621475d0-41df-44d9-b78e-0e8dfbf50da9" status: 404 len: 111 microversion: 2.1 time: 0.863433 Feb 12 21:09:23.466699 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1058/2093] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:09:22 2022] GET /compute/v2.1/os-floating-ips/621475d0-41df-44d9-b78e-0e8dfbf50da9 => generated 111 bytes in 865 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:09:23.472015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:23.472934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:23.489808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:23.492305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:23.494080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:23.497870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:23.963416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c699ed5a-08b4-4291-ba43-805e1b495de4 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:23.980410 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c699ed5a-08b4-4291-ba43-805e1b495de4 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1214 microversion: 2.1 time: 0.755243 Feb 12 21:09:23.981945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1036/2094] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:23 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1214 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:24.381916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:24.407775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f644bb6e-0f8c-493d-947f-d3379949005c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.939862 Feb 12 21:09:24.415973 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1059/2095] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:23 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:25.000781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:25.002452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:25.030072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:25.032774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:25.034480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:25.035854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:25.333169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:25.357836 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4f14d336-201d-4bf5-8891-8dafe3fcb2e7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1210 microversion: 2.1 time: 0.363173 Feb 12 21:09:25.363598 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1037/2096] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:24 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1210 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:25.437397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:25.438241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:25.454589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:25.455897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:25.457280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:25.458076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:25.935366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61b15d8d-ca90-4c24-851c-917c4d7d50c5 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] Action: 'create', calling method: .version_select at 0x7fa90800cb80>, body: {"security_group": {"name": "tempest-securitygroup-465783591", "description": "tempest-description-916620192"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:26.172318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:26.199975 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-76357df6-4bf2-4143-9b8e-a6758b25585c tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.759689 Feb 12 21:09:26.206930 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1060/2097] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:25 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:26.212706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-44c93fc2-6588-4904-b7c8-84fab2f30093 req-9a5403ae-f969-4f04-92fd-dbecdf25d9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db982964-ae22-4469-9bd5-9c53a838f1cd", "tag": "8679ae2f-0c57-4f0f-ba69-4951dc1189d5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:26.232944 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:26.232944 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:26.268791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-44c93fc2-6588-4904-b7c8-84fab2f30093 req-9a5403ae-f969-4f04-92fd-dbecdf25d9e3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:26.269264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-44c93fc2-6588-4904-b7c8-84fab2f30093 req-9a5403ae-f969-4f04-92fd-dbecdf25d9e3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:26.333491 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-44c93fc2-6588-4904-b7c8-84fab2f30093 req-9a5403ae-f969-4f04-92fd-dbecdf25d9e3 service nova] Creating event network-changed:8679ae2f-0c57-4f0f-ba69-4951dc1189d5 for instance db982964-ae22-4469-9bd5-9c53a838f1cd on nch2-master-1 Feb 12 21:09:26.348241 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-44c93fc2-6588-4904-b7c8-84fab2f30093 req-9a5403ae-f969-4f04-92fd-dbecdf25d9e3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139731 Feb 12 21:09:26.348863 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1061/2098] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:26.387801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:26.388538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:26.406458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:26.407588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:26.408598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:26.409224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:26.637159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:26.659133 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-99aa78b0-54fb-428d-a9e7-c449c5e766f7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1284 microversion: 2.1 time: 0.274971 Feb 12 21:09:26.670561 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1062/2099] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:26 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:26.791975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:26.792592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:26.833697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:26.836606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:26.836606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:26.836606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:26.953412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:09:27.377514 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e224365-1331-40f3-aa9a-7944675d667d tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 204 len: 0 microversion: 2.1 time: 0.589293 Feb 12 21:09:27.381413 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1063/2100] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:09:26 2022] DELETE /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:09:27.418939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:27.434237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:27.462950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:27.463434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:27.464266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:27.482231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:28.767957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:28.784964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eaab0f01-b5bd-48c2-8f58-422d77d892af tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 1.404884 Feb 12 21:09:28.787280 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1064/2101] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:27 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:28.798091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:28.805213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:28.818038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:28.818573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:28.819696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:28.820370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:29.153958 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61b15d8d-ca90-4c24-851c-917c4d7d50c5 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 3.648113 Feb 12 21:09:29.155482 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1038/2102] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:09:25 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 3651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:09:29.167997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:29.171373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:29.207826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:29.217680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:29.219277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:29.225118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:29.419372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:29.453277 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-249480e3-2a36-4e2f-abb6-7129327930d5 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1272 microversion: 2.1 time: 0.296031 Feb 12 21:09:29.456114 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1039/2103] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:29 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:29.463322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1001685615", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4558dc02-1bc4-4b41-a16f-8a68e939fe76"}], "security_groups": [{"name": "tempest-securitygroup--2136919108"}], "key_name": "tempest-keypair-1829506185", "user_data": "}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:29.860087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:29.872114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-35f09f01-13a0-44b4-8efa-5fd6207550de tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1514 microversion: 2.1 time: 1.083334 Feb 12 21:09:29.872717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1065/2104] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:28 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1514 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:29.887187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bbe38c16-0daa-4c6c-bded-15d311ba3dd0 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] Action: 'create', calling method: .version_select at 0x7fa8feae0e50>, body: {"security_group": {"name": "tempest-securitygroup-997543206", "description": "tempest-description-597201794"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:30.047692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] validate_networks() for [('4558dc02-1bc4-4b41-a16f-8a68e939fe76', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:09:30.915535 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bbe38c16-0daa-4c6c-bded-15d311ba3dd0 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.041574 Feb 12 21:09:30.920669 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1066/2105] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:09:29 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:30.927521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:30.930658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:30.958241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:30.958719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:30.963593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:30.964165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:31.233855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:31.268085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5cfdadfa-0409-409b-af52-11352ec77aad tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.339882 Feb 12 21:09:31.268085 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1067/2106] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:30 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:31.290710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:31.291451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:31.299002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:31.299516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:31.300391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:31.300833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:31.794408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:31.803860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37b047d4-669e-4d2a-97df-5b3f6580c6c9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.526729 Feb 12 21:09:31.814295 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1068/2107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:31 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:31.827042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:31.827667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:31.847904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:31.847904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:31.848747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:31.849090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:32.257254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:32.267150 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49204c01-6445-47b9-a8ff-8a2b556720d0 tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1514 microversion: 2.1 time: 0.455831 Feb 12 21:09:32.269037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1069/2108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:31 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1514 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:32.366933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cbc817e2-0852-4ce0-bf11-41e63a73cf9f tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] Action: 'create', calling method: .version_select at 0x7fa8feadaca0>, body: {"security_group": {"name": "tempest-securitygroup-1521613614", "description": "tempest-description-333582908"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:33.254023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:09:33.254023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:09:33.254023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:09:33.254023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:09:33.254023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:09:33.272096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:33.272655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:33.273626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:33.274165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:33.318585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for project 2094e607f7bf4345beb838fc2e483911. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:33.328091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for user d856ca6f15d74ea483e6c02dee0e0dc9 and project 2094e607f7bf4345beb838fc2e483911. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:33.363670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:09:33.377476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:09:33.497881 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cbc817e2-0852-4ce0-bf11-41e63a73cf9f tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.215950 Feb 12 21:09:33.497881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1070/2109] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:09:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:33.500813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:33.520159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:33.553804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:33.554955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:33.558037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:33.569642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:33.643791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e78facf-da05-4541-847e-19c01a909014 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.185991 Feb 12 21:09:33.648742 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1040/2110] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:09:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 4192 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:09:33.668698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:33.669340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:33.697812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:33.706256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:33.710593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:33.713322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:34.542198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:34.554395 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-274b32bf-b2b0-4b20-9317-4ed34bbcdc9b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.898886 Feb 12 21:09:34.558499 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1041/2111] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:33 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:34.573808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2ad367d5-ee32-493a-89ac-13c4fac82d68 req-e5f32558-4c64-421c-b39e-98e37313a8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29bb4ee-486f-48d1-869a-fd43a7d785c9", "name": "network-vif-deleted", "tag": "c9859cfe-7f49-4ab1-b5e4-6971a2e42056"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:34.577330 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:34.577330 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:34.625296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2ad367d5-ee32-493a-89ac-13c4fac82d68 req-e5f32558-4c64-421c-b39e-98e37313a8cd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:34.631570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2ad367d5-ee32-493a-89ac-13c4fac82d68 req-e5f32558-4c64-421c-b39e-98e37313a8cd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:34.668661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2ad367d5-ee32-493a-89ac-13c4fac82d68 req-e5f32558-4c64-421c-b39e-98e37313a8cd service nova] Creating event network-vif-deleted:c9859cfe-7f49-4ab1-b5e4-6971a2e42056 for instance d29bb4ee-486f-48d1-869a-fd43a7d785c9 on nch2-master-1 Feb 12 21:09:34.681595 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2ad367d5-ee32-493a-89ac-13c4fac82d68 req-e5f32558-4c64-421c-b39e-98e37313a8cd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121056 Feb 12 21:09:34.685333 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1042/2112] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:34.694620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:34.695351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:34.707199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:34.709965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:34.711695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:34.713094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:34.781029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:34.781029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:34.782388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lazy-loading 'fault' on Instance uuid d29bb4ee-486f-48d1-869a-fd43a7d785c9 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:09:35.153146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4085900934546babc374620183b19fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64336eed36cb4beaaf10975e476440c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:35.159092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:35.186972 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-072330e9-7c83-49d0-9682-1da6921cfe4f tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 200 len: 1308 microversion: 2.1 time: 0.484752 Feb 12 21:09:35.186972 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1043/2113] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:34 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:35.186972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13f6bb2a-3104-4702-bc5e-ab80807bacdf tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] Action: 'create', calling method: .version_select at 0x7fa908042e50>, body: {"security_group": {"name": "tempest-securitygroup-647167943", "description": "tempest-description-656901167"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:35.203880 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cda634e-7fa5-4539-8b7b-40115f6eb025 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 1.709654 Feb 12 21:09:35.206143 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1071/2114] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:33 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:35.219632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f4ef5ccc-fae9-40c0-894b-bcb717ef202a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:35.221009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f4ef5ccc-fae9-40c0-894b-bcb717ef202a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:35.356349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f4ef5ccc-fae9-40c0-894b-bcb717ef202a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:35.377243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f4ef5ccc-fae9-40c0-894b-bcb717ef202a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:35.379043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f4ef5ccc-fae9-40c0-894b-bcb717ef202a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:35.380858 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f4ef5ccc-fae9-40c0-894b-bcb717ef202a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1282 microversion: 2.20 time: 0.172517 Feb 12 21:09:35.394358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1072/2115] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:35 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:35.572717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:35.578238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:35.596617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:35.597285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:35.598315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:35.601626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:35.914162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:35.922938 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-caa662e7-128c-4583-a64b-08c92d630d4d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.354392 Feb 12 21:09:35.923633 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1073/2116] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:35 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:09:36.023641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13f6bb2a-3104-4702-bc5e-ab80807bacdf tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.844459 Feb 12 21:09:36.026832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1044/2117] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:09:35 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:36.036052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ba2261e-598e-4c66-8e94-e82cb34d83b8 tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] Calling method '.version_select at 0x7fa8fec89790>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:36.200126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:36.200773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] [instance: d29bb4ee-486f-48d1-869a-fd43a7d785c9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:36.212454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:36.212948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:36.213790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:36.214415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:36.272060 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] HTTP exception thrown: Instance d29bb4ee-486f-48d1-869a-fd43a7d785c9 could not be found. Feb 12 21:09:36.272674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] Returning 404 to user: Instance d29bb4ee-486f-48d1-869a-fd43a7d785c9 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:09:36.273544 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-899e25ff-1be8-4691-9de9-100cc446125c tempest-VolumesAdminNegativeTest-855043890 tempest-VolumesAdminNegativeTest-855043890-project] 10.222.0.31 "GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9" status: 404 len: 111 microversion: 2.1 time: 0.078900 Feb 12 21:09:36.274122 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1045/2118] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:36 2022] GET /compute/v2.1/servers/d29bb4ee-486f-48d1-869a-fd43a7d785c9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:09:36.282929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:36.283549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:36.305785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:36.306238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:36.307152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:36.307596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:36.992752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:37.008759 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0872a262-c610-4c3b-9641-4f51a056fe18 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.729351 Feb 12 21:09:37.009609 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1046/2119] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:36 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:37.024797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:37.026475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:37.034040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:37.034735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:37.035794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:37.036459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:37.253400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:37.271117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:37.274216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:37.278252 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe4b47d4-5f21-4e51-82b3-50bc5f944066 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1334 microversion: 2.20 time: 0.254795 Feb 12 21:09:37.278252 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1047/2120] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:37 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1334 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:37.283974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-927815dc-97f5-4538-991e-d2eab1a8c550 req-66b5d31d-61ba-4064-8cdc-6152e337c7af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a94071-0179-4785-80d2-9c78a84887a5", "tag": "2d74542d-b56d-4ff5-a958-316b2005d4e9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:37.285822 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:37.285822 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:37.295532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-927815dc-97f5-4538-991e-d2eab1a8c550 req-66b5d31d-61ba-4064-8cdc-6152e337c7af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:37.296224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-927815dc-97f5-4538-991e-d2eab1a8c550 req-66b5d31d-61ba-4064-8cdc-6152e337c7af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:37.314057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-927815dc-97f5-4538-991e-d2eab1a8c550 req-66b5d31d-61ba-4064-8cdc-6152e337c7af service nova] Creating event network-changed:2d74542d-b56d-4ff5-a958-316b2005d4e9 for instance 44a94071-0179-4785-80d2-9c78a84887a5 on nch1-master-1 Feb 12 21:09:37.321051 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-927815dc-97f5-4538-991e-d2eab1a8c550 req-66b5d31d-61ba-4064-8cdc-6152e337c7af service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042480 Feb 12 21:09:37.325179 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1048/2121] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:37.331062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:37.332908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:37.341936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:37.342909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:37.344585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:37.345467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:37.943952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:37.955603 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc11132d-1e0f-48bb-9a09-4ce97a82f0e2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.630815 Feb 12 21:09:37.958139 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1049/2122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:37 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:38.026855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:38.029738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:38.038360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:38.039185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:38.040519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:38.041386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:38.420548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:38.475130 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fbcbd75b-97b9-40bb-a72d-6ae6711b94bc tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.452867 Feb 12 21:09:38.478237 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1050/2123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:38 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:38.490865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:38.493573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:38.507058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:38.507659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:38.509216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:38.509928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:38.623589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:38.636428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:38.638292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:38.650227 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d5d6b45-14ad-4c3e-b3dc-23472e0870fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1340 microversion: 2.20 time: 0.170068 Feb 12 21:09:38.660877 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1051/2124] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:38 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1340 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:38.976193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:38.977112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:38.988440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:38.989444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:38.990367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:38.991232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:39.255825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:39.265652 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2906074d-c92c-4d70-853f-75174c069186 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.294316 Feb 12 21:09:39.266243 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1052/2125] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:38 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:09:39.495292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:39.823134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:39.823134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:39.823134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:39.823134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:39.824218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:39.824218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:39.824218 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d25bf8a9-58b4-49ea-9eae-ef156cb2d412 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.164744 Feb 12 21:09:39.824218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1053/2126] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:39 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:39.824750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:39.824750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:39.824750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:39.824750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:39.826507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:39.826507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:39.854467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:39.890346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:39.890346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:39.890346 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-099dd86c-6460-4406-a4ef-b941bb493b3f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1340 microversion: 2.20 time: 0.190305 Feb 12 21:09:39.890897 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1054/2127] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:39 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:40.158780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-227e8d37-c1bc-411d-a427-656489dfbda8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Action: 'create', calling method: .version_select at 0x7fa907fa7af0>, body: {"keypair": {"name": "tempest-keypair-2136016200"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:40.202284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-227e8d37-c1bc-411d-a427-656489dfbda8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Getting quotas for project 992939bc41444299957b35468c7433c6. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:40.212930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-227e8d37-c1bc-411d-a427-656489dfbda8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Getting quotas for user a85ec67db2e7425ba75e7a14eaf165e9 and project 992939bc41444299957b35468c7433c6. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:40.654120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-227e8d37-c1bc-411d-a427-656489dfbda8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Getting quotas for project 992939bc41444299957b35468c7433c6. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:40.674880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-227e8d37-c1bc-411d-a427-656489dfbda8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Getting quotas for user a85ec67db2e7425ba75e7a14eaf165e9 and project 992939bc41444299957b35468c7433c6. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:40.704641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-227e8d37-c1bc-411d-a427-656489dfbda8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.42 time: 0.549532 Feb 12 21:09:40.711227 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1055/2128] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:09:40 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 557 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 12 21:09:40.718490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:40.719109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:40.735024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:40.740535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:40.740535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:40.740790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:41.098081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:41.111826 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3bc14b70-902f-411d-b02a-dfb75ca6d19d tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.399127 Feb 12 21:09:41.121884 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1056/2129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:40 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:41.125404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-0afcd6ff-9795-472b-ba31-c97ce4a7e329 req-e8e4445b-79d9-4796-bfca-047555952a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db982964-ae22-4469-9bd5-9c53a838f1cd", "name": "network-vif-plugged", "status": "completed", "tag": "8679ae2f-0c57-4f0f-ba69-4951dc1189d5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:41.132398 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:41.132398 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:41.156214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0afcd6ff-9795-472b-ba31-c97ce4a7e329 req-e8e4445b-79d9-4796-bfca-047555952a52 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:41.156214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0afcd6ff-9795-472b-ba31-c97ce4a7e329 req-e8e4445b-79d9-4796-bfca-047555952a52 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:41.187394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-0afcd6ff-9795-472b-ba31-c97ce4a7e329 req-e8e4445b-79d9-4796-bfca-047555952a52 service nova] Creating event network-vif-plugged:8679ae2f-0c57-4f0f-ba69-4951dc1189d5 for instance db982964-ae22-4469-9bd5-9c53a838f1cd on nch2-master-1 Feb 12 21:09:41.200205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-0afcd6ff-9795-472b-ba31-c97ce4a7e329 req-e8e4445b-79d9-4796-bfca-047555952a52 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084658 Feb 12 21:09:41.202068 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1057/2130] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:41.218236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:41.221292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:41.252580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:41.254094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:41.255836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:41.258288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:41.653140 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ba2261e-598e-4c66-8e94-e82cb34d83b8 tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] 10.222.0.31 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12358 microversion: 2.1 time: 5.621254 Feb 12 21:09:41.653886 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1074/2131] 10.222.0.31 () {58 vars in 1190 bytes} [Sat Feb 12 21:09:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12358 bytes in 5623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:41.665544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:41.665544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:41.667081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:41.667794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:41.668688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:41.669164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:41.728324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:41.752187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-415586b8-8a31-4fdc-9ece-7ddd6f07cae2 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.540261 Feb 12 21:09:41.755225 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1058/2132] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:41 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:41.763804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7f663a9-8800-4d83-afe8-31cba196ec18 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] Calling method '.version_select at 0x7fa907fa7700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:41.893441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:41.927953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:41.929840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:41.931682 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32a08b66-40f3-4cd6-9502-5c3e5b2fd21d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1408 microversion: 2.20 time: 0.276731 Feb 12 21:09:41.932272 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1075/2133] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:41 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:42.011908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2d58ef5c-6498-4d03-96a4-aa44815de74e req-b58b1d56-13c3-43b2-b3bb-3347656a87f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:42.026715 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:42.026715 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:42.027950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2d58ef5c-6498-4d03-96a4-aa44815de74e req-b58b1d56-13c3-43b2-b3bb-3347656a87f0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:42.028537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2d58ef5c-6498-4d03-96a4-aa44815de74e req-b58b1d56-13c3-43b2-b3bb-3347656a87f0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:42.046997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2d58ef5c-6498-4d03-96a4-aa44815de74e req-b58b1d56-13c3-43b2-b3bb-3347656a87f0 service nova] Creating event network-changed:8a6d5784-855f-4db3-a849-95606d940801 for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 on nch2-master-1 Feb 12 21:09:42.056567 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2d58ef5c-6498-4d03-96a4-aa44815de74e req-b58b1d56-13c3-43b2-b3bb-3347656a87f0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048790 Feb 12 21:09:42.065450 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1076/2134] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:42.134337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:42.135138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:42.151261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:42.152114 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7f663a9-8800-4d83-afe8-31cba196ec18 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] 10.222.0.31 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.394073 Feb 12 21:09:42.152805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:42.153223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1059/2135] 10.222.0.31 () {58 vars in 1190 bytes} [Sat Feb 12 21:09:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:42.155320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:42.160215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:42.167074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9bd21cab-b3a4-408d-9400-8a930810a800 tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] Calling method '.version_select at 0x7fa907fcd1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:42.469808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:42.479017 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-adb9ef75-d4b4-4677-b61e-a9d81d4497f8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.350148 Feb 12 21:09:42.481834 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1077/2136] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:42 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:42.775098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:42.778567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:42.791091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:42.792340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:42.793782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:42.799720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:43.049325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9bd21cab-b3a4-408d-9400-8a930810a800 tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/01b1d313-909d-4f5f-a20a-bd6522446253" status: 202 len: 0 microversion: 2.1 time: 0.887712 Feb 12 21:09:43.050122 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1060/2137] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:09:42 2022] DELETE /compute/v2.1/os-security-groups/01b1d313-909d-4f5f-a20a-bd6522446253 => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:09:43.058016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:43.059049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:43.061622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:43.079349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7b462da-1064-49a4-a172-734e72fff462 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1322 microversion: 2.1 time: 0.306271 Feb 12 21:09:43.085044 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1078/2138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:42 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:43.092847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:43.093640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:43.094931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0376b419-a32f-465a-bbac-a72090a0cc06 tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] Calling method '.version_select at 0x7fa8fecf0280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:43.106294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:43.107059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:43.400413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:43.416887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:43.419075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:43.423213 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d47994c9-491b-489e-ad3e-6830805b905e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1408 microversion: 2.20 time: 0.370254 Feb 12 21:09:43.428484 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1061/2139] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:43 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:43.498292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:43.498831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:43.505773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:43.506815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:43.507855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:43.509073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:43.657017 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0376b419-a32f-465a-bbac-a72090a0cc06 tempest-SecurityGroupsTestAdminJSON-766165631 tempest-SecurityGroupsTestAdminJSON-766165631-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/c8e28e3d-bb56-4d34-b5be-e843386be6ea" status: 202 len: 0 microversion: 2.1 time: 0.570573 Feb 12 21:09:43.661537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1079/2140] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:09:43 2022] DELETE /compute/v2.1/os-security-groups/c8e28e3d-bb56-4d34-b5be-e843386be6ea => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:09:43.669130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2213d3f-3387-48e5-9f70-f40ceb7901ea tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] Calling method '.version_select at 0x7fa8fed85c10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:43.819073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:43.829152 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8b84b41d-d03f-4d28-aae2-0d63c930f4ac tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.334597 Feb 12 21:09:43.830124 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1062/2141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:43 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:44.102537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:44.104000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:44.110695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.111765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:44.112787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.113420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:44.290772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:44.301408 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-016bf53f-89bd-4825-9e89-9b4cf30caf37 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1509 microversion: 2.1 time: 0.203624 Feb 12 21:09:44.305892 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1063/2142] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:44 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:44.314834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-503e5628-2585-49b4-b693-bb8275f16427 req-8dca9df9-9ac5-4542-9b67-9ee69869eaac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a94071-0179-4785-80d2-9c78a84887a5", "name": "network-vif-plugged", "status": "completed", "tag": "2d74542d-b56d-4ff5-a958-316b2005d4e9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:44.316880 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:44.316880 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:09:44.332472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-503e5628-2585-49b4-b693-bb8275f16427 req-8dca9df9-9ac5-4542-9b67-9ee69869eaac service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.332914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-503e5628-2585-49b4-b693-bb8275f16427 req-8dca9df9-9ac5-4542-9b67-9ee69869eaac service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:44.359315 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-503e5628-2585-49b4-b693-bb8275f16427 req-8dca9df9-9ac5-4542-9b67-9ee69869eaac service nova] Creating event network-vif-plugged:2d74542d-b56d-4ff5-a958-316b2005d4e9 for instance 44a94071-0179-4785-80d2-9c78a84887a5 on nch1-master-1 Feb 12 21:09:44.395322 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-503e5628-2585-49b4-b693-bb8275f16427 req-8dca9df9-9ac5-4542-9b67-9ee69869eaac service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068639 Feb 12 21:09:44.398936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1064/2143] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:44.448416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:44.449124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:44.466591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.479562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:44.479562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.479562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:44.598379 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2213d3f-3387-48e5-9f70-f40ceb7901ea tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/c87c3a33-0ca1-4e32-acb8-02213e557b7c" status: 202 len: 0 microversion: 2.1 time: 0.935346 Feb 12 21:09:44.600130 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1080/2144] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:09:43 2022] DELETE /compute/v2.1/os-security-groups/c87c3a33-0ca1-4e32-acb8-02213e557b7c => generated 0 bytes in 938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:09:44.612522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-57a42de1-51bb-4d6b-9fc8-462a71398742 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] Calling method '.version_select at 0x7fa904073550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:44.648159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:44.660922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:44.663208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:44.664899 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dee5080e-1f7c-40ff-84f8-3777e516d3ba tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1408 microversion: 2.20 time: 0.223090 Feb 12 21:09:44.676804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1065/2145] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:44 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:44.855437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:44.856263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:44.867980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.868448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:44.869284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:44.869776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:45.032160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:45.039995 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6c7e11b0-7309-43ab-b246-21c95ac0738f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.189903 Feb 12 21:09:45.051115 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1066/2146] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:44 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:45.157319 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-57a42de1-51bb-4d6b-9fc8-462a71398742 tempest-SecurityGroupsTestAdminJSON-960827514 tempest-SecurityGroupsTestAdminJSON-960827514-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/1a95f269-d2c6-4e34-9ace-076898740c51" status: 202 len: 0 microversion: 2.1 time: 0.551248 Feb 12 21:09:45.158113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1081/2147] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:09:44 2022] DELETE /compute/v2.1/os-security-groups/1a95f269-d2c6-4e34-9ace-076898740c51 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:09:45.516394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-869658695", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f6b71adf-3656-401b-8bec-3091ef8cf8c7"}, {"port": "f960d66a-27d4-45da-ab76-16c8e9d8d0db", "tag": "port-1"}, {"port": "1fe06461-27fb-4282-97ba-13fca702a547", "tag": "port-2"}, {"uuid": "531eb872-2139-4490-9c0c-9bd28b6649a5", "tag": "net-1"}, {"uuid": "531eb872-2139-4490-9c0c-9bd28b6649a5"}, {"uuid": "a90998ba-17e7-4116-bb0e-3bd9e0e31276", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a90998ba-17e7-4116-bb0e-3bd9e0e31276", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7c79dff3-d53d-4ae9-a438-23dc0e39df0e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e81831ca-45fb-4913-9901-1313416408ea", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6fe52308-5497-4bfa-92db-ef7959731976", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--483731441"}], "key_name": "tempest-keypair-2136016200", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:45.685778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:45.686500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:45.694614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:45.697617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:45.700493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:45.701142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:45.730296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] validate_networks() for [('f6b71adf-3656-401b-8bec-3091ef8cf8c7', None, None, None, None, None), (None, None, 'f960d66a-27d4-45da-ab76-16c8e9d8d0db', None, None, None), (None, None, '1fe06461-27fb-4282-97ba-13fca702a547', None, None, None), ('531eb872-2139-4490-9c0c-9bd28b6649a5', None, None, None, None, None), ('531eb872-2139-4490-9c0c-9bd28b6649a5', None, None, None, None, None), ('a90998ba-17e7-4116-bb0e-3bd9e0e31276', '10.2.2.100', None, None, None, None), ('a90998ba-17e7-4116-bb0e-3bd9e0e31276', '10.2.2.200', None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:09:45.896933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:45.908581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:45.925865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:45.925865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-33d4fb93-920f-4c1f-a7a2-24296c1b2ee2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1408 microversion: 2.20 time: 0.231759 Feb 12 21:09:45.925865 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1082/2148] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:45 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:09:46.056902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:46.058140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:46.065477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:46.066193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:46.075079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:46.075079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:46.354545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:46.379466 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9eac89db-11b5-4b62-ae34-7a599ba93ce9 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1314 microversion: 2.1 time: 0.326952 Feb 12 21:09:46.380800 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1083/2149] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:46 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:09:46.931832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:46.933192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:46.941093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:46.941603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:46.942399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:46.942837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:47.191796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:47.201583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:47.203356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:47.204870 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c608cff7-26c5-4686-add4-23dfc1b9ae1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1408 microversion: 2.20 time: 0.278152 Feb 12 21:09:47.205849 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1084/2150] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:46 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:09:47.330526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2789c10f-d610-41fd-9381-586bf22c0162"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:47.331431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:47.339697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:47.340388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:47.341391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:47.342002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:48.320200 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4bca6e25-2cd5-4df1-920a-7aee6d894ee3 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "POST /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.993088 Feb 12 21:09:48.321587 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1085/2151] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:09:47 2022] POST /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:09:48.328561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:48.329702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:48.342753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:48.342753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:48.342753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:48.342753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:48.800896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:48.808936 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62324978-0c93-48cf-abc9-8212797ed1f2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1464 microversion: 2.1 time: 0.485903 Feb 12 21:09:48.811009 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1086/2152] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:48 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1464 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:48.818280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3dff8cf4-a60a-4678-a149-387d9d0b0295 req-87c4cb9c-d059-46d8-8337-536d22799365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "name": "network-vif-plugged", "status": "completed", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:48.824070 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:48.824070 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:48.843741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3dff8cf4-a60a-4678-a149-387d9d0b0295 req-87c4cb9c-d059-46d8-8337-536d22799365 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:48.844294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3dff8cf4-a60a-4678-a149-387d9d0b0295 req-87c4cb9c-d059-46d8-8337-536d22799365 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:48.863361 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3dff8cf4-a60a-4678-a149-387d9d0b0295 req-87c4cb9c-d059-46d8-8337-536d22799365 service nova] Creating event network-vif-plugged:8a6d5784-855f-4db3-a849-95606d940801 for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 on nch2-master-1 Feb 12 21:09:48.881042 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3dff8cf4-a60a-4678-a149-387d9d0b0295 req-87c4cb9c-d059-46d8-8337-536d22799365 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067285 Feb 12 21:09:48.882552 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1087/2153] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:48.890955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:48.892736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:48.905008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:48.911315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:48.911315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:48.911315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:49.281588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:49.290142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:49.291666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:49.297299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37356e79-d1c7-48d1-93a9-7f23b61f1075 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1408 microversion: 2.20 time: 0.412877 Feb 12 21:09:49.315523 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1088/2154] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:48 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:49.800720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:49.810363 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:49.810363 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:49.810363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'deleted': False, 'project_id': 'e25f9de4fbe347a7b56e4734fa27740c'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:49.826588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:49.833024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:49.833024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:49.834475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:50.062225 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5e4bcc1-ae08-4a1c-b411-49e621f797c3 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.745306 Feb 12 21:09:50.074341 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1089/2155] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:09:49 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:50.162123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee053ae6-cbc2-42f0-a16a-ab79b5be966c tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:50.173885 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee053ae6-cbc2-42f0-a16a-ab79b5be966c tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.098064 Feb 12 21:09:50.175405 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1090/2156] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:50.189928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:50.195129 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:50.195129 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:50.196971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'deleted': False} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:50.202467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:50.207101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:50.222765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:50.223469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:50.402698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:09:50.601140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:50.601669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:51.025318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:09:51.026053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:09:51.026329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:09:51.026757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:09:51.027172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:09:51.043203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:51.043586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:51.044407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:51.050159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:51.078501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Getting quotas for project 992939bc41444299957b35468c7433c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:09:51.087796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Getting quotas for user a85ec67db2e7425ba75e7a14eaf165e9 and project 992939bc41444299957b35468c7433c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:09:51.413756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:09:51.418449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7c79dff3-d53d-4ae9-a438-23dc0e39df0e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e81831ca-45fb-4913-9901-1313416408ea',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6fe52308-5497-4bfa-92db-ef7959731976',volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:09:51.674802 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3af71e39-2457-4926-b6e4-47175578da90 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 9774 microversion: 2.1 time: 1.490000 Feb 12 21:09:51.682975 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1091/2157] 10.222.0.31 () {58 vars in 1170 bytes} [Sat Feb 12 21:09:50 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 9774 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:51.682975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ab25bd1-f437-41ea-b5e6-3e5ad3a14d30 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:51.710468 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ab25bd1-f437-41ea-b5e6-3e5ad3a14d30 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.033255 Feb 12 21:09:51.711877 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1092/2158] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:09:51 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:51.718950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:51.719982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:51.727854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:51.728710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:51.730005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:51.730725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.399778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:52.425462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:52.427454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:52.433178 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a0b98c54-0480-4c37-a80a-496b09db25af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1600 microversion: 2.20 time: 0.715845 Feb 12 21:09:52.433178 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1093/2159] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:51 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1600 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:52.438720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:52.443782 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:52.443782 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:52.446160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'deleted': False, 'project_id': 'e25f9de4fbe347a7b56e4734fa27740c'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:52.453082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:52.456044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.457015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:52.457774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.497331 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b87ed1e8-71d0-48da-8d90-d93dd8af13c9 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/detail?tenant_id=517a5f8cbeba42f6841e1eccf9c2914d" status: 200 len: 15 microversion: 2.1 time: 0.064686 Feb 12 21:09:52.498613 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1094/2160] 10.222.0.31 () {58 vars in 1230 bytes} [Sat Feb 12 21:09:52 2022] GET /compute/v2.1/servers/detail?tenant_id=517a5f8cbeba42f6841e1eccf9c2914d => generated 15 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:52.503705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e040a4e6-e3d7-4b63-9843-7ad1804dea14 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:52.513288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e040a4e6-e3d7-4b63-9843-7ad1804dea14 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013470 Feb 12 21:09:52.514461 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1095/2161] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:52.536602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:52.537103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:52.557208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:52.557773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.558591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:52.559025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.741141 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d285367-6d6b-43b3-9906-e74c0cfc3cf9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.225639 Feb 12 21:09:52.744793 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1096/2162] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 21:09:52 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:52.749840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:52.764149 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:52.764149 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:52.768423 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:52.768423 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:52.772340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'tenant_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'deleted': False} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:52.789314 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23a4510b-d518-4552-b524-623bff0830c7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 7.276620 Feb 12 21:09:52.794778 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1067/2163] 10.222.0.31 () {62 vars in 1188 bytes} [Sat Feb 12 21:09:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 7283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:09:52.810128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:52.810647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-329d65c8-31a6-4393-95c1-07ce72360f08 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:52.815622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.818842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:52.822976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:52.838753 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-329d65c8-31a6-4393-95c1-07ce72360f08 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042019 Feb 12 21:09:52.843337 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1068/2164] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:52.851679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-56eec42c-5765-4ef2-a042-7bb744d00e30 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:52.855507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-56eec42c-5765-4ef2-a042-7bb744d00e30 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:52.901006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:09:53.050450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.050917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.146490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-56eec42c-5765-4ef2-a042-7bb744d00e30 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:53.172332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-56eec42c-5765-4ef2-a042-7bb744d00e30 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:53.175558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-56eec42c-5765-4ef2-a042-7bb744d00e30 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:53.189687 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-56eec42c-5765-4ef2-a042-7bb744d00e30 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1285 microversion: 2.42 time: 0.335062 Feb 12 21:09:53.191187 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1069/2165] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:52 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:53.199884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ca3e1a2a-30e5-4236-9ed9-533eb74866bd tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.278951 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ca3e1a2a-30e5-4236-9ed9-533eb74866bd tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.085406 Feb 12 21:09:53.279624 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1070/2166] 10.222.0.31 () {58 vars in 1164 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:53.296222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.297266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:53.310735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.311409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.314124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.314576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.355141 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7e7aaf0-c5fe-4149-ba16-1368f5b8337a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073916 Feb 12 21:09:53.355727 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1071/2167] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:53.360348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6dc3895e-d41b-41d0-8aa7-8edd0ad2f7de tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.369338 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6dc3895e-d41b-41d0-8aa7-8edd0ad2f7de tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012325 Feb 12 21:09:53.370274 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1072/2168] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:53.375558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.376288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:53.383840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.384935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.385995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.386723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.403288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9a863f0-cf5f-4c0b-aa06-9453b7772739 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=517a5f8cbeba42f6841e1eccf9c2914d" status: 200 len: 4826 microversion: 2.1 time: 0.657087 Feb 12 21:09:53.404524 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1097/2169] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 21:09:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=517a5f8cbeba42f6841e1eccf9c2914d => generated 4826 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:53.410008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4183385a-93c8-4c85-b425-00a67288932d tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.482440 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4183385a-93c8-4c85-b425-00a67288932d tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.076277 Feb 12 21:09:53.483684 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1098/2170] 10.222.0.31 () {58 vars in 1168 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:53.488772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.495092 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:53.495092 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:53.499552 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:53.499552 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:53.501336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'tenant_id': 'e25f9de4fbe347a7b56e4734fa27740c', 'deleted': False} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:53.520450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lazy-loading 'services' on Instance uuid db982964-ae22-4469-9bd5-9c53a838f1cd {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:09:53.524835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.525656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.526755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.527422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.566393 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a6518f58-0060-4196-9921-6e7312f09af2 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e25f9de4fbe347a7b56e4734fa27740c" status: 200 len: 15 microversion: 2.1 time: 0.081336 Feb 12 21:09:53.567416 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1099/2171] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e25f9de4fbe347a7b56e4734fa27740c => generated 15 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:53.573287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b8164a98-34c9-410f-b430-d12f3fa66e92 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.585972 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b8164a98-34c9-410f-b430-d12f3fa66e92 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017063 Feb 12 21:09:53.587206 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1100/2172] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:53.592343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bddb2787-0494-43b9-b1f6-1ddf26e33323 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.596427 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:53.596427 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:53.598333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bddb2787-0494-43b9-b1f6-1ddf26e33323 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009842 Feb 12 21:09:53.599600 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1101/2173] 10.222.0.31 () {58 vars in 1188 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:53.612513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d576539d-80c6-465e-943c-1d9fe4d773ee tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.630035 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d576539d-80c6-465e-943c-1d9fe4d773ee tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023560 Feb 12 21:09:53.630900 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1102/2174] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:53.641507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:53.642779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:53.650826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.652039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.652199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:53.653551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:53.811082 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-913c3158-c031-4e63-8b15-f32a450fd43e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "DELETE /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments/2789c10f-d610-41fd-9381-586bf22c0162" status: 202 len: 0 microversion: 2.1 time: 0.439352 Feb 12 21:09:53.811680 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1073/2175] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:09:53 2022] DELETE /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments/2789c10f-d610-41fd-9381-586bf22c0162 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:09:53.836501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-050bd726-45d3-41d4-8b1c-317e752e17d1 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.959150 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-050bd726-45d3-41d4-8b1c-317e752e17d1 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.145985 Feb 12 21:09:53.969607 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1074/2176] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:53.981389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0da225fe-72c0-4ff6-a0f3-29187973db45 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:53.990329 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0da225fe-72c0-4ff6-a0f3-29187973db45 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013020 Feb 12 21:09:53.996828 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1075/2177] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:09:54.009728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a00b5d96-8189-4757-af1f-4a7e310c05a5 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.045292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a00b5d96-8189-4757-af1f-4a7e310c05a5 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.047207 Feb 12 21:09:54.057878 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1076/2178] 10.222.0.31 () {58 vars in 1143 bytes} [Sat Feb 12 21:09:53 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:54.065550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26bcbe06-bded-403d-9bf9-3cfa53d5b5ac tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.090615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-26bcbe06-bded-403d-9bf9-3cfa53d5b5ac tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030588 Feb 12 21:09:54.092036 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1077/2179] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:54.128741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cace1217-7737-4122-b198-32e3906fc901 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.141950 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-549ec085-e414-4ded-9a08-61a45667d326 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 0 microversion: 2.1 time: 0.506838 Feb 12 21:09:54.148920 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1103/2180] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:09:53 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:09:54.157067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.181867 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:54.181867 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:54.184109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:54.187995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:54.224415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:54.251670 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cace1217-7737-4122-b198-32e3906fc901 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.135918 Feb 12 21:09:54.252359 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1078/2181] 10.222.0.31 () {58 vars in 1147 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:54.265701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-49b24c1a-4a7d-4604-9a94-11c3ef50adcd tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.266648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-49b24c1a-4a7d-4604-9a94-11c3ef50adcd tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:54.268469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:54.272401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:54.282333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:54.440413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:09:54.463842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-49b24c1a-4a7d-4604-9a94-11c3ef50adcd tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:54.471469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-49b24c1a-4a7d-4604-9a94-11c3ef50adcd tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:54.480033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-49b24c1a-4a7d-4604-9a94-11c3ef50adcd tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:54.481573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-49b24c1a-4a7d-4604-9a94-11c3ef50adcd tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1285 microversion: 2.42 time: 0.225754 Feb 12 21:09:54.493385 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1079/2182] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:54.498348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f5a0cb29-5194-42b1-b5a1-f81396844d90 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.510691 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f5a0cb29-5194-42b1-b5a1-f81396844d90 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.015795 Feb 12 21:09:54.512035 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1080/2183] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:54.526194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf28377a-d86a-4ce5-a353-c9672b30d574 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.540306 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf28377a-d86a-4ce5-a353-c9672b30d574 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018732 Feb 12 21:09:54.543105 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1081/2184] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:09:54.554039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb9a0a19-89d1-47c8-824e-31557289882b tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.589527 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb9a0a19-89d1-47c8-824e-31557289882b tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.035790 Feb 12 21:09:54.593997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-75d34207-8ecd-48c9-aaa6-6e16b83f3071 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.443203 Feb 12 21:09:54.600512 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1104/2185] 10.222.0.31 () {58 vars in 1149 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:54.602809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1082/2186] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:09:54.609088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-402af30f-6444-49f4-88ba-9d00dd743504 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.615794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:54.626490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:54.636276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:54.637647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:54.638742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:54.643820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:54.658987 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-402af30f-6444-49f4-88ba-9d00dd743504 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050630 Feb 12 21:09:54.658987 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1105/2187] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:54.671383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be60a3a3-f062-4f98-a9af-4eb3fcf55b57 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:54.692372 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be60a3a3-f062-4f98-a9af-4eb3fcf55b57 tempest-FlavorsV2TestJSON-1748999636 tempest-FlavorsV2TestJSON-1748999636-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024908 Feb 12 21:09:54.718573 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1106/2188] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:55.039091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:55.051127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:55.067033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.067628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.069973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.072327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.171374 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b42bca45-96af-4e26-8ad7-bba0c59602be tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 0 microversion: 2.1 time: 0.562219 Feb 12 21:09:55.174837 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1083/2189] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:09:54 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:09:55.188497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:55.188896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:55.215331 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-007e30a7-f53b-4d3a-b07f-6500d8292255 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181142 Feb 12 21:09:55.217827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.219357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.220213 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1107/2190] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:09:55 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:55.225823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.227265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.350019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:55.351165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:55.362931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.370116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.371307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.371679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.498955 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8787f7c2-bc65-493a-b2c2-614ac93df6e0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153323 Feb 12 21:09:55.504443 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1108/2191] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:09:55 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:09:55.525697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:55.526619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:55.536360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.537140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.541619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.541619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.804866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:55.818778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:55.821260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:55.826845 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52e4482a-f8eb-4bc0-8a3b-4c05deff1570 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1519 microversion: 2.42 time: 0.319054 Feb 12 21:09:55.829049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1109/2192] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:55 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:55.847146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:55.859257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:55.886823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.891966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.893754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.896711 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2b421f0-28f9-4066-982a-26814505fc48 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1614 microversion: 2.1 time: 0.719674 Feb 12 21:09:55.900136 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1084/2193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:55 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1614 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:55.902274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.916714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:55.918960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:55.949712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.956283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.956283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:55.956283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:55.985877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:09:56.400799 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd6a7ecf-7ace-4ee9-8735-11aea97303a7 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1614 microversion: 2.1 time: 0.490140 Feb 12 21:09:56.401437 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1085/2194] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:55 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1614 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:56.451742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b110b18-35c2-4517-a71b-4e8f1519c985 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "DELETE /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 204 len: 0 microversion: 2.1 time: 0.611960 Feb 12 21:09:56.452435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1110/2195] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:09:55 2022] DELETE /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:09:56.458924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:56.460044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:56.478907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:56.479471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:56.486700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:56.487156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:56.553679 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9699d485-a878-4a1e-87ff-5cb902f9e4eb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/ips" status: 200 len: 112 microversion: 2.20 time: 0.098649 Feb 12 21:09:56.554298 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1111/2196] 10.222.0.31 () {60 vars in 1288 bytes} [Sat Feb 12 21:09:56 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/ips => generated 112 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:09:56.565284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9758eeea-4ab3-4047-9bd4-9b33e13b391b req-2a6220bf-ddd5-4c50-9ce1-d5d7b745f129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:56.568776 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:56.568776 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:56.596053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9758eeea-4ab3-4047-9bd4-9b33e13b391b req-2a6220bf-ddd5-4c50-9ce1-d5d7b745f129 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:56.596506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9758eeea-4ab3-4047-9bd4-9b33e13b391b req-2a6220bf-ddd5-4c50-9ce1-d5d7b745f129 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:56.624480 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9758eeea-4ab3-4047-9bd4-9b33e13b391b req-2a6220bf-ddd5-4c50-9ce1-d5d7b745f129 service nova] Creating event network-changed:8a6d5784-855f-4db3-a849-95606d940801 for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 on nch2-master-1 Feb 12 21:09:56.632104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9758eeea-4ab3-4047-9bd4-9b33e13b391b req-2a6220bf-ddd5-4c50-9ce1-d5d7b745f129 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074814 Feb 12 21:09:56.636460 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1112/2197] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:09:56.651083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:56.656446 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:56.656446 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:56.660965 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:56.660965 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:56.664035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:56.681674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:56.683088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:56.686241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:56.686935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:56.836194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9309ad6-786d-4865-84cb-89381117fd88 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Action: 'create', calling method: .version_select at 0x7fa907fe2430>, body: {"pool": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:56.994522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:09:57.178310 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b82d3247-7861-45a5-a8ba-5ebcca8e6dd0 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1639 microversion: 2.1 time: 0.540502 Feb 12 21:09:57.180465 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1113/2198] 10.222.0.31 () {58 vars in 1189 bytes} [Sat Feb 12 21:09:56 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1639 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:57.202611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:57.229272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:57.261139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:57.261656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:57.262495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:57.266723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:58.753832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:58.768162 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a2ebb80-2e2e-4d54-94cb-7799189d140e tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1515 microversion: 2.1 time: 1.586272 Feb 12 21:09:58.772952 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1114/2199] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:09:57 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1515 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:09:58.799444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:58.801175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:58.821000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:58.821796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:58.822953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:58.823591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:59.182013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:59.200110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:59.202413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:09:59.204920 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cac8162e-1de6-4a2e-98e7-54d7689511ca tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1593 microversion: 2.42 time: 0.428081 Feb 12 21:09:59.206200 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1115/2200] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:09:58 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1593 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:09:59.219051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:09:59.222865 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:59.222865 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:59.226221 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:09:59.226221 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:09:59.230018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:09:59.239260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:59.239260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:59.240775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:59.242104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:59.284889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f98a6ac4-e7a7-4e35-88ec-cef0e0fff308 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.075478 Feb 12 21:09:59.314468 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1116/2201] 10.222.0.31 () {58 vars in 1195 bytes} [Sat Feb 12 21:09:59 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:09:59.327825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:09:59.330693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:09:59.340640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:59.341426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:59.342410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:09:59.343070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:09:59.782445 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6811244-002a-4a40-85c3-fce09f9783c6 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 0 microversion: 2.1 time: 0.465890 Feb 12 21:09:59.783385 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1117/2202] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:09:59 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:10:00.048159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-53111548-fa54-4a60-99df-61251af40d84 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:00.069727 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-53111548-fa54-4a60-99df-61251af40d84 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.283665 Feb 12 21:10:00.071713 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1118/2203] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:09:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:00.082503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:00.083380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:00.122833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:00.125277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:00.125277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:00.125277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:00.556163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:00.573823 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e1e8b2e-f781-4df9-bc90-c6b4454dc86b tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1515 microversion: 2.1 time: 0.498038 Feb 12 21:10:00.575735 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1119/2204] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:00 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1515 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:00.588508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:00.593882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:00.607208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:00.607668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:00.608489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:00.608926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:00.787533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:10:00.788460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:10:00.789969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:10:00.790407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:10:00.790828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:10:01.100434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:01.130451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:01.136378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:01.145383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:01.146942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:01.210419 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-59ab0435-e562-47fc-a7ce-64b2aa4ad6fe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 1067 microversion: 2.1 time: 0.631747 Feb 12 21:10:01.224701 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1120/2205] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:10:00 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 1067 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 12 21:10:01.302465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:01.306144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:01.358995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:01.359479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:01.360310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:01.363159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.095365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:02.112203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:02.121305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:02.126231 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27b3e8e8-7bde-4645-9d5f-7e8d511b0f33 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1660 microversion: 2.42 time: 0.867528 Feb 12 21:10:02.127095 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1121/2206] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:01 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1660 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:02.156222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:02.157248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:02.176101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:02.177281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.180893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:02.181984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.570571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:02.580365 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5de1f56a-4f4f-403f-ada2-a9cfb8e89911 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.452132 Feb 12 21:10:02.581026 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1122/2207] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:02 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:02.593460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:02.594191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:02.618143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:02.618143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.618143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:02.618143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.684892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:02.685191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.685706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lazy-loading 'fault' on Instance uuid db982964-ae22-4469-9bd5-9c53a838f1cd {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:10:02.772709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9de8229c9f54ad18ec20ab5f29fbcf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e53bfabce8d42e183bcf495f606b29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:02.787570 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-520345e3-09de-44b9-bdd3-de1724997ae8 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 200 len: 1308 microversion: 2.1 time: 0.205153 Feb 12 21:10:02.788189 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1123/2208] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:02 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:02.801543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d60895a1-818e-4641-8ab3-a67b130fe339 req-adaccc33-229d-4e53-a786-c3740d49392c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db982964-ae22-4469-9bd5-9c53a838f1cd", "name": "network-vif-deleted", "tag": "8679ae2f-0c57-4f0f-ba69-4951dc1189d5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:02.803426 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:02.803426 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:02.817389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d60895a1-818e-4641-8ab3-a67b130fe339 req-adaccc33-229d-4e53-a786-c3740d49392c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:02.817389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d60895a1-818e-4641-8ab3-a67b130fe339 req-adaccc33-229d-4e53-a786-c3740d49392c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:02.851853 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d60895a1-818e-4641-8ab3-a67b130fe339 req-adaccc33-229d-4e53-a786-c3740d49392c service nova] Creating event network-vif-deleted:8679ae2f-0c57-4f0f-ba69-4951dc1189d5 for instance db982964-ae22-4469-9bd5-9c53a838f1cd on nch2-master-1 Feb 12 21:10:02.854245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d60895a1-818e-4641-8ab3-a67b130fe339 req-adaccc33-229d-4e53-a786-c3740d49392c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064592 Feb 12 21:10:02.860478 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1124/2209] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:02.866874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93b319a5-4387-4ab1-8121-d4c6333a9864 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-992104434", "imageRef": "c12e1e68-f980-4709-aa0a-5ef1231752c0", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:02.965037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-93b319a5-4387-4ab1-8121-d4c6333a9864 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:10:03.108823 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9309ad6-786d-4865-84cb-89381117fd88 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.705977 Feb 12 21:10:03.111216 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1086/2210] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:09:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:03.131504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae01f8f2-aa0d-4584-b33a-540223a6d6da tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Calling method '.version_select at 0x7fa90806f9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:03.455502 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae01f8f2-aa0d-4584-b33a-540223a6d6da tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips/d546106e-228e-430d-9e15-cb6d4bc0e4b6" status: 200 len: 142 microversion: 2.1 time: 0.334412 Feb 12 21:10:03.456595 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1087/2211] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:10:03 2022] GET /compute/v2.1/os-floating-ips/d546106e-228e-430d-9e15-cb6d4bc0e4b6 => generated 142 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:10:03.462472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:03.463301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:03.476940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:03.478205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:03.479239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:03.479883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:03.756380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:03.769754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:03.772318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:03.775212 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e47b358d-b054-441b-a0da-8810f4509d70 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1706 microversion: 2.42 time: 0.315940 Feb 12 21:10:03.776396 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1088/2212] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:03 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1706 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:03.781546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b793faa0-f9b7-4439-a88a-e60d9fc44a64 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Calling method '.version_select at 0x7fa907fb2a60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:03.810396 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-93b319a5-4387-4ab1-8121-d4c6333a9864 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] HTTP exception thrown: Flavor's memory is too small for requested image. Feb 12 21:10:03.810987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93b319a5-4387-4ab1-8121-d4c6333a9864 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:10:03.811826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93b319a5-4387-4ab1-8121-d4c6333a9864 tempest-FlavorsV2NegativeTest-1007725414 tempest-FlavorsV2NegativeTest-1007725414-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.950186 Feb 12 21:10:03.812726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1125/2213] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:10:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 952 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:10:03.824990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:03.824990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:03.833759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:03.834627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:03.837044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:03.837617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:04.192867 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b793faa0-f9b7-4439-a88a-e60d9fc44a64 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.414929 Feb 12 21:10:04.197667 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1089/2214] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:10:03 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:04.205265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:04.206108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:04.256341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:04.259582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:04.265799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:04.266910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:04.296137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] HTTP exception thrown: Instance db982964-ae22-4469-9bd5-9c53a838f1cd could not be found. Feb 12 21:10:04.297170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Returning 404 to user: Instance db982964-ae22-4469-9bd5-9c53a838f1cd could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:10:04.298399 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a52c61ea-c89b-41d4-ab51-2987b503e66a tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 404 len: 111 microversion: 2.1 time: 0.097900 Feb 12 21:10:04.299489 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1090/2215] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:04 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:10:04.323988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f10de7d2-2cb4-4f7c-8de1-99b081d66eb9 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Calling method '.version_select at 0x7fa908045940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:04.519165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:04.532066 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b40b895-aca0-4108-a7e2-25dc5616332a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.717461 Feb 12 21:10:04.533257 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1126/2216] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:03 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:04.800350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:04.801652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:04.813016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:04.814544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:04.816519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:04.817241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:05.493465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:05.509533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:05.518424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:05.527323 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c611d23c-2b74-48e3-bde1-806edf6136e9 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1752 microversion: 2.42 time: 0.736785 Feb 12 21:10:05.528415 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1127/2217] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:04 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1752 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:05.558947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:05.558947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:05.574107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:05.574866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:05.576188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:05.577034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:05.932491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:05.941555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b04b2f9c-eabe-4bba-aab8-6b4051d782c3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.394864 Feb 12 21:10:05.942133 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1128/2218] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:05 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:06.083497 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f10de7d2-2cb4-4f7c-8de1-99b081d66eb9 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/d546106e-228e-430d-9e15-cb6d4bc0e4b6" status: 202 len: 0 microversion: 2.1 time: 1.782635 Feb 12 21:10:06.084080 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1091/2219] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:10:04 2022] DELETE /compute/v2.1/os-floating-ips/d546106e-228e-430d-9e15-cb6d4bc0e4b6 => generated 0 bytes in 1784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:10:06.096009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df7277bd-000e-4dcc-9b56-4e25bdeaa239 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Action: 'create', calling method: .version_select at 0x7fa8fe2c89d0>, body: {"pool": null} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:06.586708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:06.587498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:06.605898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:06.608880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:06.608880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:06.608880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:06.784296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:06.796227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:06.798058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:06.799472 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e0f23812-085d-41c0-9243-fc18df8e54f3 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1740 microversion: 2.42 time: 0.230375 Feb 12 21:10:06.800598 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1092/2220] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:06 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:06.960640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:06.961802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:06.970956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:06.972489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:06.974058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:06.974058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:07.194069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:07.224349 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0902efa2-36d1-476a-88e3-031392418b11 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.268456 Feb 12 21:10:07.236872 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1093/2221] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:06 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:07.821510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:07.822270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:07.831814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:07.832492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:07.833709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:07.834482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:08.042015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:08.052500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:08.054103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:08.055867 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10413291-77ca-4190-ae7e-447520e90888 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1786 microversion: 2.42 time: 0.239478 Feb 12 21:10:08.066584 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1094/2222] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:07 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1786 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:08.244665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:08.245448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:08.251839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:08.252299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:08.253100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:08.260700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:08.954206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:08.963805 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-af9dd8e0-b2d8-49e6-b7a9-cd617ca96f71 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.724618 Feb 12 21:10:08.970054 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1095/2223] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:08 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:09.077329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:09.078094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:09.088332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:09.090619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:09.091556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:09.092451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:09.434361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:09.454557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:09.456402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:09.457855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-32ad144a-2a91-4639-adca-2f29705302b4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1786 microversion: 2.42 time: 0.384799 Feb 12 21:10:09.458753 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1096/2224] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:09 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1786 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:09.983152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:09.983922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:09.991629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:10.000661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:10.000661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:10.000661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:10.317218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df7277bd-000e-4dcc-9b56-4e25bdeaa239 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.225921 Feb 12 21:10:10.322263 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1129/2225] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:10:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:10:10.334084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d097395-f98f-4c14-84f0-264b61716e69 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Calling method '.version_select at 0x7fa8fe152d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:10.360324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:10.369134 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8931e0e5-2368-45cb-b7cb-ad144f877b07 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.389680 Feb 12 21:10:10.375946 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1097/2226] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:09 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:10.476180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:10.477602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:10.484463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:10.485116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:10.486264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:10.486872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:10.786133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:10.803019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:10.805809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:10.807716 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14788a62-7280-4ca8-bd05-6b79e6d72a15 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1832 microversion: 2.42 time: 0.335222 Feb 12 21:10:10.808832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1098/2227] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:10 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1832 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:11.391791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:11.392474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:11.401702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:11.402154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:11.403304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:11.403413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:11.612759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:11.628666 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7ce3e42-3f36-4eed-a028-bcc459f6ce5a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.240354 Feb 12 21:10:11.629262 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1099/2228] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:11 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:11.839036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:11.843178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:11.865673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:11.866134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:11.866941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:11.868295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:12.115027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d097395-f98f-4c14-84f0-264b61716e69 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/aac4541f-b3a8-4e17-9874-bc9ae8968292" status: 202 len: 0 microversion: 2.1 time: 1.788497 Feb 12 21:10:12.115626 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1130/2229] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:10:10 2022] DELETE /compute/v2.1/os-floating-ips/aac4541f-b3a8-4e17-9874-bc9ae8968292 => generated 0 bytes in 1790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:10:12.124322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8319cc94-4e05-473e-9df2-84db0fdd468d tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Calling method '.version_select at 0x7fa8fe86e0d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:12.258489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-8319cc94-4e05-473e-9df2-84db0fdd468d tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aac4541f-b3a8-4e17-9874-bc9ae8968292 could not be found", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:10:12.259826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8319cc94-4e05-473e-9df2-84db0fdd468d tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] HTTP exception thrown: Floating IP not found for ID aac4541f-b3a8-4e17-9874-bc9ae8968292 Feb 12 21:10:12.260436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8319cc94-4e05-473e-9df2-84db0fdd468d tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Returning 404 to user: Floating IP not found for ID aac4541f-b3a8-4e17-9874-bc9ae8968292 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:10:12.261291 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8319cc94-4e05-473e-9df2-84db0fdd468d tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips/aac4541f-b3a8-4e17-9874-bc9ae8968292" status: 404 len: 111 microversion: 2.1 time: 0.141110 Feb 12 21:10:12.262649 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1131/2230] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:10:12 2022] GET /compute/v2.1/os-floating-ips/aac4541f-b3a8-4e17-9874-bc9ae8968292 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:10:12.273126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5c63a429-285d-4eca-a3e9-e7908a4c3948 req-92345167-6fac-480a-8750-1ad1cb6fabc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "4d209389-a95f-430a-95ec-f6d0b38d85a6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:12.277480 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:12.277480 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:12.301993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5c63a429-285d-4eca-a3e9-e7908a4c3948 req-92345167-6fac-480a-8750-1ad1cb6fabc3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:12.304489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5c63a429-285d-4eca-a3e9-e7908a4c3948 req-92345167-6fac-480a-8750-1ad1cb6fabc3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:12.331574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5c63a429-285d-4eca-a3e9-e7908a4c3948 req-92345167-6fac-480a-8750-1ad1cb6fabc3 service nova] Creating event network-changed:4d209389-a95f-430a-95ec-f6d0b38d85a6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:12.338948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5c63a429-285d-4eca-a3e9-e7908a4c3948 req-92345167-6fac-480a-8750-1ad1cb6fabc3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074464 Feb 12 21:10:12.340073 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1132/2231] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:12.353168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c06fcf9-2784-4373-b60d-d60213571964 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Calling method '.version_select at 0x7fa8fe24da60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:12.442258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:12.464763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:12.466676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:12.468134 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-030cad1b-f6ad-463a-9aa9-b5eb0d77fd81 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1832 microversion: 2.42 time: 0.643888 Feb 12 21:10:12.469762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1100/2232] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:11 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1832 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:12.505829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG neutronclient.v2_0.client [None req-1c06fcf9-2784-4373-b60d-d60213571964 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aac4541f-b3a8-4e17-9874-bc9ae8968292 could not be found", "detail": ""}} {{(pid=141727) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:10:12.505829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1c06fcf9-2784-4373-b60d-d60213571964 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] HTTP exception thrown: Floating IP not found for ID aac4541f-b3a8-4e17-9874-bc9ae8968292 Feb 12 21:10:12.510399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c06fcf9-2784-4373-b60d-d60213571964 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] Returning 404 to user: Floating IP not found for ID aac4541f-b3a8-4e17-9874-bc9ae8968292 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:10:12.511539 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c06fcf9-2784-4373-b60d-d60213571964 tempest-FloatingIPsTestJSON-1442884695 tempest-FloatingIPsTestJSON-1442884695-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/aac4541f-b3a8-4e17-9874-bc9ae8968292" status: 404 len: 111 microversion: 2.1 time: 0.169472 Feb 12 21:10:12.516819 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1133/2233] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:10:12 2022] DELETE /compute/v2.1/os-floating-ips/aac4541f-b3a8-4e17-9874-bc9ae8968292 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:10:12.647777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:12.649826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:12.670513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:12.671283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:12.672283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:12.672731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:13.496031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:13.496784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:13.504033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:13.504503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:13.505348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:13.505801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:13.705748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:13.723887 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9377a3d7-5146-4c4d-ab15-18bd65e1c91c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 1.081519 Feb 12 21:10:13.728551 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1101/2234] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:12 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:13.826949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:13.840078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:13.842469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:13.843638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6bda5384-a87f-466a-b644-ceedf0d37a74 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1853 microversion: 2.42 time: 0.352953 Feb 12 21:10:13.844564 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1134/2235] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:13 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1853 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:14.373002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-42878dbd-b169-4a8e-b76c-cee76ccc393f req-32aa19ad-ee7e-4e89-8000-7b9f269f8c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "f960d66a-27d4-45da-ab76-16c8e9d8d0db"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:14.376569 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:14.376569 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:10:14.392123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-42878dbd-b169-4a8e-b76c-cee76ccc393f req-32aa19ad-ee7e-4e89-8000-7b9f269f8c2c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:14.392972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-42878dbd-b169-4a8e-b76c-cee76ccc393f req-32aa19ad-ee7e-4e89-8000-7b9f269f8c2c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:14.410246 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-42878dbd-b169-4a8e-b76c-cee76ccc393f req-32aa19ad-ee7e-4e89-8000-7b9f269f8c2c service nova] Creating event network-changed:f960d66a-27d4-45da-ab76-16c8e9d8d0db for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:14.417507 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-42878dbd-b169-4a8e-b76c-cee76ccc393f req-32aa19ad-ee7e-4e89-8000-7b9f269f8c2c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052288 Feb 12 21:10:14.418555 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1102/2236] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:14.754642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:14.755033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:14.769100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:14.769813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:14.772361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:14.773240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:14.864259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:14.865827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:14.876836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:14.885953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:14.885953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:14.885953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:15.251592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:15.260527 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-43a734fb-2f07-43a1-a9ac-1b324d880bec tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.520856 Feb 12 21:10:15.272916 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1135/2237] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:14 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:15.776878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:15.793275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:15.796979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:15.803541 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-44920835-f0fe-4c69-bfb1-e1286e0dc68c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.943513 Feb 12 21:10:15.809450 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1103/2238] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:14 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:16.291251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:16.292688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:16.305528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:16.305528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:16.305528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:16.306115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:16.491726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:16.502898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56681a92-6836-45f8-9fc3-4429f0460e0b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.216447 Feb 12 21:10:16.503504 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1136/2239] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:16 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:16.575692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-686b2c31-f830-458a-89ce-c7c894cb6f4b req-aa78ec41-ff5e-4ddd-803a-a9b6d82c891b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "1fe06461-27fb-4282-97ba-13fca702a547"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:16.577289 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:16.577289 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:10:16.592204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-686b2c31-f830-458a-89ce-c7c894cb6f4b req-aa78ec41-ff5e-4ddd-803a-a9b6d82c891b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:16.593040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-686b2c31-f830-458a-89ce-c7c894cb6f4b req-aa78ec41-ff5e-4ddd-803a-a9b6d82c891b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:16.611110 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-686b2c31-f830-458a-89ce-c7c894cb6f4b req-aa78ec41-ff5e-4ddd-803a-a9b6d82c891b service nova] Creating event network-changed:1fe06461-27fb-4282-97ba-13fca702a547 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:16.618531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-686b2c31-f830-458a-89ce-c7c894cb6f4b req-aa78ec41-ff5e-4ddd-803a-a9b6d82c891b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051191 Feb 12 21:10:16.620889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1104/2240] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:16.824215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:16.824910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:16.831497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:16.832245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:16.833563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:16.834251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:17.503656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:17.520482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:17.521191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:17.530136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:17.530136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:17.530451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:17.530451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:17.530451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:17.530451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:17.533255 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bafcb203-032b-4956-a581-51d7a83d295e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.709582 Feb 12 21:10:17.546063 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1137/2241] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:16 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:18.009703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:18.025292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cb75a43d-3daf-49e9-b5f8-8b7f737584b7 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1471 microversion: 2.1 time: 0.508900 Feb 12 21:10:18.027052 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1105/2242] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:17 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:18.552440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:18.553336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:18.575890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:18.576357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:18.577190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:18.577668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:18.917687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-fb4924f9-a726-4965-8d40-dceb7a3c62cf req-0f3f68c5-0aa7-4787-b820-becf273b713e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "d18f9305-c081-40ea-be43-4032e65318f6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:18.919868 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:18.919868 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:10:18.953940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fb4924f9-a726-4965-8d40-dceb7a3c62cf req-0f3f68c5-0aa7-4787-b820-becf273b713e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:18.955087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fb4924f9-a726-4965-8d40-dceb7a3c62cf req-0f3f68c5-0aa7-4787-b820-becf273b713e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:18.995715 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-fb4924f9-a726-4965-8d40-dceb7a3c62cf req-0f3f68c5-0aa7-4787-b820-becf273b713e service nova] Creating event network-changed:d18f9305-c081-40ea-be43-4032e65318f6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:18.997913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:19.014663 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-fb4924f9-a726-4965-8d40-dceb7a3c62cf req-0f3f68c5-0aa7-4787-b820-becf273b713e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104552 Feb 12 21:10:19.020653 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1106/2243] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:19.045743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:19.049852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:19.049981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:19.050107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:19.050209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b04ca715-969f-46f2-9e2c-817df1ec5781 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.500551 Feb 12 21:10:19.059101 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1138/2244] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:18 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:19.075512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:19.081004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:19.084184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:19.086837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:19.574864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:19.583234 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c252173d-a7aa-403c-8d2f-35c7372c9bca tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.543664 Feb 12 21:10:19.583718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1107/2245] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:19 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:19.651536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:19.652093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:19.664539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:19.665141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:19.665960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:19.672309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:19.695970 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] HTTP exception thrown: Instance db982964-ae22-4469-9bd5-9c53a838f1cd could not be found. Feb 12 21:10:19.696910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Returning 404 to user: Instance db982964-ae22-4469-9bd5-9c53a838f1cd could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:10:19.698129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a0729f76-2a67-4824-b4c9-05b3d29877df tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "DELETE /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 404 len: 111 microversion: 2.1 time: 0.050591 Feb 12 21:10:19.702136 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1139/2246] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:10:19 2022] DELETE /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:10:19.708027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:19.708678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] [instance: db982964-ae22-4469-9bd5-9c53a838f1cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:19.719997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:19.721124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:19.722034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:19.722543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:19.740152 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] HTTP exception thrown: Instance db982964-ae22-4469-9bd5-9c53a838f1cd could not be found. Feb 12 21:10:19.743548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] Returning 404 to user: Instance db982964-ae22-4469-9bd5-9c53a838f1cd could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:10:19.744432 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25c1334d-c643-4e79-b5a1-c0ced01001d0 tempest-AttachSCSIVolumeTestJSON-1680990447 tempest-AttachSCSIVolumeTestJSON-1680990447-project] 10.222.0.31 "GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd" status: 404 len: 111 microversion: 2.1 time: 0.041301 Feb 12 21:10:19.762877 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1108/2247] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:19 2022] GET /compute/v2.1/servers/db982964-ae22-4469-9bd5-9c53a838f1cd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:10:20.081531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:20.082150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:20.096512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:20.096962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:20.097805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:20.098233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:20.602470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:20.604449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:20.621606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:20.622404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:20.624138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:20.624800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:20.659294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:20.682230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:20.699132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:20.708916 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5147d44-7d20-437b-a78c-4b2684482925 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.631757 Feb 12 21:10:20.715434 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1140/2248] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:20 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:21.171293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:21.182538 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7c4e2ab-0c01-4e55-a701-6b54af0cd97c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.586311 Feb 12 21:10:21.184384 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1109/2249] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:20 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:21.638061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c80ca821-d77a-45f1-ae1a-7a490c6df327 req-ee0e781c-2cc2-47fb-8a39-f7350d86c492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "c24391d7-58a5-450b-bfb5-2e331131b9e0"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:21.641549 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:21.641549 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:21.668607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c80ca821-d77a-45f1-ae1a-7a490c6df327 req-ee0e781c-2cc2-47fb-8a39-f7350d86c492 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:21.669735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c80ca821-d77a-45f1-ae1a-7a490c6df327 req-ee0e781c-2cc2-47fb-8a39-f7350d86c492 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:21.700456 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c80ca821-d77a-45f1-ae1a-7a490c6df327 req-ee0e781c-2cc2-47fb-8a39-f7350d86c492 service nova] Creating event network-changed:c24391d7-58a5-450b-bfb5-2e331131b9e0 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:21.713807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c80ca821-d77a-45f1-ae1a-7a490c6df327 req-ee0e781c-2cc2-47fb-8a39-f7350d86c492 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080356 Feb 12 21:10:21.718132 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1141/2250] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:21.737917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:21.739200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:21.746790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:21.747584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:21.748637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:21.749306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:22.200311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:22.201013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:22.212830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:22.213429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:22.214362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:22.217583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:22.418083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:22.435065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:22.436730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:22.438057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5594d85f-876c-46a9-a897-1358c6f6da0e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.712945 Feb 12 21:10:22.442327 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1110/2251] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:21 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:22.740742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1474981085", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "0667fd4a-8e2d-4583-adf6-fead39b333d4"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:22.761288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:22.772500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-082dddf1-a6d9-4a80-ad49-f14a8ef3bace tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.576067 Feb 12 21:10:22.777839 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1142/2252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:22 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:22.782033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ac25c444-46a1-4501-92fb-98601c8aeaa1 req-fe148b6a-8ec6-49c5-8b9c-6d2a826066af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "name": "network-vif-unplugged", "status": "completed", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:22.783594 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:22.783594 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:22.805853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac25c444-46a1-4501-92fb-98601c8aeaa1 req-fe148b6a-8ec6-49c5-8b9c-6d2a826066af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:22.806301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac25c444-46a1-4501-92fb-98601c8aeaa1 req-fe148b6a-8ec6-49c5-8b9c-6d2a826066af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:22.830095 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ac25c444-46a1-4501-92fb-98601c8aeaa1 req-fe148b6a-8ec6-49c5-8b9c-6d2a826066af service nova] Creating event network-vif-unplugged:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:10:22.836374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] validate_networks() for [('0667fd4a-8e2d-4583-adf6-fead39b333d4', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:10:22.839347 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ac25c444-46a1-4501-92fb-98601c8aeaa1 req-fe148b6a-8ec6-49c5-8b9c-6d2a826066af service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064470 Feb 12 21:10:22.840899 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1143/2253] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:23.463863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:23.465580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:23.483952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:23.488599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:23.488599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:23.491194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:23.865091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:10:23.865708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:10:23.866305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:10:23.866803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:10:23.868188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:10:23.890230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:23.890230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:23.890230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:23.890230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:23.913409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Getting quotas for project 9627e1d31e814deb8265e43f63ac807c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:23.928403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Getting quotas for user c4d49d7210e1490da25ef76c213f6059 and project 9627e1d31e814deb8265e43f63ac807c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:23.983548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:10:23.994315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:10:24.185626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c178ba8-e63c-4f3a-91b6-58795eeed7ba tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741588 Feb 12 21:10:24.189538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1111/2254] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:10:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:10:24.199158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:24.199798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:24.223318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:24.223786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:24.225292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:24.225761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:24.246851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:24.274296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:24.285621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:24.287283 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9cfcd23a-8abd-42d5-a2e8-bb82f766923c tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.827983 Feb 12 21:10:24.298996 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1144/2255] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:23 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:24.303653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1c139446-a6bd-4be0-8da6-f1d83e3428af req-b1a6ce5f-c441-4f0d-9d0b-974c4254a4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "f256d627-df49-4516-b949-fc05f0dbf0bc"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:24.310793 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:24.310793 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:24.314936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1c139446-a6bd-4be0-8da6-f1d83e3428af req-b1a6ce5f-c441-4f0d-9d0b-974c4254a4aa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:24.319322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1c139446-a6bd-4be0-8da6-f1d83e3428af req-b1a6ce5f-c441-4f0d-9d0b-974c4254a4aa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:24.341003 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1c139446-a6bd-4be0-8da6-f1d83e3428af req-b1a6ce5f-c441-4f0d-9d0b-974c4254a4aa service nova] Creating event network-changed:f256d627-df49-4516-b949-fc05f0dbf0bc for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:24.359087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1c139446-a6bd-4be0-8da6-f1d83e3428af req-b1a6ce5f-c441-4f0d-9d0b-974c4254a4aa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068733 Feb 12 21:10:24.360190 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1145/2256] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:24.410768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56f25114-0f17-4598-b923-b13cee0b6a70 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:24.411662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56f25114-0f17-4598-b923-b13cee0b6a70 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:24.549519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-56f25114-0f17-4598-b923-b13cee0b6a70 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:24.558199 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56f25114-0f17-4598-b923-b13cee0b6a70 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1224 microversion: 2.1 time: 0.172677 Feb 12 21:10:24.558790 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1146/2257] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:24 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1224 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:24.834344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:24.845460 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e7d38e96-6531-4095-8704-8f6b5b423160 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.652379 Feb 12 21:10:24.846509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1112/2258] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:24 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:25.314986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:25.317613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:25.330496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:25.331241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:25.332316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:25.332978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:25.576175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-082309c5-d468-4104-b62e-95ab9c75b852 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:25.576862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-082309c5-d468-4104-b62e-95ab9c75b852 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:25.755500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-082309c5-d468-4104-b62e-95ab9c75b852 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:25.775600 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-082309c5-d468-4104-b62e-95ab9c75b852 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1224 microversion: 2.1 time: 0.203182 Feb 12 21:10:25.776548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1113/2259] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:25 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1224 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:25.865952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:25.866837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:25.888025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:25.901066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:25.904133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:25.904133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:26.108027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:26.156322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:26.165307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:26.183638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63db7bce-a0e1-4b26-877c-bea11aff942a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.874826 Feb 12 21:10:26.190098 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1147/2260] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:25 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:26.384006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-94fcc7b4-0d2c-4472-943f-52787c3bfa3d req-8c9904ee-bb1d-436e-b0b7-182b72d0efb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "19dd89b0-f04c-47e0-b086-a93ccf42ad36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:26.386157 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:26.386157 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:26.397206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-94fcc7b4-0d2c-4472-943f-52787c3bfa3d req-8c9904ee-bb1d-436e-b0b7-182b72d0efb9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:26.398113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-94fcc7b4-0d2c-4472-943f-52787c3bfa3d req-8c9904ee-bb1d-436e-b0b7-182b72d0efb9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:26.431370 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-94fcc7b4-0d2c-4472-943f-52787c3bfa3d req-8c9904ee-bb1d-436e-b0b7-182b72d0efb9 service nova] Creating event network-changed:19dd89b0-f04c-47e0-b086-a93ccf42ad36 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:26.437157 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-94fcc7b4-0d2c-4472-943f-52787c3bfa3d req-8c9904ee-bb1d-436e-b0b7-182b72d0efb9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058189 Feb 12 21:10:26.438469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1148/2261] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:26.446808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:26.447673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:26.454834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:26.455841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:26.457027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:26.457715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:26.484766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:26.503697 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f1f5e218-7fe2-4251-97b7-e9e130682d04 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.641255 Feb 12 21:10:26.517176 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1114/2262] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:25 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:26.538692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lazy-loading 'flavor' on Instance uuid ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:10:26.793238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:26.796464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:26.823551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:26.824031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:26.832330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:26.834791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:26.982996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:27.006401 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b1ea9fcd-5637-4adc-8924-858dfde91164 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1220 microversion: 2.1 time: 0.218048 Feb 12 21:10:27.010781 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1115/2263] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:26 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1220 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:27.213285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:27.214120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:27.222909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:27.223522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:27.224456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:27.225060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:27.684660 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-15812721-65dc-4441-98d9-f3033d4527a1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/action" status: 202 len: 0 microversion: 2.20 time: 1.226713 Feb 12 21:10:27.688101 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1149/2264] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:10:26 2022] POST /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/action => generated 0 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:10:27.702556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-da1715bd-b047-45d8-af08-600daeeec457 req-5a63d918-8356-4996-b79f-a43fe870d7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "name": "network-vif-plugged", "status": "completed", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:27.711820 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:27.711820 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:27.733171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-da1715bd-b047-45d8-af08-600daeeec457 req-5a63d918-8356-4996-b79f-a43fe870d7cf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:27.735246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-da1715bd-b047-45d8-af08-600daeeec457 req-5a63d918-8356-4996-b79f-a43fe870d7cf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:27.794101 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-da1715bd-b047-45d8-af08-600daeeec457 req-5a63d918-8356-4996-b79f-a43fe870d7cf service nova] Creating event network-vif-plugged:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:10:27.822583 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-da1715bd-b047-45d8-af08-600daeeec457 req-5a63d918-8356-4996-b79f-a43fe870d7cf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128806 Feb 12 21:10:27.826075 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1150/2265] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:27.862062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:27.864595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:27.885917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:27.887911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:27.888965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:27.892199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:28.232907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.246625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.252031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.262330 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6c22cec2-65ff-4257-86bd-b2629615372a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 1.057747 Feb 12 21:10:28.265791 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1116/2266] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:27 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:28.272098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:28.272718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:28.289854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:28.290301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:28.293280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:28.295004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:28.435380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.468597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-777b4ef8-510f-4f01-8ac2-4e124b745d08 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.641170 Feb 12 21:10:28.470967 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1151/2267] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:27 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:28.487389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:28.488203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:28.495608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:28.496421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:28.497472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:28.498114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:28.583797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.595949 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ba1a111-6b84-4545-9862-eadece5a9f37 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1282 microversion: 2.1 time: 0.112238 Feb 12 21:10:28.596971 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1152/2268] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:28 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:28.944362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.962181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.962181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:28.964288 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb89c1a2-82be-4ea1-ac85-34cdb28be2c5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.697027 Feb 12 21:10:28.966425 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1117/2269] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:28 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:29.285223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:29.285921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:29.314443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.315117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.318549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.319591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.491032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:29.499841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:29.512635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.513827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.514960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.516263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.862924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:29.869196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:29.873543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:29.878335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:29.890877 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38b7030e-c52c-4716-86a5-31a1131e4aef tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.611823 Feb 12 21:10:29.891829 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1153/2270] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:29 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:29.906952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:29.907880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:29.909988 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6ad958a1-dff4-4600-8703-9c774136cffe tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1477 microversion: 2.1 time: 0.424494 Feb 12 21:10:29.912981 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1118/2271] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:29 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:29.935067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.935529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.936352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.936792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.985723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:29.987497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:29.995565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:29.996239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:29.999734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:30.000192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:30.349905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:30.358791 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-805b2caa-2740-4591-aff4-bb0ee4f0e1b5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1324 microversion: 2.1 time: 0.465657 Feb 12 21:10:30.359626 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1154/2272] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:29 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:30.469167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:30.479145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:30.481023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:30.483179 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-735a417d-84c2-42b5-addd-a2f2b9c08a93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.502943 Feb 12 21:10:30.483903 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1119/2273] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:29 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:30.910340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:30.910959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:30.918131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:30.918608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:30.919409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:30.919846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:30.930693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:30.931967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:30.939173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:30.939671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:30.941613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:30.942778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.386701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:31.398848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:31.400865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:31.402120 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72ce8f8e-1166-4a29-9d56-e3abd3ebf47a tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.495857 Feb 12 21:10:31.416799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1155/2274] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:30 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:31.420248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:31.420889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:31.430456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:31.430456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.431042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:31.431481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.448504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:31.459288 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d76b898-f3e8-4061-add6-2d83fcc1d665 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1463 microversion: 2.1 time: 0.532280 Feb 12 21:10:31.461668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1120/2275] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:30 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1463 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:31.477660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:31.478290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:31.489676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:31.490143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.491200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:31.491638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.704097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:31.713680 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0f41a202-9acd-44cb-b349-108d297c502b tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1463 microversion: 2.1 time: 0.241951 Feb 12 21:10:31.714816 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1121/2276] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:31 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1463 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:31.720715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:31.722540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:31.729859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:31.730412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.731476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:31.732161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:31.802728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:31.812094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e895bf9-e83f-4a8a-9aa0-4a6f4a02c436 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1324 microversion: 2.1 time: 0.396193 Feb 12 21:10:31.823627 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1156/2277] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:31 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:32.033328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-665395609", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:32.045597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:32.053839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:32.059408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:32.062383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-703e3477-f226-4392-a92d-9b4c607b4863 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.346363 Feb 12 21:10:32.062962 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1122/2278] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:31 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:32.099094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] validate_networks() for [('4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:10:32.102017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:32.106241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:32.114759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.118778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.118778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.118778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.224064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:10:32.226675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:10:32.228476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:10:32.231330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:10:32.234810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:10:32.509372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:32.523718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.523718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.523718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.523718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.559556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1e3638e9-ab99-4da9-a744-0531691095f6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 1067 microversion: 2.1 time: 0.488054 Feb 12 21:10:32.567085 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1123/2279] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:10:32 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 1067 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 12 21:10:32.573867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2a656d97-3429-429f-928c-31b3b887347d req-f2882976-2460-4894-b90a-f0630aabdc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:32.575720 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:32.575720 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:10:32.583709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2a656d97-3429-429f-928c-31b3b887347d req-f2882976-2460-4894-b90a-f0630aabdc78 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.584160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2a656d97-3429-429f-928c-31b3b887347d req-f2882976-2460-4894-b90a-f0630aabdc78 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.597711 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2a656d97-3429-429f-928c-31b3b887347d req-f2882976-2460-4894-b90a-f0630aabdc78 service nova] Creating event network-changed:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:10:32.604201 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2a656d97-3429-429f-928c-31b3b887347d req-f2882976-2460-4894-b90a-f0630aabdc78 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035135 Feb 12 21:10:32.605519 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1124/2280] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:32.611873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:32.612615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:32.620616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.621213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.622208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.622646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.933328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:10:32.933867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:10:32.934259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:10:32.934675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:10:32.935460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:10:32.947185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.947953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.949148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:32.950896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:32.993340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:33.008137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for user 1cec3ccfc53b48bfa8bc879989b720b8 and project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:33.022808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:10:33.036535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:10:33.163570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:33.174003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:33.175550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:33.176744 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50a34ad8-a6c2-41f6-8838-7ac6e2ea5280 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.570153 Feb 12 21:10:33.177311 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1125/2281] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:32 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:33.182748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:33.185585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:33.190692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:33.191153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:33.192153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:33.192597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:33.260671 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d9eeeffe-fa65-4f07-9f37-77190aac11ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446843 Feb 12 21:10:33.261975 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1157/2282] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:10:33.272165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:33.277680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:33.285887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:33.287914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:33.289033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:33.290026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:34.212841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.223373 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0ee8cd6-a9e1-4187-abfa-84af165337d6 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1324 microversion: 2.1 time: 0.960086 Feb 12 21:10:34.231582 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1158/2283] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:33 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1324 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:34.246144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:34.247296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:34.249809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.258575 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc0b9add-7987-40eb-9346-9d13e27924eb tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 1.079505 Feb 12 21:10:34.260782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:34.262887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:34.263068 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1126/2284] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:33 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:34.264139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:34.265326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:34.272898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d31911f5-23ce-4ad3-b9c3-8888fbc7a16f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:34.278469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d31911f5-23ce-4ad3-b9c3-8888fbc7a16f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:34.443584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d31911f5-23ce-4ad3-b9c3-8888fbc7a16f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.464872 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d31911f5-23ce-4ad3-b9c3-8888fbc7a16f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1207 microversion: 2.1 time: 0.199637 Feb 12 21:10:34.465732 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1127/2285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:34 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1207 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:34.482780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:34.483713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:34.493512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:34.496445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:34.530285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:34.531807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:34.738314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.753465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.771223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.771223 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1aa2ff32-fbc0-46d6-b765-11a152b2df6d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.528576 Feb 12 21:10:34.771223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1159/2286] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:34 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:34.971120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.987070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.989214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:34.990985 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34724b6d-2cc9-43aa-b572-66e41b618d39 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.521822 Feb 12 21:10:34.992372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1128/2287] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:34 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:35.240731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:35.241349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:35.253691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:35.256292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:35.259219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:35.260360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:35.277812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:35.278417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:35.298702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:35.306059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:35.310979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:35.311790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:35.768691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:35.794433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8466434b-9ab6-4bd7-8104-3ac6e49ad283 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.519893 Feb 12 21:10:35.819584 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1129/2288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:35 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:35.832530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:35.834678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:35.855390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:35.856771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:35.858446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:35.859811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:35.993525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.008193 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccd3a928-4f22-4cfa-81b8-a5a1d650cd62 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1259 microversion: 2.1 time: 0.183663 Feb 12 21:10:36.018575 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1130/2289] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:35 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:36.024088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:36.024962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:36.032342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.032993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:36.034094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.034703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:36.131475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.162793 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b46f45ec-4096-44d7-938b-db8ec14ca442 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1324 microversion: 2.1 time: 0.926439 Feb 12 21:10:36.187028 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1160/2290] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:35 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1324 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:36.196569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:36.202930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:36.211910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.213800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:36.215785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.217623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:36.361034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.386069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.391795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.394397 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92b84dd0-cf13-4fec-9dae-61e24bd091a7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.373367 Feb 12 21:10:36.395301 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1131/2291] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:36 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:36.519692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c53857ae-796f-4617-8da7-e12df66f3bfd req-0b08a670-991b-4905-8996-e84c6a624059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "name": "network-vif-plugged", "status": "completed", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:36.524923 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:36.524923 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:10:36.533493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c53857ae-796f-4617-8da7-e12df66f3bfd req-0b08a670-991b-4905-8996-e84c6a624059 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.534044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c53857ae-796f-4617-8da7-e12df66f3bfd req-0b08a670-991b-4905-8996-e84c6a624059 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:36.556999 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c53857ae-796f-4617-8da7-e12df66f3bfd req-0b08a670-991b-4905-8996-e84c6a624059 service nova] Creating event network-vif-plugged:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:10:36.569660 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c53857ae-796f-4617-8da7-e12df66f3bfd req-0b08a670-991b-4905-8996-e84c6a624059 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055430 Feb 12 21:10:36.572134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1132/2292] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:10:36.855220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.855220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.856109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:36.856109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f93008f-8431-43bc-b203-22fc21dc3a03 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.626400 Feb 12 21:10:36.856109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1161/2293] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:36 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:36.856852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:36.856852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:36.856852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.856852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:36.857470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:36.857470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.041119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:37.053395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:37.129636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.129636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.129636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.129636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.192520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:37.204135 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8478d2a5-9f7c-4297-87d2-b267d3063398 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.371588 Feb 12 21:10:37.214906 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1133/2294] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:36 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:37.220131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:37.221033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:37.243851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.247729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:37.252404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.261925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.261925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.262529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e46986c-09c2-4247-a3b2-b3e5ccc7fd58 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1277 microversion: 2.1 time: 0.233536 Feb 12 21:10:37.275198 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1162/2295] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:37 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:37.416403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:37.418013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:37.440557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.441383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.443612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.445943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.769708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:37.780659 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9ac98b3-a220-4747-a15a-6ce6f2eb4a2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1324 microversion: 2.1 time: 0.564268 Feb 12 21:10:37.782257 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1134/2296] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:37 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:37.835613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:37.837257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:37.845162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.845839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:37.846948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:37.847488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:38.164922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.173662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.175215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.176418 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f33d2efb-03ab-4439-8677-3a88cad736b0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.766395 Feb 12 21:10:38.177200 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1163/2297] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:37 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:38.223439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:38.224239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:38.233606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:38.234126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:38.235229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:38.235834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:38.431884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.446334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.452567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.454691 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa22d231-8119-44f7-9e29-4e5fe254220f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.622969 Feb 12 21:10:38.455270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1135/2298] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:37 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:38.471074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:38.471573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:38.500521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:38.501484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:38.502364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:38.502812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:38.631815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:38.641850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-740e5f3c-e447-4416-bbbe-00193606317c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.423302 Feb 12 21:10:38.650442 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1164/2299] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:38 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:38.802026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:38.803014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:38.815035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:38.819284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:38.819284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:38.819284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:39.138055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:39.146880 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47ce12be-65ad-40ef-8d9d-2ed79acc102f tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1520 microversion: 2.1 time: 0.349932 Feb 12 21:10:39.147763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1165/2300] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:38 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:39.170640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f338cd2f-9120-412a-9914-9f75c55cd808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'create', calling method: .version_select at 0x7fa8fe2c8670>, body: {"pool": null} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:39.218567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:39.227526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f9119b23-589b-4895-81e8-037074e486d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.766691 Feb 12 21:10:39.238811 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1136/2301] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:38 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:39.245145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:39.246124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:39.253716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:39.254468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:39.256080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:39.256735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:39.809650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:39.822529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:39.824032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:39.825242 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1b4439f-05db-4037-b41d-04323966eb66 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.584511 Feb 12 21:10:39.830964 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1137/2302] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:39 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:39.843369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:39.843369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:39.861649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:39.861649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:39.861649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:39.865197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:40.735283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:40.745662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:40.746888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:40.748064 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df34101b-8cae-4b06-8ef9-471c94cd5951 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.916048 Feb 12 21:10:40.777204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1138/2303] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:39 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:40.782199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:40.783081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:40.791029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:40.791777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:40.793025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:40.793669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:41.016480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:41.032698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a01a4430-2723-4492-8854-112b85bab550 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.254011 Feb 12 21:10:41.033529 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1139/2304] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:40 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:41.053307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:41.055076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:41.074569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:41.077306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:41.078737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:41.079349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:41.411750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:41.421730 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40763485-9506-4691-826e-76a3854242af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.380970 Feb 12 21:10:41.422627 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1140/2305] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:41 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:41.429909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-002dd2b9-77f5-48f2-b66a-f4c32dca8044 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Action: 'create', calling method: .version_select at 0x7fa907fdb310>, body: {"keypair": {"name": "tempest-keypair-1526943967"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:41.444648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-002dd2b9-77f5-48f2-b66a-f4c32dca8044 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Getting quotas for project c1ff07a97663458e87406ec3a5e2cf1c. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:41.461927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-002dd2b9-77f5-48f2-b66a-f4c32dca8044 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Getting quotas for user 9d5e8baa8b2d40f5ae21571ff953b9e4 and project c1ff07a97663458e87406ec3a5e2cf1c. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:41.784201 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f338cd2f-9120-412a-9914-9f75c55cd808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.618770 Feb 12 21:10:41.784804 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1166/2306] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:10:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:41.789843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:41.790828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:41.797576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:41.798137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:41.798951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:41.799392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:41.992584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.001026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.002655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.003810 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c386824d-ee4c-46f1-a15f-a8fd5d862d1f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.218088 Feb 12 21:10:42.004389 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1167/2307] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:41 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:42.012658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-99e55c7d-6617-4551-b88b-26b2caa19300 req-594f8495-2bdb-4ecf-b28e-08b5bfbccb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6", "tag": "e38f0d55-536c-4032-855c-af42ba5ed8b7"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:42.012658 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:42.012658 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:42.018430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-99e55c7d-6617-4551-b88b-26b2caa19300 req-594f8495-2bdb-4ecf-b28e-08b5bfbccb8c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.018877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-99e55c7d-6617-4551-b88b-26b2caa19300 req-594f8495-2bdb-4ecf-b28e-08b5bfbccb8c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.030189 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-99e55c7d-6617-4551-b88b-26b2caa19300 req-594f8495-2bdb-4ecf-b28e-08b5bfbccb8c service nova] Creating event network-changed:e38f0d55-536c-4032-855c-af42ba5ed8b7 for instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 on nch2-master-1 Feb 12 21:10:42.035103 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-99e55c7d-6617-4551-b88b-26b2caa19300 req-594f8495-2bdb-4ecf-b28e-08b5bfbccb8c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029521 Feb 12 21:10:42.035802 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1168/2308] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:42.040631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:42.041326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:42.047661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.048121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.048948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.049409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.118960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-002dd2b9-77f5-48f2-b66a-f4c32dca8044 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Getting quotas for project c1ff07a97663458e87406ec3a5e2cf1c. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:42.124241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-002dd2b9-77f5-48f2-b66a-f4c32dca8044 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Getting quotas for user 9d5e8baa8b2d40f5ae21571ff953b9e4 and project c1ff07a97663458e87406ec3a5e2cf1c. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:42.142898 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-002dd2b9-77f5-48f2-b66a-f4c32dca8044 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.718749 Feb 12 21:10:42.143538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1141/2309] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:10:41 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 720 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:10:42.150596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1216298499", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "0667fd4a-8e2d-4583-adf6-fead39b333d4"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:42.205628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] validate_networks() for [('0667fd4a-8e2d-4583-adf6-fead39b333d4', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:10:42.282194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.295533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.298118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.300510 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aef3a691-6212-47d3-8ff6-65c85427f76e tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.263376 Feb 12 21:10:42.312386 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1169/2310] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:42 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:42.316102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:42.318964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:42.323839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.324415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.325389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.325904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.527496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.540529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3f43f8a-b0f5-484f-a55d-046da67e40d6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.234931 Feb 12 21:10:42.545157 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1170/2311] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:42 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:42.566677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:42.571067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:42.579352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.580087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.581004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:42.582477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:42.792611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:42.800178 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc56bf50-a68a-4a4d-bcf7-d545e9739477 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.256453 Feb 12 21:10:42.801248 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1171/2312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:42 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:43.021164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b2981eb8-6408-42c9-8be6-06629fe0f36c req-589d9fcc-f5df-4ae3-9fcf-68659f8965b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "4d209389-a95f-430a-95ec-f6d0b38d85a6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:43.021164 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:43.021164 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:43.026110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b2981eb8-6408-42c9-8be6-06629fe0f36c req-589d9fcc-f5df-4ae3-9fcf-68659f8965b0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.026663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b2981eb8-6408-42c9-8be6-06629fe0f36c req-589d9fcc-f5df-4ae3-9fcf-68659f8965b0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.039613 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b2981eb8-6408-42c9-8be6-06629fe0f36c req-589d9fcc-f5df-4ae3-9fcf-68659f8965b0 service nova] Creating event network-vif-plugged:4d209389-a95f-430a-95ec-f6d0b38d85a6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:43.044882 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b2981eb8-6408-42c9-8be6-06629fe0f36c req-589d9fcc-f5df-4ae3-9fcf-68659f8965b0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038911 Feb 12 21:10:43.045840 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1172/2313] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:10:43.051103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:43.051256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:10:43.051619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:10:43.051792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:43.052102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:10:43.052546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:10:43.052961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:10:43.058619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.059070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.059861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.060296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.062789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.063475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.064308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.064779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.084158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Getting quotas for project 9627e1d31e814deb8265e43f63ac807c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:43.089860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Getting quotas for user c4d49d7210e1490da25ef76c213f6059 and project 9627e1d31e814deb8265e43f63ac807c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:43.105918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:10:43.107032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:10:43.245966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.251293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.252989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.254364 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-103bc010-92ab-41d8-bf46-610018c91c52 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.207438 Feb 12 21:10:43.255794 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1173/2314] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:43 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:43.307504 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cb4096e6-aadd-47f9-b36a-2c8da1abedb5 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162646 Feb 12 21:10:43.309770 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1142/2315] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:10:43.324425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb8a33b7-1b67-461b-a16b-452b316af6d3 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:43.325253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb8a33b7-1b67-461b-a16b-452b316af6d3 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:43.339739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:43.343935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:43.347904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.348631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.349695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.350324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.423911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb8a33b7-1b67-461b-a16b-452b316af6d3 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.432182 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb8a33b7-1b67-461b-a16b-452b316af6d3 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1224 microversion: 2.1 time: 0.114566 Feb 12 21:10:43.441731 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1174/2316] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:43 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:43.558648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:43.559574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:43.567034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.567507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.568364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.568804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.684656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.694541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.701159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.701159 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c393774-8643-4ce5-b239-2815ee05ee58 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.368713 Feb 12 21:10:43.701159 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1143/2317] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:43 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:43.744526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:43.760730 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-718a07c9-693d-408f-8512-c43eb483f4ee tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.206657 Feb 12 21:10:43.774140 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1175/2318] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:43 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:43.826038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:43.827366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:43.842813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.842813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:43.842813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:43.843122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.025501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.033705 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c79e4dc4-dcc9-45ea-b5bc-a33c7cfd1a49 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.220448 Feb 12 21:10:44.035693 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1144/2319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:43 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:44.274448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.275288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:44.288174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.290174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.291891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.292681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.303044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0909f872-7d4c-4ddf-b538-bd41db40c85c tempest-ListImagesTestJSON-1595818057 tempest-ListImagesTestJSON-1595818057-project] Calling method '.version_select at 0x7fa8fe1b49d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.374459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0909f872-7d4c-4ddf-b538-bd41db40c85c tempest-ListImagesTestJSON-1595818057 tempest-ListImagesTestJSON-1595818057-project] 10.222.0.31 "GET /compute/v2.1/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9" status: 200 len: 784 microversion: 2.1 time: 0.229288 Feb 12 21:10:44.375195 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1176/2320] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/images/4a11baa3-e49c-4bef-9cb0-43274e3b71c9 => generated 784 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:44.391171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c08981fb-2a7c-42ce-b094-ba1e5c3e9bb3 tempest-ListImagesTestJSON-1595818057 tempest-ListImagesTestJSON-1595818057-project] Calling method '.version_select at 0x7fa8fe1d7310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.478767 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c08981fb-2a7c-42ce-b094-ba1e5c3e9bb3 tempest-ListImagesTestJSON-1595818057 tempest-ListImagesTestJSON-1595818057-project] 10.222.0.31 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.090819 Feb 12 21:10:44.480268 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1177/2321] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/images => generated 445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:44.491320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.500645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:44.500645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.500645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.501152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.501771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.524672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.548361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.569075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.573913 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9bc6df56-9ff3-474a-be6b-35699a29d3f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1744 microversion: 2.20 time: 0.303457 Feb 12 21:10:44.575012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.588925 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1145/2322] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1744 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:44.603945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2234b541-ecce-4c42-ab94-9d2b2d3ebd3a tempest-ListImagesTestJSON-1595818057 tempest-ListImagesTestJSON-1595818057-project] Calling method '.version_select at 0x7fa8fd90dc10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.606255 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a9d5191-8c68-4eea-98d6-9cfb3a1895de tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1228 microversion: 2.1 time: 0.124159 Feb 12 21:10:44.607479 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1178/2323] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:44.675204 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2234b541-ecce-4c42-ab94-9d2b2d3ebd3a tempest-ListImagesTestJSON-1595818057 tempest-ListImagesTestJSON-1595818057-project] 10.222.0.31 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.084068 Feb 12 21:10:44.675873 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1146/2324] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:44.717477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.718012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:44.724369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.724826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.725699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.726195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.781959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:44.783298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:44.791437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.792099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.793012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:44.793585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:44.970278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.987444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.990167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:44.992700 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca812263-dc4b-4fa7-8c8a-642936860512 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.278763 Feb 12 21:10:44.993200 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1179/2325] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:45.053867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:45.056574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:45.064507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:45.070264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:45.070830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:45.072608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:45.073111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:45.078437 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0cc4243a-a598-4df6-b47e-f66c7c7d2192 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.301658 Feb 12 21:10:45.079033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1147/2326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:44 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:45.218456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:45.226810 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7fbed068-152f-44c2-8077-f9aa38fe715d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.178169 Feb 12 21:10:45.227446 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1180/2327] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:45 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:45.522052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1433880319", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0824877a-f60f-4b02-85ba-7bb3e69bc246"}, {"port": "17ba1c7f-90cf-4f91-a05e-68927bcbe7cc", "tag": "port-1"}, {"port": "db0ca88d-7497-4c86-9f77-a0e7753f1866", "tag": "port-2"}, {"uuid": "362c5c76-0028-4be9-86fd-cc1c41d159ca", "tag": "net-1"}, {"uuid": "362c5c76-0028-4be9-86fd-cc1c41d159ca"}, {"uuid": "c71d3387-4285-452a-953d-e8edb5c159e7", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c71d3387-4285-452a-953d-e8edb5c159e7", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2abea7c0-bbed-4f39-8231-884740b5d70b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1612196638"}], "key_name": "tempest-keypair-1526943967", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:45.596222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:45.597048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:45.604756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:45.605525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:45.606332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:45.606793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:45.645845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] validate_networks() for [('0824877a-f60f-4b02-85ba-7bb3e69bc246', None, None, None, None, None), (None, None, '17ba1c7f-90cf-4f91-a05e-68927bcbe7cc', None, None, None), (None, None, 'db0ca88d-7497-4c86-9f77-a0e7753f1866', None, None, None), ('362c5c76-0028-4be9-86fd-cc1c41d159ca', None, None, None, None, None), ('362c5c76-0028-4be9-86fd-cc1c41d159ca', None, None, None, None, None), ('c71d3387-4285-452a-953d-e8edb5c159e7', '10.2.2.100', None, None, None, None), ('c71d3387-4285-452a-953d-e8edb5c159e7', '10.2.2.200', None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:10:45.873243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:45.887704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:45.893513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:45.895109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff0ada8c-fca4-42c2-b6a8-cfd49e3c078b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1744 microversion: 2.20 time: 0.302639 Feb 12 21:10:45.896110 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1181/2328] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:45 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1744 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:45.910568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:45.911582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:45.919702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:45.927473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:45.927473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:45.927473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:45.993044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:46.009812 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea1d612a-4e1e-48cb-b468-3e1cb479c50e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1284 microversion: 2.1 time: 0.112228 Feb 12 21:10:46.019975 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1182/2329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:45 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:46.025372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-8a1322f5-b741-4684-a7a7-712893391660 req-1811a268-3ec2-44f0-a859-e46966f84293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "name": "network-vif-plugged", "status": "completed", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:46.030817 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:46.030817 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:46.038316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8a1322f5-b741-4684-a7a7-712893391660 req-1811a268-3ec2-44f0-a859-e46966f84293 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.039518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8a1322f5-b741-4684-a7a7-712893391660 req-1811a268-3ec2-44f0-a859-e46966f84293 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.073609 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-8a1322f5-b741-4684-a7a7-712893391660 req-1811a268-3ec2-44f0-a859-e46966f84293 service nova] Creating event network-vif-plugged:8a6d5784-855f-4db3-a849-95606d940801 for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 on nch2-master-1 Feb 12 21:10:46.082311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-8a1322f5-b741-4684-a7a7-712893391660 req-1811a268-3ec2-44f0-a859-e46966f84293 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060178 Feb 12 21:10:46.084035 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1183/2330] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:46.095876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:46.096597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:46.107195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.108347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.109176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.109651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.348832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:46.359741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:46.361478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:46.362796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-883596f4-26c4-4c77-ba0c-4421dcb83d08 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.278786 Feb 12 21:10:46.363373 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1184/2331] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:46 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:46.384763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:46.385667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:46.392689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.393153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.394007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.394590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.598243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:46.609416 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a024add5-4c71-4eb3-a693-bafb50ed5c55 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.242937 Feb 12 21:10:46.610438 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1185/2332] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:46 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:46.623497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:46.624869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:46.631104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.633570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.637751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.637751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.813284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:46.827705 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-08d34ebd-7aae-494c-8ed0-5871f5dcd13f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.210406 Feb 12 21:10:46.828795 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1186/2333] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:46 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:46.917647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:46.917647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:46.923244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.924262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:46.926028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:46.928557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:47.223140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.236040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.238403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.246686 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-95e1f9d6-318a-4d1b-ab5c-e7d11eb100f9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.336266 Feb 12 21:10:47.247476 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1187/2334] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:46 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:47.264152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:47.265373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:47.272745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:47.274096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:47.280064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:47.280064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:47.402119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.410123 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79d2b33f-8266-45a2-8b15-049f40a04808 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1282 microversion: 2.1 time: 0.160086 Feb 12 21:10:47.411537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1188/2335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:47 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:47.425472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:47.426167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:47.434856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:47.435502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:47.437042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:47.437685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:47.768310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.786986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.789112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:47.791141 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2411394f-6bd6-4542-adb6-c12f331b95a4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.378451 Feb 12 21:10:47.792157 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1189/2336] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:47 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:47.806783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:47.807700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:47.818305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:47.819061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:47.820613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:47.824467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:48.133269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:48.142368 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd6377d4-f002-4e70-8ec9-e74418da13a2 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.348698 Feb 12 21:10:48.143254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1190/2337] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:47 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:48.311649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fd11dbc2-9cb2-493f-a412-6b0d9b8d2f84 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Action: 'create', calling method: .version_select at 0x7fa90801dee0>, body: {"keypair": {"name": "tempest-keypair-1169807478"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:48.328842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fd11dbc2-9cb2-493f-a412-6b0d9b8d2f84 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:48.336917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fd11dbc2-9cb2-493f-a412-6b0d9b8d2f84 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:48.529507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fd11dbc2-9cb2-493f-a412-6b0d9b8d2f84 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:48.547289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fd11dbc2-9cb2-493f-a412-6b0d9b8d2f84 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:48.587954 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fd11dbc2-9cb2-493f-a412-6b0d9b8d2f84 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.443439 Feb 12 21:10:48.588911 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1191/2338] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:10:48 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:48.597879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:48.598735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:48.608072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:48.608712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:48.609761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:48.610374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:48.784106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:48.791419 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c3a9f3c-a4c3-472c-b0d6-472139410d2a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.197012 Feb 12 21:10:48.802079 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1192/2339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:48 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:48.810687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "f960d66a-27d4-45da-ab76-16c8e9d8d0db"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "d18f9305-c081-40ea-be43-4032e65318f6"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "19dd89b0-f04c-47e0-b086-a93ccf42ad36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:48.814164 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:48.814164 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:48.823495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:48.824311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:48.844410 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] Creating event network-vif-plugged:f960d66a-27d4-45da-ab76-16c8e9d8d0db for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:48.845331 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] Creating event network-vif-plugged:d18f9305-c081-40ea-be43-4032e65318f6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:48.846266 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] Creating event network-vif-plugged:19dd89b0-f04c-47e0-b086-a93ccf42ad36 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:48.854507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7c41fa5a-ffbf-46c2-86a1-392458c3b7db req-4f4ba321-35e7-401a-938e-e8c01985c9ae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049824 Feb 12 21:10:48.855456 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1193/2340] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:48.861222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:48.864412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:48.871765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:48.873247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:48.874403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:48.875114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.132478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.150056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.158203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.159479 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49adae82-a09e-43dd-85ea-3484fc2c525d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.302539 Feb 12 21:10:49.162058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1194/2341] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:48 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:49.168070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:49.169589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:49.180617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.181117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.182014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.182459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.424355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.435980 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b302d4c3-facc-4552-88ba-fd0dcaab065c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.272831 Feb 12 21:10:49.436799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1195/2342] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:49 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:49.450977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ecc54b80-a9ba-4a74-b5c4-e82a58789347 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe17f0d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:49.465602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ecc54b80-a9ba-4a74-b5c4-e82a58789347 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs/tempest-keypair-1169807478" status: 200 len: 691 microversion: 2.1 time: 0.017912 Feb 12 21:10:49.466803 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1196/2343] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:10:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1169807478 => generated 691 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:49.471961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:49.472624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:49.486482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.487515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.488027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.488515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.771792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.789086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.790637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:49.791922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ad22899-7dae-4090-b806-07624880efa7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.324003 Feb 12 21:10:49.796251 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1197/2344] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:49 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:49.797432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:49.798260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:49.806405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.806857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.807661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.808159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.946039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:10:49.947021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:10:49.947690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:10:49.948295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:10:49.948876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:10:49.975352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.978575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:49.979827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:49.980742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.009961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Getting quotas for project c1ff07a97663458e87406ec3a5e2cf1c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:50.010334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:50.018230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Getting quotas for user 9d5e8baa8b2d40f5ae21571ff953b9e4 and project c1ff07a97663458e87406ec3a5e2cf1c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:50.062030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea45caeb-3532-4620-af5c-470ca73aa4f1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.268123 Feb 12 21:10:50.063356 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1198/2345] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:49 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:50.078826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-524abd02-8514-4d6d-8b11-3bd3f4e5b23d tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe1b4430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:50.219895 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-524abd02-8514-4d6d-8b11-3bd3f4e5b23d tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169807478" status: 202 len: 0 microversion: 2.1 time: 0.155294 Feb 12 21:10:50.227019 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1199/2346] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169807478 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:10:50.234005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:50.234860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:50.276274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:10:50.276544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6eaf870e-5f05-4b08-bd12-c6b8d5f1e1d2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d4a0966d-0bbc-4ea1-8a6b-3fd2b922a34a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2abea7c0-bbed-4f39-8231-884740b5d70b',volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:10:50.278409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.278998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.279670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.280110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.455728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:50.471171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d474121-ba56-40e6-a0f2-f4dc62cd8d83 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.242706 Feb 12 21:10:50.471772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1200/2347] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:50 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:50.477520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9e9931b8-a297-4510-82fc-53b8e3c6d1ee req-83e13023-570f-4ca4-b1b2-b9753959ce76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42793e4d-48dd-4081-bd66-942f8df5fa65", "tag": "2892cb32-6dec-4f9c-8027-ac60fc70109c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:50.479292 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:50.479292 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:50.486722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9e9931b8-a297-4510-82fc-53b8e3c6d1ee req-83e13023-570f-4ca4-b1b2-b9753959ce76 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.487430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9e9931b8-a297-4510-82fc-53b8e3c6d1ee req-83e13023-570f-4ca4-b1b2-b9753959ce76 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.505325 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9e9931b8-a297-4510-82fc-53b8e3c6d1ee req-83e13023-570f-4ca4-b1b2-b9753959ce76 service nova] Creating event network-changed:2892cb32-6dec-4f9c-8027-ac60fc70109c for instance 42793e4d-48dd-4081-bd66-942f8df5fa65 on nch2-master-1 Feb 12 21:10:50.509441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9e9931b8-a297-4510-82fc-53b8e3c6d1ee req-83e13023-570f-4ca4-b1b2-b9753959ce76 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035846 Feb 12 21:10:50.510537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1201/2348] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:50.517245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:50.518435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:50.542860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.544833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.547348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.548669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.744707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:50.754968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:50.756883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:50.758448 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb212ee4-719d-463b-b791-d9e06e767806 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.246576 Feb 12 21:10:50.759313 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1202/2349] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:50 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:50.771803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-067db76b-409c-47c2-8033-234a1cfd388f tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Action: 'create', calling method: .version_select at 0x7fa8fe164940>, body: {"keypair": {"name": "tempest-keypair-1465230189"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:50.791537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-067db76b-409c-47c2-8033-234a1cfd388f tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:50.797134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-067db76b-409c-47c2-8033-234a1cfd388f tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:50.936739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-067db76b-409c-47c2-8033-234a1cfd388f tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:50.945263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-067db76b-409c-47c2-8033-234a1cfd388f tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:50.961717 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-067db76b-409c-47c2-8033-234a1cfd388f tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.201423 Feb 12 21:10:50.962320 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1203/2350] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:10:50 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:50.968206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:50.968206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:50.975664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.976778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:50.977614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:50.978054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.191532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:51.200096 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-601c0b4f-2cf0-40d4-bb1e-c01a282cdc72 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.236634 Feb 12 21:10:51.200791 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1204/2351] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:50 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:51.218400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:51.219708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:51.225883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.226496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.227313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.227758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.464603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:51.477270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:51.479889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:51.481698 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c77c9db1-c51d-41af-93cb-ace96f7d3783 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.267042 Feb 12 21:10:51.482864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1205/2352] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:51 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:51.487946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6", "name": "network-vif-plugged", "status": "completed", "tag": "e38f0d55-536c-4032-855c-af42ba5ed8b7"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "f256d627-df49-4516-b949-fc05f0dbf0bc"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "c24391d7-58a5-450b-bfb5-2e331131b9e0"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-plugged", "status": "completed", "tag": "1fe06461-27fb-4282-97ba-13fca702a547"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:51.491007 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:51.491007 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:51.504372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.504372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.518185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Creating event network-vif-plugged:e38f0d55-536c-4032-855c-af42ba5ed8b7 for instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 on nch2-master-1 Feb 12 21:10:51.518702 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Creating event network-vif-plugged:f256d627-df49-4516-b949-fc05f0dbf0bc for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:51.519209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Creating event network-vif-plugged:c24391d7-58a5-450b-bfb5-2e331131b9e0 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:51.519714 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] Creating event network-vif-plugged:1fe06461-27fb-4282-97ba-13fca702a547 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:51.534973 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4fba6de9-1fdf-4d74-9815-09645d129820 req-777f8110-3ec1-4343-bb7d-9106c9a78dbf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.048394 Feb 12 21:10:51.546497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1206/2353] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:51.546497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6cb10e8e-6867-4206-8ed1-88f793c4c056 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe19d940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:51.567750 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d6324944-1733-4440-8a9d-36b92424de26 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.049312 Feb 12 21:10:51.575598 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1148/2354] 10.222.0.31 () {62 vars in 1188 bytes} [Sat Feb 12 21:10:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 6058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:10:51.581869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:51.582880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:51.666310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.666310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.666310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.666310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.677829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6cb10e8e-6867-4206-8ed1-88f793c4c056 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465230189" status: 202 len: 0 microversion: 2.1 time: 0.137260 Feb 12 21:10:51.697759 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1207/2355] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465230189 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:10:51.697759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:51.697759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:51.698357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.698801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.699596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:51.700029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:51.965039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:51.973865 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8dbca535-8b64-4336-be77-9f050055e25a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.396749 Feb 12 21:10:51.974816 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1149/2356] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:51 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:51.979680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-838bc883-3e7e-4d6a-9f64-85cbbe652b69 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:51.980487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-838bc883-3e7e-4d6a-9f64-85cbbe652b69 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:51.997103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.004963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac812c14-6713-45a2-9929-6516a0ae61e3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.319464 Feb 12 21:10:52.013757 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1208/2357] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:51 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:52.020345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-366f72da-8d2b-432e-8097-5decd81c77c8 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Action: 'create', calling method: .version_select at 0x7fa8fe170430>, body: {"keypair": {"name": "tempest-keypair-291945161", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:52.037632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-366f72da-8d2b-432e-8097-5decd81c77c8 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:52.043238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-366f72da-8d2b-432e-8097-5decd81c77c8 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:52.048780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-838bc883-3e7e-4d6a-9f64-85cbbe652b69 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.067199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-838bc883-3e7e-4d6a-9f64-85cbbe652b69 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.067199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-838bc883-3e7e-4d6a-9f64-85cbbe652b69 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.069518 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-838bc883-3e7e-4d6a-9f64-85cbbe652b69 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1286 microversion: 2.32 time: 0.093606 Feb 12 21:10:52.070709 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1150/2358] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:51 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:52.075630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:52.076248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:52.083260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:52.083684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:52.084510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:52.084906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:52.170140 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-366f72da-8d2b-432e-8097-5decd81c77c8 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.154611 Feb 12 21:10:52.170756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1209/2359] 10.222.0.31 () {60 vars in 1158 bytes} [Sat Feb 12 21:10:52 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:52.181827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de6ecefd-6623-4890-804e-571c3fc9dfdb tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe24df70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:52.280684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.290747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.292573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.296611 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2ccc887-dee5-4372-9439-37dee9021d82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.224444 Feb 12 21:10:52.297588 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de6ecefd-6623-4890-804e-571c3fc9dfdb tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291945161" status: 202 len: 0 microversion: 2.1 time: 0.121242 Feb 12 21:10:52.298601 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1210/2360] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291945161 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:10:52.312748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1151/2361] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:52 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:52.316039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:52.317082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:52.317712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25bfa929-daa4-46b6-b89d-0d9cbe049c77 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Action: 'create', calling method: .version_select at 0x7fa907fdb310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1235179136"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:52.330942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:52.331578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:52.332638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:52.333225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:52.337212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-25bfa929-daa4-46b6-b89d-0d9cbe049c77 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:52.345187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-25bfa929-daa4-46b6-b89d-0d9cbe049c77 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:52.521803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.531360 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-95ef39e2-1873-48d6-be29-a12b46aaca2e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.231221 Feb 12 21:10:52.532577 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1211/2362] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:52 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:52.544016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:52.550312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:52.553211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:52.553965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:52.572695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:52.573566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:52.740675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-25bfa929-daa4-46b6-b89d-0d9cbe049c77 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:52.761779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-25bfa929-daa4-46b6-b89d-0d9cbe049c77 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:52.793394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25bfa929-daa4-46b6-b89d-0d9cbe049c77 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.479149 Feb 12 21:10:52.794980 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1152/2363] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:10:52 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:52.804580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36d88c76-77ac-40b0-9f4f-ea41efca3b60 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Action: 'create', calling method: .version_select at 0x7fa907e523a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1855934263"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:52.820478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.831387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.843465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:52.844836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-36d88c76-77ac-40b0-9f4f-ea41efca3b60 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:52.848364 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f935ce74-9b5f-4cc6-a91d-2b32e684c7e4 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.312303 Feb 12 21:10:52.857722 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1212/2364] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:52 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:52.865334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-36d88c76-77ac-40b0-9f4f-ea41efca3b60 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:52.991976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:52.993178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:53.004377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.005073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.005677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.006496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.172965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-36d88c76-77ac-40b0-9f4f-ea41efca3b60 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:53.178580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-36d88c76-77ac-40b0-9f4f-ea41efca3b60 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:53.197984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36d88c76-77ac-40b0-9f4f-ea41efca3b60 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.397252 Feb 12 21:10:53.200852 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1153/2365] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:10:52 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:53.211098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.213777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:53.221755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.222093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.222093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.222739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.223419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.231647 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3648072-1a75-4160-bade-17ea6209ea1c tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.244495 Feb 12 21:10:53.232430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1213/2366] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:52 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:53.252066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff2e47cf-785e-48dd-99b4-f30fbdd9d018 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.253603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff2e47cf-785e-48dd-99b4-f30fbdd9d018 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:53.360723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff2e47cf-785e-48dd-99b4-f30fbdd9d018 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.383168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff2e47cf-785e-48dd-99b4-f30fbdd9d018 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.384701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff2e47cf-785e-48dd-99b4-f30fbdd9d018 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.391908 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff2e47cf-785e-48dd-99b4-f30fbdd9d018 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1286 microversion: 2.32 time: 0.140027 Feb 12 21:10:53.392082 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1214/2367] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:53 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:53.394618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.411984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67969055-0677-4333-a4bd-851dae270747 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1307 microversion: 2.1 time: 0.208975 Feb 12 21:10:53.414083 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1154/2368] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:53 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:53.419626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.420938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:53.428135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f6bf6af-d5f5-4f00-a26b-4a8746b7a023 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Action: 'create', calling method: .version_select at 0x7fa8fe11b790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-103893212"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:53.434177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.434641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.435449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.436247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.448015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5f6bf6af-d5f5-4f00-a26b-4a8746b7a023 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:53.455351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5f6bf6af-d5f5-4f00-a26b-4a8746b7a023 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:53.613046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.622728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.624713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.626181 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b66aa84-fb8f-4f51-aafb-3113c402dbc8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.210783 Feb 12 21:10:53.639127 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1155/2369] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:53 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:53.644461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.645375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:53.653277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.654040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.660126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.660126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.767648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5f6bf6af-d5f5-4f00-a26b-4a8746b7a023 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:10:53.778330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5f6bf6af-d5f5-4f00-a26b-4a8746b7a023 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Getting quotas for user dde19386557c42fa9b7e6db7da4db4ac and project fc33e736e356438ebf9472994ba92131. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:10:53.821055 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f6bf6af-d5f5-4f00-a26b-4a8746b7a023 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.417342 Feb 12 21:10:53.822810 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1215/2370] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:10:53 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:53.841153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:53.845445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6287477e-d7ad-41be-a9ae-4f774b0dfd01 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe189550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.848888 ncdv-master-1 devstack@n-api.service[141727]: WARNING oslo_db.sqlalchemy.utils [None req-6287477e-d7ad-41be-a9ae-4f774b0dfd01 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 12 21:10:53.849496 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08388ee6-a5a3-4670-b29c-8ecca0c0b21b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.208927 Feb 12 21:10:53.851511 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1156/2371] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:53 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:53.859316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6287477e-d7ad-41be-a9ae-4f774b0dfd01 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs" status: 200 len: 1675 microversion: 2.1 time: 0.030087 Feb 12 21:10:53.861108 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1216/2372] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:10:53 2022] GET /compute/v2.1/os-keypairs => generated 1675 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:53.864893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.871750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:53.873937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a831a0aa-399b-4d8e-8bab-0c51fa6fea18 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe1d7c10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:53.874798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.875630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.876459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:53.876954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:53.995225 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a831a0aa-399b-4d8e-8bab-0c51fa6fea18 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-103893212" status: 202 len: 0 microversion: 2.1 time: 0.125626 Feb 12 21:10:53.996099 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1217/2373] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-103893212 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:10:54.004286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c89d6b0e-7523-4dad-a5e0-036f7cc0c237 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fe19dca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:54.139587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.149846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.151367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.152679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1ff72d0-11bf-4c86-91e3-a27255c4ff7b tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1874 microversion: 2.42 time: 0.292527 Feb 12 21:10:54.158791 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1157/2374] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:53 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1874 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:54.185514 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c89d6b0e-7523-4dad-a5e0-036f7cc0c237 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1855934263" status: 202 len: 0 microversion: 2.1 time: 0.184139 Feb 12 21:10:54.190166 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1218/2375] 10.222.0.31 () {58 vars in 1277 bytes} [Sat Feb 12 21:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1855934263 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:10:54.200342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2e66321-a975-4633-90b9-bda6d594dbd7 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] Calling method '.version_select at 0x7fa8fd9095e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:54.248096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:54.248736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:54.255949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.256406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.257781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.258393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.332560 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2e66321-a975-4633-90b9-bda6d594dbd7 tempest-KeyPairsV2TestJSON-1471188037 tempest-KeyPairsV2TestJSON-1471188037-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1235179136" status: 202 len: 0 microversion: 2.1 time: 0.138363 Feb 12 21:10:54.333330 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1158/2376] 10.222.0.31 () {58 vars in 1277 bytes} [Sat Feb 12 21:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1235179136 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:10:54.409741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:54.410380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:54.421576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.424811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.431751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.432224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.500739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.533943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65fc4578-989a-4e84-b4ee-fc3f97404da8 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.289414 Feb 12 21:10:54.534544 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1219/2377] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:54 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:54.552442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:54.553017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:54.572407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.572872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.573718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.574180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.627016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.680827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.682307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.683494 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81d64897-7898-4a6e-aba8-62d315923cbf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1576 microversion: 2.32 time: 0.277891 Feb 12 21:10:54.694426 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1159/2378] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:54 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1576 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:54.694426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:54.694426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:54.701608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.704457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.704457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.704457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.813748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:54.822963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-68369a01-ba83-455c-ad35-24809f3916d1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1485 microversion: 2.1 time: 0.274173 Feb 12 21:10:54.824466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1220/2379] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:54 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1485 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:54.849300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:54.850472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:54.864155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.864627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:54.865483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:54.865929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.004126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.039934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.042506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.044335 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9228e093-f68d-4ad5-a9bc-cbe178c95994 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.357239 Feb 12 21:10:55.045434 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1160/2380] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:54 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:55.067511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:55.067511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:55.080364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.080829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.081690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.082706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.123629 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4b2f2965-63fc-454d-86a9-c786dd6efdab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6/action" status: 202 len: 0 microversion: 2.1 time: 0.287217 Feb 12 21:10:55.126157 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1221/2381] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:10:54 2022] POST /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:10:55.135411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:55.136411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:55.144302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.145478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.154796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.154796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.361094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.369629 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9881bc5c-d557-4809-9f2a-f88dce978ed1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1490 microversion: 2.1 time: 0.239062 Feb 12 21:10:55.371467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.378190 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1222/2382] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:55 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1490 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:55.384102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:55.384709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:55.388909 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-753ca09b-69be-40c1-97c6-c24efe8e2a8c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.341710 Feb 12 21:10:55.393238 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1161/2383] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:55 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:55.401086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.401086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.401086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.401086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.551978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:55.552603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:55.560530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.562506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.562506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.563044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.776768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.792233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.793900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.795847 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-92c052e3-5026-4c70-8589-a3d4750ea3f7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2834 microversion: 2.42 time: 0.416689 Feb 12 21:10:55.809294 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1223/2384] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:55 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2834 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:55.820498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:55.823747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:55.841318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.841318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.841318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.841318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.900737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.918552 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd9d4e5d-6cfb-4076-b7ab-97285dd0434a tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.370791 Feb 12 21:10:55.921496 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1162/2385] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:55 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:55.926835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:55.928412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:55.935754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.936266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.937254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:55.937886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:55.969201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.982399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.986255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:55.988982 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-177959b8-5d67-4640-bba9-a017b8bd09eb tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1594 microversion: 2.32 time: 0.190727 Feb 12 21:10:55.990093 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1224/2386] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:55 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1594 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:56.063375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:56.064014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:56.076071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.076996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.078611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.078843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.293449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:56.304029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:56.305996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:56.307593 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-664e60f0-8114-4f3c-b98e-7d508d9e334c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.248734 Feb 12 21:10:56.309014 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1225/2387] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:56 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:10:56.316644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9cd44df8-b533-4326-be7b-b0d7fb454690 req-55ea9471-7db3-4bed-8f82-96db0e09b566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42793e4d-48dd-4081-bd66-942f8df5fa65", "name": "network-vif-plugged", "status": "completed", "tag": "2892cb32-6dec-4f9c-8027-ac60fc70109c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:56.320968 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:56.320968 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:10:56.328821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9cd44df8-b533-4326-be7b-b0d7fb454690 req-55ea9471-7db3-4bed-8f82-96db0e09b566 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.330236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9cd44df8-b533-4326-be7b-b0d7fb454690 req-55ea9471-7db3-4bed-8f82-96db0e09b566 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.343867 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9cd44df8-b533-4326-be7b-b0d7fb454690 req-55ea9471-7db3-4bed-8f82-96db0e09b566 service nova] Creating event network-vif-plugged:2892cb32-6dec-4f9c-8027-ac60fc70109c for instance 42793e4d-48dd-4081-bd66-942f8df5fa65 on nch2-master-1 Feb 12 21:10:56.349092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9cd44df8-b533-4326-be7b-b0d7fb454690 req-55ea9471-7db3-4bed-8f82-96db0e09b566 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038457 Feb 12 21:10:56.350040 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1226/2388] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:56.397861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:56.399568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:56.407062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.408043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.409142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.409618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.526059 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c5ce5b6-f41d-4ca4-8db2-58bfa8374a13 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.605195 Feb 12 21:10:56.528088 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1163/2389] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 21:10:55 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7/os-interface => generated 1833 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:56.532918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:56.533781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:56.541339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.543359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.543359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.544000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.821530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:56.834717 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2bcd37f5-c0d2-4768-bfb4-ae50e66d3dad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 200 len: 1470 microversion: 2.1 time: 0.442468 Feb 12 21:10:56.836028 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1227/2390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:56 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:56.855579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-121221032"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:56.857724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:56.864474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.864925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.865846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:56.866283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:56.960882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:56.972229 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df9b75de-53b2-40c6-a407-944205c06cab tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.442878 Feb 12 21:10:56.981682 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1164/2391] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:56 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:56.993628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:56.994728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:57.011064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:57.013597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:57.018330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:57.018844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:57.309171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.318308 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fbdd23ec-910e-4bb8-9b60-cd34b51e974f tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.335184 Feb 12 21:10:57.342871 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1165/2392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:56 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:57.342871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:57.342871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:57.353762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:57.354483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:57.355039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:57.357690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:57.454887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.467615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.469123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.475423 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6237c4e1-667c-463b-964a-6f0193529dcf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1594 microversion: 2.32 time: 0.146587 Feb 12 21:10:57.486437 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1166/2393] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:57 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:57.500552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:57.501159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:57.511129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:57.511579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:57.512393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:57.512829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:57.631813 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea2671e3-fe79-4ee5-83a6-2409470fe9e6 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6/action" status: 202 len: 0 microversion: 2.1 time: 0.779799 Feb 12 21:10:57.634289 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1228/2394] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:10:56 2022] POST /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Feb 12 21:10:57.662142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a93c1d71-5de8-4317-94d8-03526ad9c465 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe11b820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:57.746523 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a93c1d71-5de8-4317-94d8-03526ad9c465 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.090069 Feb 12 21:10:57.750430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1229/2395] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:10:57 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:57.958802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.971534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.976048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:57.978809 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5dacadfc-3ef0-47a7-a651-834bc1da1511 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.490098 Feb 12 21:10:57.979407 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1167/2396] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:57 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:57.994817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:57.996138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:58.020639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:58.021108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:58.030741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:58.031215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:58.362212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:58.363140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:58.389434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:58.399898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:58.403497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:58.405842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:58.473105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:58.488406 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a193a32-fb46-4c3c-adbc-e7662dbb1003 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1324 microversion: 2.1 time: 0.498828 Feb 12 21:10:58.490736 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1230/2397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:57 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:58.510850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:58.511471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:58.535561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:58.536023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:58.537338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:58.537813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:58.921731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:58.936796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:58.938871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:58.941318 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c6288ad-c69b-42de-a267-c598832408b3 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1662 microversion: 2.32 time: 0.433436 Feb 12 21:10:58.942999 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1231/2398] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:58 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1662 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:58.945579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:58.954660 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b53569a-ac5e-423d-b445-271e705ef166 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1472 microversion: 2.1 time: 0.600389 Feb 12 21:10:58.968228 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1168/2399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:58 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:10:58.974518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6866b13b-572a-4b53-89f3-5cd7a846ad3c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd909700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:59.068898 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6866b13b-572a-4b53-89f3-5cd7a846ad3c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.097975 Feb 12 21:10:59.070081 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1169/2400] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:10:58 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:10:59.080841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:59.081753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:59.099881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.100606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.101898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.102513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.200740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c05fb0e-c552-4958-8e8e-780a7d9d2e2d tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Calling method '.version_select at 0x7fa8fe0dc820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:59.227018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c05fb0e-c552-4958-8e8e-780a7d9d2e2d tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.227474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c05fb0e-c552-4958-8e8e-780a7d9d2e2d tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.228299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c05fb0e-c552-4958-8e8e-780a7d9d2e2d tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.228756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c05fb0e-c552-4958-8e8e-780a7d9d2e2d tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.334993 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c05fb0e-c552-4958-8e8e-780a7d9d2e2d tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] 10.222.0.31 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.391015 Feb 12 21:10:59.338637 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1232/2401] 10.222.0.31 () {58 vars in 1121 bytes} [Sat Feb 12 21:10:58 2022] GET /compute/v2.1/limits => generated 511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:59.394032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:59.394707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:59.410615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.411076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.416213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.416213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.587040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:59.597812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:59.618272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:59.620910 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5facb9b4-3ede-41ec-b68b-36a3d4d7088e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.549640 Feb 12 21:10:59.625995 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1170/2402] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:59 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:59.643848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-81f5156f-ebd8-452f-98cd-f8aa7465e778 req-b5f4b8b5-d864-4f0c-8dd7-3a1326f917a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "tag": "4d209389-a95f-430a-95ec-f6d0b38d85a6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:59.646016 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:10:59.646016 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:10:59.655731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81f5156f-ebd8-452f-98cd-f8aa7465e778 req-b5f4b8b5-d864-4f0c-8dd7-3a1326f917a6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.656480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81f5156f-ebd8-452f-98cd-f8aa7465e778 req-b5f4b8b5-d864-4f0c-8dd7-3a1326f917a6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.676797 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-81f5156f-ebd8-452f-98cd-f8aa7465e778 req-b5f4b8b5-d864-4f0c-8dd7-3a1326f917a6 service nova] Creating event network-changed:4d209389-a95f-430a-95ec-f6d0b38d85a6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:10:59.686106 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-81f5156f-ebd8-452f-98cd-f8aa7465e778 req-b5f4b8b5-d864-4f0c-8dd7-3a1326f917a6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058149 Feb 12 21:10:59.687302 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1171/2403] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:10:59.694716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-459301373", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:10:59.793118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:10:59.795577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:59.808716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:59.810272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:10:59.817660 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-007a4335-f2fa-469e-af45-e5cef5dd0b02 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2834 microversion: 2.42 time: 0.433771 Feb 12 21:10:59.818704 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1233/2404] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:10:59 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2834 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:10:59.829300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:10:59.829962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:10:59.844100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.844563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:10:59.845388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:10:59.845843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.168235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:00.181855 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a75f759-bd2c-4e28-a3c5-eed3bb668568 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 200 len: 1519 microversion: 2.1 time: 0.361873 Feb 12 21:11:00.182467 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1234/2405] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:10:59 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 1519 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:00.206373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:00.206885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:00.219216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.219724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.220475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.220912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.235082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Getting quotas for project e44436b561da46a5a8cec71d728622a0. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:00.248416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Getting quotas for user 555dcf52fc394f53a02d35827148ca00 and project e44436b561da46a5a8cec71d728622a0. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:00.288768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Feb 12 21:11:00.290409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:00.292698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1fef8a1-eb73-46a6-868b-700545781768 tempest-AbsoluteLimitsNegativeTestJSON-909267559 tempest-AbsoluteLimitsNegativeTestJSON-909267559-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.604152 Feb 12 21:11:00.297159 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1172/2406] 10.222.0.31 () {60 vars in 1147 bytes} [Sat Feb 12 21:10:59 2022] POST /compute/v2.1/servers => generated 87 bytes in 607 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:00.310175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:00.312704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:00.337763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.340751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.341897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.343052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.603280 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d55c9b1d-ddc0-45c4-9a65-cccdad71d692 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.404849 Feb 12 21:11:00.610755 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1235/2407] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 21:11:00 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7/os-interface => generated 1833 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:00.611499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:00.624202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:00.634509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.635652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.636518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.637167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.811306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:00.830510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:00.832845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:00.839094 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bfce1c17-c7e4-4443-900e-d69004a9cf15 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1709 microversion: 2.32 time: 0.540207 Feb 12 21:11:00.839772 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1173/2408] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:00 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1709 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:00.859250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92187643-4e7f-45c0-89a6-339da0b7e94f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd909280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:00.936372 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92187643-4e7f-45c0-89a6-339da0b7e94f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.081831 Feb 12 21:11:00.942916 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1174/2409] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:00 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:00.949134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.141"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:00.950772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:00.957626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.958417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:00.959484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:00.960899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:01.036125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Acquired lock "refresh_cache-0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:11:01.258341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:01.272478 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d6e1cc4-cf41-4875-8146-6be71a1ee527 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1478 microversion: 2.1 time: 0.663764 Feb 12 21:11:01.274880 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1236/2410] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:00 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1478 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:01.297245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:01.297913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:01.315352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:01.316180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:01.317160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:01.317833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:01.602374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:01.621759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:01.624895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:01.625883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d03a227-efc8-4776-8668-cb6e9b6fc1d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.342924 Feb 12 21:11:01.637822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1237/2411] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:01 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:01.857789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:01.858233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:01.875710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:01.879028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:01.888241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:01.891057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:02.295536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.308977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.311158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.312632 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-39831603-405a-456b-97ca-32809668dcd4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1756 microversion: 2.32 time: 0.459296 Feb 12 21:11:02.313800 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1238/2412] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:01 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1756 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:02.318462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0552c2f4-dbd0-457b-afb5-784759d78963 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe164280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:02.392371 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0552c2f4-dbd0-457b-afb5-784759d78963 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.076499 Feb 12 21:11:02.405786 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1239/2413] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:02 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:02.418895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:02.419698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:02.426349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:02.436145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:02.436145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:02.436145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:02.708040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.717697 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-76ef748b-8fd1-4401-ad2f-e8c53904d4c6 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1478 microversion: 2.1 time: 0.310512 Feb 12 21:11:02.718863 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1240/2414] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:02 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1478 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:02.725168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:02.730535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:02.743530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:02.745742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:02.751736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:02.752450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:02.972825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.988791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.993788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:02.995819 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2862e617-9260-4874-9fe4-83d27456efaa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.275398 Feb 12 21:11:02.996974 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1241/2415] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:02 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:03.237822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c7ab692e-6254-4a6e-bad2-a9eddc8a3248 req-8d9ba21a-0032-4009-94c0-9dbe7cf39cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "name": "network-vif-unplugged", "status": "completed", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:03.239985 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:03.239985 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:03.258791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c7ab692e-6254-4a6e-bad2-a9eddc8a3248 req-8d9ba21a-0032-4009-94c0-9dbe7cf39cf5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:03.259616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c7ab692e-6254-4a6e-bad2-a9eddc8a3248 req-8d9ba21a-0032-4009-94c0-9dbe7cf39cf5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:03.284369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c7ab692e-6254-4a6e-bad2-a9eddc8a3248 req-8d9ba21a-0032-4009-94c0-9dbe7cf39cf5 service nova] Creating event network-vif-unplugged:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:11:03.296487 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c7ab692e-6254-4a6e-bad2-a9eddc8a3248 req-8d9ba21a-0032-4009-94c0-9dbe7cf39cf5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062326 Feb 12 21:11:03.302434 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1242/2416] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:03.337547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:03.338351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:03.346957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:03.347550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:03.348468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:03.348985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:03.786093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:03.796441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:03.799138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:03.802829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-371d726d-cdd0-4bb5-8e14-35346f884e66 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1756 microversion: 2.32 time: 0.469021 Feb 12 21:11:03.802829 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1243/2417] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:03 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1756 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:03.823070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7848613b-4fc0-49e5-8076-ba832aa99ddf tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe164d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:04.676567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Building network info cache for instance {{(pid=141726) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:11:06.213878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Updating instance_info_cache with network_info: [{"id": "c0e4abe5-512a-438d-9ee8-c182fa52f022", "address": "fa:16:3e:85:dc:01", "network": {"id": "0667fd4a-8e2d-4583-adf6-fead39b333d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-435642992-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9627e1d31e814deb8265e43f63ac807c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc0e4abe5-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:11:06.341799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Releasing lock "refresh_cache-0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:11:06.343058 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66d76924-30f6-4c55-a2d5-8a23fb6f28d9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action" status: 202 len: 0 microversion: 2.1 time: 5.398796 Feb 12 21:11:06.343900 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1175/2418] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:00 2022] POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action => generated 0 bytes in 5400 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:11:06.349273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:06.350689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:06.366799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:06.367736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:06.369904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:06.371951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:06.621257 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7848613b-4fc0-49e5-8076-ba832aa99ddf tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 2.817454 Feb 12 21:11:06.621907 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1244/2419] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:03 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:06.636945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:06.637595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:06.655934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:06.657295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:06.658470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:06.660353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:06.895921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:06.917960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f0676b2-bede-4144-b287-3b7a24befb31 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1478 microversion: 2.1 time: 0.571440 Feb 12 21:11:06.919230 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1176/2420] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:06 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1478 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:06.926443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-29050bff-bb2d-4382-a628-861e96c3a1f8 req-848cae6a-b36f-444a-b940-d08a7e99dca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:06.935342 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:06.935342 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:06.965335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-29050bff-bb2d-4382-a628-861e96c3a1f8 req-848cae6a-b36f-444a-b940-d08a7e99dca1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:06.965823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-29050bff-bb2d-4382-a628-861e96c3a1f8 req-848cae6a-b36f-444a-b940-d08a7e99dca1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:06.993331 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-29050bff-bb2d-4382-a628-861e96c3a1f8 req-848cae6a-b36f-444a-b940-d08a7e99dca1 service nova] Creating event network-changed:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:11:07.009779 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-29050bff-bb2d-4382-a628-861e96c3a1f8 req-848cae6a-b36f-444a-b940-d08a7e99dca1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086635 Feb 12 21:11:07.016987 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1177/2421] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:07.029920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:07.029920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:07.047102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:07.047280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:07.049285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:07.050197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:07.098283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:07.118625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:07.126884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:07.136377 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-024e417e-d4eb-4437-bc73-3fb552df8422 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1739 microversion: 2.20 time: 0.513041 Feb 12 21:11:07.138695 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1245/2422] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:06 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1739 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:07.146490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-13845e70-7935-4564-836c-257e8b84af4d req-6a054970-c531-4f13-af5b-4a2c1ee4669d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6", "name": "network-vif-plugged", "status": "completed", "tag": "e38f0d55-536c-4032-855c-af42ba5ed8b7"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:07.165192 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:07.165192 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:07.186423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-13845e70-7935-4564-836c-257e8b84af4d req-6a054970-c531-4f13-af5b-4a2c1ee4669d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:07.190818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-13845e70-7935-4564-836c-257e8b84af4d req-6a054970-c531-4f13-af5b-4a2c1ee4669d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:07.210968 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-13845e70-7935-4564-836c-257e8b84af4d req-6a054970-c531-4f13-af5b-4a2c1ee4669d service nova] Creating event network-vif-plugged:e38f0d55-536c-4032-855c-af42ba5ed8b7 for instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 on nch2-master-1 Feb 12 21:11:07.244296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-13845e70-7935-4564-836c-257e8b84af4d req-6a054970-c531-4f13-af5b-4a2c1ee4669d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091505 Feb 12 21:11:07.248400 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1246/2423] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:07.267240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.141"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:07.269241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:07.281069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:07.281598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:07.285216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:07.285770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:07.349741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Acquired lock "refresh_cache-42793e4d-48dd-4081-bd66-942f8df5fa65" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:11:08.213599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:08.229993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:08.236172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:08.238069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-62314956-c5f3-41b8-bdef-dde1ae6dea51 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1838 microversion: 2.32 time: 1.219569 Feb 12 21:11:08.242234 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1178/2424] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:07 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1838 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:08.250652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bf83e433-f8e9-4dd5-91bb-dbf1e2061260 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd909ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:08.323302 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bf83e433-f8e9-4dd5-91bb-dbf1e2061260 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.079658 Feb 12 21:11:08.327445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1179/2425] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:08 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:08.537906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-620661499", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "54128c98-9bca-420b-9f5f-b82e242f4a33"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:08.610026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] validate_networks() for [('54128c98-9bca-420b-9f5f-b82e242f4a33', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:11:09.883369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:11:09.884118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:11:09.884253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:11:09.884669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:11:09.885079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:11:09.907094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:09.907464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:09.908282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:09.908719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:09.962534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Getting quotas for project 2e8686c8d8414bd0a886dd2e33c3daf5. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:09.969253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Getting quotas for user 1e22e951d6844d568a2fb90c8598e6b0 and project 2e8686c8d8414bd0a886dd2e33c3daf5. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:09.983945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Going to run 3 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:11:09.988180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:11:10.102309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=13154ac3-ea21-4e42-874e-47df8fc0774a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:11:10.247679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=8d94d265-92b9-424f-8314-b0fb321f73b5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:11:10.665920 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dfe8bdbb-162c-46ad-afe9-fa481b834fdc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.338771 Feb 12 21:11:10.666678 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1180/2426] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:11:10.676404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:10.684298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:10.690954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:10.691498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:10.692381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:10.692901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:11.130188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:11.141074 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-705c5bb5-fe1e-470d-a4f6-a3c4c1e52939 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1478 microversion: 2.1 time: 0.468226 Feb 12 21:11:11.150945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1181/2427] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:10 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1478 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:11.160720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:11.161252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:11.181974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:11.182832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:11.183857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:11.184420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:11.542739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.network.neutron [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] re-assign floating IP 172.35.2.141 from instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd Feb 12 21:11:11.617295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Building network info cache for instance {{(pid=141727) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:11:11.641549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:11.655226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:11.659326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:11.669557 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2f2296d-56dd-4457-965e-b946f482f9d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1721 microversion: 2.20 time: 0.517387 Feb 12 21:11:11.671215 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1182/2428] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:11 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1721 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:11.680955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:11.684170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:11.705198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:11.712423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:11.729474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:11.729474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.177185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:12.194010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:12.196148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:12.197336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7e815508-608c-4a7a-967d-219664def3af tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1859 microversion: 2.32 time: 0.522997 Feb 12 21:11:12.209726 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1183/2429] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:11 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1859 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:12.215682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f285ad0f-22e3-4f72-bad8-5695c4dfeef8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd90d4c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:12.310698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f285ad0f-22e3-4f72-bad8-5695c4dfeef8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.098719 Feb 12 21:11:12.316588 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1184/2430] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:12 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:12.321326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-74bac318-44e3-4b9b-b777-da18935ac679 req-9ab23565-1881-4d8f-8517-36fd3c33f6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "name": "network-vif-plugged", "status": "completed", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:12.323019 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:12.323019 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:12.352622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-74bac318-44e3-4b9b-b777-da18935ac679 req-9ab23565-1881-4d8f-8517-36fd3c33f6f1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.353080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-74bac318-44e3-4b9b-b777-da18935ac679 req-9ab23565-1881-4d8f-8517-36fd3c33f6f1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.391790 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-74bac318-44e3-4b9b-b777-da18935ac679 req-9ab23565-1881-4d8f-8517-36fd3c33f6f1 service nova] Creating event network-vif-plugged:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:11:12.428373 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-74bac318-44e3-4b9b-b777-da18935ac679 req-9ab23565-1881-4d8f-8517-36fd3c33f6f1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115869 Feb 12 21:11:12.431103 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1185/2431] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:12.438730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e97c484b-e46b-4688-865b-db527cc4bd7a req-65557326-956a-4063-bb8e-32eaf33a42e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "335b0423-e329-43fd-bea1-28e4856ef8b9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:12.440505 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:12.440505 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:12.465876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e97c484b-e46b-4688-865b-db527cc4bd7a req-65557326-956a-4063-bb8e-32eaf33a42e3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.466348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e97c484b-e46b-4688-865b-db527cc4bd7a req-65557326-956a-4063-bb8e-32eaf33a42e3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.494392 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e97c484b-e46b-4688-865b-db527cc4bd7a req-65557326-956a-4063-bb8e-32eaf33a42e3 service nova] Creating event network-changed:335b0423-e329-43fd-bea1-28e4856ef8b9 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:12.508320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e97c484b-e46b-4688-865b-db527cc4bd7a req-65557326-956a-4063-bb8e-32eaf33a42e3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067192 Feb 12 21:11:12.508320 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1186/2432] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:12.508508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:12.511781 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:12.511781 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:12.512858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:12.513944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:12.538318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.539355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.540404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.541123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.568285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3eb9fb3b-da4b-46be-aae8-1d6e35187532 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.064078 Feb 12 21:11:12.570638 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1187/2433] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:11:12 2022] GET /compute/v2.1/servers => generated 1015 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:12.575684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8f13ee77-dfc1-4c9a-b37d-5e828765574f req-56b9c13d-2495-4099-b536-ee1506efa46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:12.577689 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:12.577689 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:12.593015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8f13ee77-dfc1-4c9a-b37d-5e828765574f req-56b9c13d-2495-4099-b536-ee1506efa46a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.596713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8f13ee77-dfc1-4c9a-b37d-5e828765574f req-56b9c13d-2495-4099-b536-ee1506efa46a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.636916 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8f13ee77-dfc1-4c9a-b37d-5e828765574f req-56b9c13d-2495-4099-b536-ee1506efa46a service nova] Creating event network-changed:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:11:12.646180 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8f13ee77-dfc1-4c9a-b37d-5e828765574f req-56b9c13d-2495-4099-b536-ee1506efa46a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074001 Feb 12 21:11:12.652901 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1188/2434] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:12.664002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:12.671183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:12.699790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.700459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:12.701464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:12.703460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:13.106334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Updating instance_info_cache with network_info: [{"id": "c0e4abe5-512a-438d-9ee8-c182fa52f022", "address": "fa:16:3e:85:dc:01", "network": {"id": "0667fd4a-8e2d-4583-adf6-fead39b333d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-435642992-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9627e1d31e814deb8265e43f63ac807c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc0e4abe5-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:11:13.217857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Building network info cache for instance {{(pid=141727) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:11:13.222765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:13.231796 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c6a0b18-39d5-4f31-a134-ff86d1e5c9a1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1478 microversion: 2.1 time: 0.577280 Feb 12 21:11:13.244231 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1189/2435] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:12 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1478 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:13.253256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d70a12a0-fefc-4653-81d3-cc5c72f2d6b0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:13.254217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d70a12a0-fefc-4653-81d3-cc5c72f2d6b0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:13.442520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d70a12a0-fefc-4653-81d3-cc5c72f2d6b0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:13.458606 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d70a12a0-fefc-4653-81d3-cc5c72f2d6b0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1222 microversion: 2.1 time: 0.209499 Feb 12 21:11:13.459307 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1190/2436] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:13 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:13.469560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:13.470366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:13.484757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:13.487707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:13.488639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:13.492248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:14.057300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:14.069016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:14.074025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:14.077253 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-445bb8c6-ea7f-4efc-ac79-5759f6471461 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1664 microversion: 2.20 time: 0.614200 Feb 12 21:11:14.079823 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1191/2437] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:13 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1664 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:14.087540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:14.090376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:14.105838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:14.107580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:14.108616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:14.110057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:14.448346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Updating instance_info_cache with network_info: [{"id": "2892cb32-6dec-4f9c-8027-ac60fc70109c", "address": "fa:16:3e:b0:72:bb", "network": {"id": "0667fd4a-8e2d-4583-adf6-fead39b333d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-435642992-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9627e1d31e814deb8265e43f63ac807c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2892cb32-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:11:14.562676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Releasing lock "refresh_cache-42793e4d-48dd-4081-bd66-942f8df5fa65" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:11:14.563627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e65cd975-3d4c-4dca-b9cc-bc518d70512e tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65/action" status: 202 len: 0 microversion: 2.1 time: 7.310577 Feb 12 21:11:14.564347 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1247/2438] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:07 2022] POST /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65/action => generated 0 bytes in 7315 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:11:14.571707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-189f58a5-c3d8-44d5-b9c2-63551562c42e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe11b3a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:14.652787 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-189f58a5-c3d8-44d5-b9c2-63551562c42e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.087218 Feb 12 21:11:14.654465 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1248/2439] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:14 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:14.667961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5583872c-2e0a-476f-bbb0-bfbbf03d7db2"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:14.674002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:14.681100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:14.688972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:14.690174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:14.690805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:14.711297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:14.725679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:14.731157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:14.733617 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0123ab4c-7e0d-4c3d-ad21-11d074ca75ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.650177 Feb 12 21:11:14.746837 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1192/2440] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:14 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:14.758603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:14.759242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:14.774270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:14.777007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:14.777926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:14.781558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:15.058482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:15.067703 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6bb4a81a-16db-4af4-aa23-f64d982c5971 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1463 microversion: 2.1 time: 0.319863 Feb 12 21:11:15.071391 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1193/2441] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:14 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:15.099498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:15.100530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:15.112487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:15.117067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:15.117067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:15.117526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:15.281032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:15.292703 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ed2d3b7-6efa-42b9-810a-934d67649bdd tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1226 microversion: 2.1 time: 0.207988 Feb 12 21:11:15.313174 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1194/2442] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:15 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1226 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:15.313174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3e23a85b-c53f-433b-9515-1bda5a2b7f91 req-0628b139-7b46-4637-9bbe-f35395efa849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "17ba1c7f-90cf-4f91-a05e-68927bcbe7cc"}, {"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "db0ca88d-7497-4c86-9f77-a0e7753f1866"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:15.317321 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:15.317321 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:15.340835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3e23a85b-c53f-433b-9515-1bda5a2b7f91 req-0628b139-7b46-4637-9bbe-f35395efa849 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:15.341505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3e23a85b-c53f-433b-9515-1bda5a2b7f91 req-0628b139-7b46-4637-9bbe-f35395efa849 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:15.381285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3e23a85b-c53f-433b-9515-1bda5a2b7f91 req-0628b139-7b46-4637-9bbe-f35395efa849 service nova] Creating event network-changed:17ba1c7f-90cf-4f91-a05e-68927bcbe7cc for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:15.381900 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3e23a85b-c53f-433b-9515-1bda5a2b7f91 req-0628b139-7b46-4637-9bbe-f35395efa849 service nova] Creating event network-changed:db0ca88d-7497-4c86-9f77-a0e7753f1866 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:15.400895 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3e23a85b-c53f-433b-9515-1bda5a2b7f91 req-0628b139-7b46-4637-9bbe-f35395efa849 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085345 Feb 12 21:11:15.408781 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1195/2443] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:15.432019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d0ac374f-86bf-43fe-8730-4c60629cd14d req-53e89ab1-ab21-4817-8b2f-10ebd085fe07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "name": "network-vif-unplugged", "status": "completed", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:15.438680 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:15.438680 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:15.467953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d0ac374f-86bf-43fe-8730-4c60629cd14d req-53e89ab1-ab21-4817-8b2f-10ebd085fe07 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:15.469034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d0ac374f-86bf-43fe-8730-4c60629cd14d req-53e89ab1-ab21-4817-8b2f-10ebd085fe07 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:15.485750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.server_external_events [req-d0ac374f-86bf-43fe-8730-4c60629cd14d req-53e89ab1-ab21-4817-8b2f-10ebd085fe07 service nova] Unable to find a host for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514. Dropping event network-vif-unplugged {{(pid=141726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 21:11:15.488782 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d0ac374f-86bf-43fe-8730-4c60629cd14d req-53e89ab1-ab21-4817-8b2f-10ebd085fe07 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070158 Feb 12 21:11:15.488782 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1196/2444] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 78 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 12 21:11:15.501615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.141"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:16.210189 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-53e79f84-5532-43ba-afbf-11c22db62e58 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.554379 Feb 12 21:11:16.211958 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1249/2445] 10.222.0.31 () {62 vars in 1363 bytes} [Sat Feb 12 21:11:14 2022] POST /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments => generated 188 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:11:16.228330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-797b787e-fe53-41ff-afc8-d09f62743954 req-9613f8cf-cd80-49fd-9dc7-b44d92b20207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42793e4d-48dd-4081-bd66-942f8df5fa65", "tag": "2892cb32-6dec-4f9c-8027-ac60fc70109c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:16.240275 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:16.240275 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:16.268950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-797b787e-fe53-41ff-afc8-d09f62743954 req-9613f8cf-cd80-49fd-9dc7-b44d92b20207 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.280115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-797b787e-fe53-41ff-afc8-d09f62743954 req-9613f8cf-cd80-49fd-9dc7-b44d92b20207 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:16.312648 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-797b787e-fe53-41ff-afc8-d09f62743954 req-9613f8cf-cd80-49fd-9dc7-b44d92b20207 service nova] Creating event network-changed:2892cb32-6dec-4f9c-8027-ac60fc70109c for instance 42793e4d-48dd-4081-bd66-942f8df5fa65 on nch2-master-1 Feb 12 21:11:16.328864 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-797b787e-fe53-41ff-afc8-d09f62743954 req-9613f8cf-cd80-49fd-9dc7-b44d92b20207 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114711 Feb 12 21:11:16.330373 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1250/2446] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:16.386339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:16.394109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:16.423317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.437714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:16.441012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.441693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:16.612663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:16.620085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.625736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:16.625736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.625736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:16.798144 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-691e515d-0b20-4779-ad49-8cde2f8c1ca5 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 0 microversion: 2.1 time: 0.466160 Feb 12 21:11:16.799488 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1251/2447] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:16 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:11:16.812178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0dbe7b0f-218d-4f4b-9efb-da092a782858 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe189b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:16.907517 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0dbe7b0f-218d-4f4b-9efb-da092a782858 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.105714 Feb 12 21:11:16.908744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1252/2448] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:16 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:16.916738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:16.918162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:16.937051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.937051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:16.937925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:16.938361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.501053 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] HTTP exception thrown: Floating IP 172.35.2.141 is not associated with instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd. Feb 12 21:11:17.502838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Returning 409 to user: Floating IP 172.35.2.141 is not associated with instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:17.503820 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-18c32ffb-3b05-4950-927a-ae6d27776e36 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action" status: 409 len: 146 microversion: 2.1 time: 2.013649 Feb 12 21:11:17.505191 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1197/2449] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:15 2022] POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action => generated 146 bytes in 2016 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:17.514699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:17.515774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:17.523766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.524543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.525575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.526187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.628768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:17.642876 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-437a2af7-da59-4a34-8c75-74ccecf12038 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1280 microversion: 2.1 time: 0.131545 Feb 12 21:11:17.645196 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1198/2450] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:17 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:17.651584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:17.652517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:17.660367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.661313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.662352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.662800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.668412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:17.680165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:17.681819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:17.683118 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91247072-caf6-4ef0-80cd-37252c40233d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.772745 Feb 12 21:11:17.683683 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1253/2451] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:16 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:17.702129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:17.702772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:17.713163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.713163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.715845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.716576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.749725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.750175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.750663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lazy-loading 'fault' on Instance uuid fa7e1aca-9785-4119-a180-49e60318243e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:11:17.944618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ca1d8d8-4427-4b96-beec-21b3a65f97cc tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1597 microversion: 2.1 time: 0.247685 Feb 12 21:11:17.945197 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1254/2452] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:17 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1597 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:17.949618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c5b71725-c738-46a0-8d62-28e9a7161cb4 req-a8200715-c63a-4840-b650-6827547aeee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "b2910da7-aefa-45b5-ab32-c4167ae080b7"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:17.951549 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:17.951549 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:17.960214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c5b71725-c738-46a0-8d62-28e9a7161cb4 req-a8200715-c63a-4840-b650-6827547aeee4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:17.960939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c5b71725-c738-46a0-8d62-28e9a7161cb4 req-a8200715-c63a-4840-b650-6827547aeee4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:17.970198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67bd9d2b-347e-4a5f-ae34-3749b3aef82b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/action" status: 202 len: 0 microversion: 2.20 time: 0.323277 Feb 12 21:11:17.974287 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1199/2453] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:11:17 2022] POST /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:17.981229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.141"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:17.982439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c5b71725-c738-46a0-8d62-28e9a7161cb4 req-a8200715-c63a-4840-b650-6827547aeee4 service nova] Creating event network-changed:b2910da7-aefa-45b5-ab32-c4167ae080b7 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:17.991769 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c5b71725-c738-46a0-8d62-28e9a7161cb4 req-a8200715-c63a-4840-b650-6827547aeee4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044680 Feb 12 21:11:17.992785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1255/2454] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:18.002907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80049c16-a74f-431d-856e-fdafef4cadcd tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe06a700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:18.080497 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80049c16-a74f-431d-856e-fdafef4cadcd tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.084599 Feb 12 21:11:18.083675 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1256/2455] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:17 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:18.101648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:18.105782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:18.128662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:18.129897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:18.135389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:18.136935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:18.278721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:18.286080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:18.286924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:18.290292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:18.291264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:18.896242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-191595d7-f273-47d9-9d63-7e6385135310 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action" status: 202 len: 0 microversion: 2.1 time: 0.810029 Feb 12 21:11:18.903435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1257/2456] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:18 2022] POST /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:11:18.904495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:18.905332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:18.919707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:18.919981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:18.920734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:18.921508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:19.038919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Acquired lock "refresh_cache-42793e4d-48dd-4081-bd66-942f8df5fa65" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:11:19.284751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:19.301630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:19.301630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:19.301630 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa3b3e73-c3ed-435a-b3e5-dfa0d17fb414 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1750 microversion: 2.20 time: 0.398138 Feb 12 21:11:19.301630 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1258/2457] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:18 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1750 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:19.306517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:19.307150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:19.314055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:19.314585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:19.315435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:19.317392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:19.468104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:19.480165 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e42daf48-409b-4f52-aaa5-62dcb51d317a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1280 microversion: 2.1 time: 0.179905 Feb 12 21:11:19.488712 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1259/2458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:19 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:19.502928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:19.504071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:19.518535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:19.519358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:19.520452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:19.521332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:20.105412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:20.121105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:20.123242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:20.125085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-561cfb45-48f8-46ba-9fcc-debae737de72 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.634455 Feb 12 21:11:20.139996 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1260/2459] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:19 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:20.145240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:20.146120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:20.155689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:20.158926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:20.160080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:20.160606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:20.504162 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad41c530-e3d6-4e40-b3f8-228342a4f9d8 tempest-ServersAdminTestJSON-1977213929 tempest-ServersAdminTestJSON-1977213929-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1614 microversion: 2.1 time: 0.362645 Feb 12 21:11:20.512168 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1261/2460] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:20 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1614 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:20.526125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:20.527805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:20.541210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:20.542195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:20.543502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:20.544042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:20.619277 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-353d3f7a-53d5-41eb-9152-7a387c046a09 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "POST /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3/action" status: 200 len: 24543 microversion: 2.1 time: 0.105664 Feb 12 21:11:20.623537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1262/2461] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:20 2022] POST /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3/action => generated 24543 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:11:20.648462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5dae0562-c156-472c-82c6-9c59451cd491 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe0ce670>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:20.719112 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5dae0562-c156-472c-82c6-9c59451cd491 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.093039 Feb 12 21:11:20.720154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1263/2462] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:20 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:20.731448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:20.732424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:20.742285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:20.743046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:20.744029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:20.744638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:21.374500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:21.401617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:21.403748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:21.408053 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56696a25-ce77-4d14-bae2-1ca2c7bfbbe1 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1752 microversion: 2.20 time: 0.680704 Feb 12 21:11:21.409961 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1264/2463] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:20 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1752 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:21.422028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:21.422921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:21.437222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:21.441070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:21.442409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:21.444742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:21.720242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Building network info cache for instance {{(pid=141726) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:11:22.217634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:22.231664 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc6cdede-ccc9-45b2-b25b-204ec1079bf3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.816806 Feb 12 21:11:22.237953 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1265/2464] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:21 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:22.249415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:22.253825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:22.272808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:22.273310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:22.274207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:22.274660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:22.347215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:22.838895 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5ab7219-6362-4067-a96e-edd6a2b7d090 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "DELETE /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 204 len: 0 microversion: 2.1 time: 0.599375 Feb 12 21:11:22.839598 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1266/2465] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:22 2022] DELETE /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:22.846760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:22.864487 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:22.864487 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:22.869078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:22.870292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Searching by: {'deleted': False, 'project_id': 'a19875f98800434db2950efcf23ff3a4'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:22.888352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:22.891144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:22.896162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:22.898656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:22.969277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:11:23.041020 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ddafe45-0a6b-45fa-883d-e877d0e19c2c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199762 Feb 12 21:11:23.054086 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1267/2466] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:11:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:23.058642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-198ffd36-701f-4981-a503-5f91a0dd5c7f req-082201bb-0fa3-4d0a-af1a-ddb064209a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "cb16a4b9-5c35-4c83-b676-814b33f4354e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:23.061376 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:23.061376 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:23.071594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-198ffd36-701f-4981-a503-5f91a0dd5c7f req-082201bb-0fa3-4d0a-af1a-ddb064209a3b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.072139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-198ffd36-701f-4981-a503-5f91a0dd5c7f req-082201bb-0fa3-4d0a-af1a-ddb064209a3b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.112243 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-198ffd36-701f-4981-a503-5f91a0dd5c7f req-082201bb-0fa3-4d0a-af1a-ddb064209a3b service nova] Creating event network-changed:cb16a4b9-5c35-4c83-b676-814b33f4354e for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:23.134414 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-198ffd36-701f-4981-a503-5f91a0dd5c7f req-082201bb-0fa3-4d0a-af1a-ddb064209a3b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077513 Feb 12 21:11:23.152440 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1268/2467] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:23.168701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:23.174205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:23.190802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.191466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.192450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.192907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.244717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Updating instance_info_cache with network_info: [{"id": "2892cb32-6dec-4f9c-8027-ac60fc70109c", "address": "fa:16:3e:b0:72:bb", "network": {"id": "0667fd4a-8e2d-4583-adf6-fead39b333d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-435642992-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9627e1d31e814deb8265e43f63ac807c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2892cb32-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:11:23.378853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Releasing lock "refresh_cache-42793e4d-48dd-4081-bd66-942f8df5fa65" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:11:23.381192 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b3a1c876-f4e8-454d-9d07-8fa5c010f8ef tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65/action" status: 202 len: 0 microversion: 2.1 time: 5.404973 Feb 12 21:11:23.384447 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1200/2468] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:17 2022] POST /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65/action => generated 0 bytes in 5409 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:11:23.391610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1532355e-0429-4de9-a1f3-b2971c626398 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd8ce310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:23.484897 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1532355e-0429-4de9-a1f3-b2971c626398 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.098107 Feb 12 21:11:23.485751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1201/2469] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:23 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:23.493884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:23.494988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:23.505669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.506426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.508584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.509206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.675864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.687300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.688948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.690301 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5fce04e2-9bcb-46ba-8613-d508c1c0bfae tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1752 microversion: 2.20 time: 0.203290 Feb 12 21:11:23.691005 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1202/2470] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:23 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:23.703719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e9086311-57a8-44b7-861c-86f0be588a70 req-ceadbad9-c037-49d8-8dbe-eeaebf766a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d94d265-92b9-424f-8314-b0fb321f73b5", "tag": "af1288cf-8eee-461b-8fdd-3ff82ef1f8c5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:23.708066 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:23.708066 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:23.716535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e9086311-57a8-44b7-861c-86f0be588a70 req-ceadbad9-c037-49d8-8dbe-eeaebf766a7a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.717139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e9086311-57a8-44b7-861c-86f0be588a70 req-ceadbad9-c037-49d8-8dbe-eeaebf766a7a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.732674 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e9086311-57a8-44b7-861c-86f0be588a70 req-ceadbad9-c037-49d8-8dbe-eeaebf766a7a service nova] Creating event network-changed:af1288cf-8eee-461b-8fdd-3ff82ef1f8c5 for instance 8d94d265-92b9-424f-8314-b0fb321f73b5 on nch1-master-1 Feb 12 21:11:23.738373 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e9086311-57a8-44b7-861c-86f0be588a70 req-ceadbad9-c037-49d8-8dbe-eeaebf766a7a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045972 Feb 12 21:11:23.739262 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1203/2471] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:23.746253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:23.747319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:23.754080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.754614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.755691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.756089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.776199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.795731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.797336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.798595 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e80ed98-e806-4fa3-8952-abe61ba9238a tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.643104 Feb 12 21:11:23.811601 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1269/2472] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:23 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:23.818661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:23.823801 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:23.823801 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:23.825547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.826689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Searching by: {'deleted': False, 'project_id': 'a19875f98800434db2950efcf23ff3a4'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:23.835387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.836062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.836954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.837673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.876112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:11:23.919617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.926264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:23.928165 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee1409eb-c1c3-42de-9788-82de511e5d33 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1470 microversion: 2.1 time: 0.187419 Feb 12 21:11:23.940443 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1204/2473] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:23 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:23.947982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:23.948857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:23.956270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.957004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.957243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.959577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:23.959979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:23.960693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:24.358294 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6657d9f7-c5b5-427d-a8d4-c42d7f29b682 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.545125 Feb 12 21:11:24.359871 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1270/2474] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:11:23 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:24.368628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:24.369847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:24.384447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:24.385982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:24.387017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:24.387635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:24.461725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:24.461934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:24.470190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1be4628-3636-401d-bcc3-04c80e54d6bf tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.527272 Feb 12 21:11:24.477465 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1205/2475] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:23 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:24.482093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1336b3f4-950f-49c3-80ec-0147ffbe2d82 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:24.505543 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1336b3f4-950f-49c3-80ec-0147ffbe2d82 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026905 Feb 12 21:11:24.528604 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1206/2476] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:11:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:24.534113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5316c352-023e-4525-8924-6691f7bbcf29 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd901c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:24.624818 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5316c352-023e-4525-8924-6691f7bbcf29 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1413 microversion: 2.1 time: 0.094787 Feb 12 21:11:24.628567 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1207/2477] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:24 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:24.711065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:24.711694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:24.728347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:24.729102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:24.730129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:24.730748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:24.941149 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da90bebe-9844-439b-8e90-93dd49b6a10b tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "DELETE /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 204 len: 0 microversion: 2.1 time: 0.579448 Feb 12 21:11:24.942212 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1271/2478] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:24 2022] DELETE /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:24.954627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:24.955023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:24.966236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:24.966236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:24.966236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:24.966236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:25.621322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:25.650059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:25.651863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:25.653268 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-41ba8e30-a41d-42df-803f-9cb15a8a8c48 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.946758 Feb 12 21:11:25.654826 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1208/2479] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:24 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:25.659340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:25.659993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:25.666632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:25.667090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:25.667891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:25.668530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:25.835810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:25.848710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:25.852822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:25.855522 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf23a723-7ce8-4d1e-b0e1-c525f6bab4ad tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.905306 Feb 12 21:11:25.857690 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1272/2480] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:24 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:25.864191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.141"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:25.865778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:25.875588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:25.876477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:25.879404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:25.880121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:25.960303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Acquired lock "refresh_cache-0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:11:26.067089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:26.078384 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4f19d2a-687b-4297-9040-bab6e383c627 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 200 len: 1470 microversion: 2.1 time: 0.422412 Feb 12 21:11:26.079703 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1209/2481] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:25 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:26.085122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42793e4d-48dd-4081-bd66-942f8df5fa65", "tag": "2892cb32-6dec-4f9c-8027-ac60fc70109c"}, {"name": "network-changed", "server_uuid": "13154ac3-ea21-4e42-874e-47df8fc0774a", "tag": "7de9234c-8a3c-4d65-9cee-718d58f221b1"}, {"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "c03b11d7-ad51-4a19-be11-d54473d9b412"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:26.087646 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:26.087646 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:26.098361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:26.098361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:26.116500 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] Creating event network-changed:2892cb32-6dec-4f9c-8027-ac60fc70109c for instance 42793e4d-48dd-4081-bd66-942f8df5fa65 on nch2-master-1 Feb 12 21:11:26.117477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] Creating event network-changed:7de9234c-8a3c-4d65-9cee-718d58f221b1 for instance 13154ac3-ea21-4e42-874e-47df8fc0774a on nch2-master-1 Feb 12 21:11:26.121102 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] Creating event network-changed:c03b11d7-ad51-4a19-be11-d54473d9b412 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:26.128880 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-751688fc-5cac-49f1-afd7-b0aa584a5810 req-283f3ad7-88f4-4c3e-96d8-6cba9d369e13 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.047645 Feb 12 21:11:26.129801 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1210/2482] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:26.146197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:26.146927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:26.154805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:26.155276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:26.156266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:26.156709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:26.520546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:26.529202 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd695a29-aaa1-4ac3-945b-eddc1b28ea42 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.397963 Feb 12 21:11:26.531646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1211/2483] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:26 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:26.546632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9af05720-e0e7-47ce-8750-3fb641ac3a24 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd920790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:26.617325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9af05720-e0e7-47ce-8750-3fb641ac3a24 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1422 microversion: 2.1 time: 0.073232 Feb 12 21:11:26.626382 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1212/2484] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:26 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:26.634201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-51b3735e-e452-4884-958a-9c62269ddfc6 req-5747a98d-18b7-4e52-8705-84ebc7bd59bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92301117-2563-4606-aba3-80d2cdcf4214", "tag": "6c2d4fff-ca67-4966-a06e-aaa926490420"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:26.637130 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:26.637130 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:26.644815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-51b3735e-e452-4884-958a-9c62269ddfc6 req-5747a98d-18b7-4e52-8705-84ebc7bd59bc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:26.645622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-51b3735e-e452-4884-958a-9c62269ddfc6 req-5747a98d-18b7-4e52-8705-84ebc7bd59bc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:26.667499 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-51b3735e-e452-4884-958a-9c62269ddfc6 req-5747a98d-18b7-4e52-8705-84ebc7bd59bc service nova] Creating event network-changed:6c2d4fff-ca67-4966-a06e-aaa926490420 for instance 92301117-2563-4606-aba3-80d2cdcf4214 on nch2-master-1 Feb 12 21:11:26.673929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-51b3735e-e452-4884-958a-9c62269ddfc6 req-5747a98d-18b7-4e52-8705-84ebc7bd59bc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045212 Feb 12 21:11:26.675058 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1213/2485] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:26.681609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03c5b6a6-e515-4210-8cd5-f293d2010131 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fd8caca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:26.787327 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03c5b6a6-e515-4210-8cd5-f293d2010131 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 200 len: 1422 microversion: 2.1 time: 0.110897 Feb 12 21:11:26.788835 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1214/2486] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:26 2022] GET /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:26.805061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:26.815897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:26.821563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:26.824108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:26.827390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:26.828155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:27.423235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:27.447106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:27.448935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:27.452407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-664bf647-6bcf-4b38-87b1-3d85b3e56efb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.653750 Feb 12 21:11:27.453306 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1215/2487] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:26 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:27.463877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7c66e08-4df7-4733-949d-c0d597153d23 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907e175e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:29.269756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Building network info cache for instance {{(pid=141727) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:11:29.525907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7c66e08-4df7-4733-949d-c0d597153d23 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 204 len: 0 microversion: 2.1 time: 2.070918 Feb 12 21:11:29.526578 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1216/2488] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:27 2022] DELETE /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 0 bytes in 2072 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:29.533485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:29.534248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:29.545010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:29.545591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:29.546415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:29.547780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:29.967324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:29.991913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:29.995630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:29.998258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b38277e-f816-4ced-8c51-b5327456ea50 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.469604 Feb 12 21:11:30.000691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1217/2489] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:29 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:30.010818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:30.012014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 44a94071-0179-4785-80d2-9c78a84887a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:30.023788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.025486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.027345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.028564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.060463 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] HTTP exception thrown: Instance 44a94071-0179-4785-80d2-9c78a84887a5 could not be found. Feb 12 21:11:30.061104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Returning 404 to user: Instance 44a94071-0179-4785-80d2-9c78a84887a5 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:30.062014 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d2cbc93-529f-4e85-a9da-7b2c67765bc1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5" status: 404 len: 111 microversion: 2.1 time: 0.058867 Feb 12 21:11:30.065219 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1218/2490] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:30 2022] GET /compute/v2.1/servers/44a94071-0179-4785-80d2-9c78a84887a5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:30.072002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:30.072625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:30.091911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.092353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.093147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.093611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.419445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:30.428080 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d743fd0-97f4-400a-bf0b-a140a830997c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.359700 Feb 12 21:11:30.443471 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1219/2491] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:30 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:30.449594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-28783acd-4996-47c9-86de-59e59692ef96 req-4222b09e-5633-4fda-b506-67d3ab5dfa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a94071-0179-4785-80d2-9c78a84887a5", "name": "network-vif-deleted", "tag": "2d74542d-b56d-4ff5-a958-316b2005d4e9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:30.451728 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:30.451728 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:30.460966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-28783acd-4996-47c9-86de-59e59692ef96 req-4222b09e-5633-4fda-b506-67d3ab5dfa3e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.461692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-28783acd-4996-47c9-86de-59e59692ef96 req-4222b09e-5633-4fda-b506-67d3ab5dfa3e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.474509 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-28783acd-4996-47c9-86de-59e59692ef96 req-4222b09e-5633-4fda-b506-67d3ab5dfa3e service nova] Creating event network-vif-deleted:2d74542d-b56d-4ff5-a958-316b2005d4e9 for instance 44a94071-0179-4785-80d2-9c78a84887a5 on nch1-master-1 Feb 12 21:11:30.484058 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-28783acd-4996-47c9-86de-59e59692ef96 req-4222b09e-5633-4fda-b506-67d3ab5dfa3e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038181 Feb 12 21:11:30.485221 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1220/2492] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:30.504185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:30.505341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:30.515495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.518473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.519890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.520502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.792557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:30.821615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:30.825498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:30.827911 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2462071-5f17-4b90-b6c1-e8a310b088fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.341074 Feb 12 21:11:30.829239 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1221/2493] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:30 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:30.849187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-de5c6486-f355-4783-93fd-8f8fe37ceabd req-b8bbbd16-7f07-473d-b30c-adcf4899992d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "ea9dd83b-8155-49b9-9961-155b1a2273e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:30.852847 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:30.852847 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:30.862537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-de5c6486-f355-4783-93fd-8f8fe37ceabd req-b8bbbd16-7f07-473d-b30c-adcf4899992d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.863522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-de5c6486-f355-4783-93fd-8f8fe37ceabd req-b8bbbd16-7f07-473d-b30c-adcf4899992d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.878383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-de5c6486-f355-4783-93fd-8f8fe37ceabd req-b8bbbd16-7f07-473d-b30c-adcf4899992d service nova] Creating event network-changed:ea9dd83b-8155-49b9-9961-155b1a2273e6 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:30.886348 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-de5c6486-f355-4783-93fd-8f8fe37ceabd req-b8bbbd16-7f07-473d-b30c-adcf4899992d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055007 Feb 12 21:11:30.887554 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1222/2494] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:30.893492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:30.903972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:30.903972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.905207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.906382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:30.907010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:30.979773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:31.131096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Updating instance_info_cache with network_info: [{"id": "c0e4abe5-512a-438d-9ee8-c182fa52f022", "address": "fa:16:3e:85:dc:01", "network": {"id": "0667fd4a-8e2d-4583-adf6-fead39b333d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-435642992-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9627e1d31e814deb8265e43f63ac807c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc0e4abe5-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:11:31.261327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Releasing lock "refresh_cache-0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:11:31.266179 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d947f1bb-8272-485d-ab6e-1ca6273413e0 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action" status: 202 len: 0 microversion: 2.1 time: 5.403405 Feb 12 21:11:31.266962 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1273/2495] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:25 2022] POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action => generated 0 bytes in 5408 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:11:31.273312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:31.277990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:31.290578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:31.294583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:31.295762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:31.297773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:31.403514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:31.455674 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aef8e2e1-603f-4009-afe3-8d7b072fe677 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 204 len: 0 microversion: 2.1 time: 0.566067 Feb 12 21:11:31.456554 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1223/2496] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:30 2022] DELETE /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:31.481097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c944541b-f2e8-4b94-a63a-77fa094e9f26 req-fdf27d57-db9e-42f6-a430-e0b145fe875c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6", "name": "network-vif-unplugged", "status": "completed", "tag": "e38f0d55-536c-4032-855c-af42ba5ed8b7"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:31.485756 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:31.485756 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:31.500760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c944541b-f2e8-4b94-a63a-77fa094e9f26 req-fdf27d57-db9e-42f6-a430-e0b145fe875c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:31.502121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c944541b-f2e8-4b94-a63a-77fa094e9f26 req-fdf27d57-db9e-42f6-a430-e0b145fe875c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:31.540736 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c944541b-f2e8-4b94-a63a-77fa094e9f26 req-fdf27d57-db9e-42f6-a430-e0b145fe875c service nova] Creating event network-vif-unplugged:e38f0d55-536c-4032-855c-af42ba5ed8b7 for instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 on nch2-master-1 Feb 12 21:11:31.552417 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c944541b-f2e8-4b94-a63a-77fa094e9f26 req-fdf27d57-db9e-42f6-a430-e0b145fe875c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091465 Feb 12 21:11:31.557460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1224/2497] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:31.567133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:31.567868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:31.596274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:31.601212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:31.601212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:31.607592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:31.821630 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d7e5b4da-cc8a-428c-ad6f-792b3d5a9fa3 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "DELETE /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 204 len: 0 microversion: 2.1 time: 0.548745 Feb 12 21:11:31.825744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1274/2498] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:31 2022] DELETE /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:31.839597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb266cd1-ede9-4be7-8822-8bfc8e481d61 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '.version_select at 0x7fa8fe1b4820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:31.993535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:32.005068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:32.007027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:32.010729 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff86dd6f-c776-450c-95ea-c622d2d3bff0 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.455128 Feb 12 21:11:32.025400 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1225/2499] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:31 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:32.025400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:32.025400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:32.048543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.049533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.059111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.060344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.289412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:32.301511 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c92024a9-025d-466c-ba59-d612ef0c2c23 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.285591 Feb 12 21:11:32.303482 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1226/2500] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:32 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:32.308726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-229506530", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:32.381515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] validate_networks() for [('4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:11:32.525201 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb266cd1-ede9-4be7-8822-8bfc8e481d61 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/os-floating-ips/a5c8cfb9-9afd-4ab2-9d97-be2e3ea74574" status: 200 len: 185 microversion: 2.1 time: 0.697933 Feb 12 21:11:32.526982 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1275/2501] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:11:31 2022] GET /compute/v2.1/os-floating-ips/a5c8cfb9-9afd-4ab2-9d97-be2e3ea74574 => generated 185 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:32.532199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:32.533264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:32.541524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.542326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.544088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.544088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.898990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:32.911083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:11:32.911839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:11:32.912574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:11:32.913964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:11:32.914865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:11:32.916459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a5c3eaa-b5cc-45f7-9951-8139310d48d1 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1469 microversion: 2.1 time: 0.387063 Feb 12 21:11:32.917822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1276/2502] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:32 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1469 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:32.933538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.934155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:32.934771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.934901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:32.936595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.937345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.952248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.952248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.952248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:32.952248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:32.963843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:32.970440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for user 1cec3ccfc53b48bfa8bc879989b720b8 and project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:32.988320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:11:32.992008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:11:33.206186 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd8bd39f-cef5-4819-8350-d956a5a41496 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901288 Feb 12 21:11:33.212747 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1227/2503] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:11:33.218821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-db4080bb-ddbe-4f02-8b71-6481556d5853 req-e346efdf-97fe-4099-a01b-bfa29582bde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42793e4d-48dd-4081-bd66-942f8df5fa65", "name": "network-vif-deleted", "tag": "2892cb32-6dec-4f9c-8027-ac60fc70109c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:33.220722 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:33.220722 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:33.230987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-db4080bb-ddbe-4f02-8b71-6481556d5853 req-e346efdf-97fe-4099-a01b-bfa29582bde8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:33.231456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-db4080bb-ddbe-4f02-8b71-6481556d5853 req-e346efdf-97fe-4099-a01b-bfa29582bde8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:33.254228 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-db4080bb-ddbe-4f02-8b71-6481556d5853 req-e346efdf-97fe-4099-a01b-bfa29582bde8 service nova] Creating event network-vif-deleted:2892cb32-6dec-4f9c-8027-ac60fc70109c for instance 42793e4d-48dd-4081-bd66-942f8df5fa65 on nch2-master-1 Feb 12 21:11:33.272188 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-db4080bb-ddbe-4f02-8b71-6481556d5853 req-e346efdf-97fe-4099-a01b-bfa29582bde8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057622 Feb 12 21:11:33.274231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:33.276568 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1228/2504] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:33.284304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.141"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:33.292499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:33.294559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:33.297093 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5d0dbd2-7f23-48bf-adaf-23bac82e6a2b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.374904 Feb 12 21:11:33.298032 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1277/2505] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:32 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:33.306532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6426d9df-719a-499b-8713-4500f8d150a2 req-bb0e4b6e-3bd1-433f-b5b8-a55506c9e96d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:33.308684 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:33.308684 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:33.318527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6426d9df-719a-499b-8713-4500f8d150a2 req-bb0e4b6e-3bd1-433f-b5b8-a55506c9e96d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:33.319972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6426d9df-719a-499b-8713-4500f8d150a2 req-bb0e4b6e-3bd1-433f-b5b8-a55506c9e96d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:33.341007 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6426d9df-719a-499b-8713-4500f8d150a2 req-bb0e4b6e-3bd1-433f-b5b8-a55506c9e96d service nova] Creating event network-changed:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:11:33.356121 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6426d9df-719a-499b-8713-4500f8d150a2 req-bb0e4b6e-3bd1-433f-b5b8-a55506c9e96d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054739 Feb 12 21:11:33.363037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1278/2506] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:33.376046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:33.376761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:33.409389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:33.411859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:33.416006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:33.416693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:33.631151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:33.649420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:33.649909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:33.650733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:33.651185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:33.996145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Acquired lock "refresh_cache-0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:11:34.214881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:34.224553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:34.226324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:34.238879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d388e6be-2e63-438b-8b59-6c6cc6ae827e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.874119 Feb 12 21:11:34.239931 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1279/2507] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:33 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:34.259154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f1a0bc1-e520-4803-a6d6-ce376bffb42c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:34.259154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f1a0bc1-e520-4803-a6d6-ce376bffb42c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:34.369027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f1a0bc1-e520-4803-a6d6-ce376bffb42c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:34.376412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f1a0bc1-e520-4803-a6d6-ce376bffb42c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1207 microversion: 2.1 time: 0.123949 Feb 12 21:11:34.379662 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1280/2508] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:34 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1207 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:34.385229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:34.386106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:34.418031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:34.418641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:34.422834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:34.422834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:34.973079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:34.981756 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4cbf567b-3bae-4690-b7a4-ea48584f684c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.600502 Feb 12 21:11:34.991554 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1281/2509] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:34 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:35.024424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5de5a152-b4c7-4d62-b6a8-767f208bc9c3 req-8a5b0463-022a-4e83-8022-ed92517f9398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d94d265-92b9-424f-8314-b0fb321f73b5", "name": "network-vif-plugged", "status": "completed", "tag": "af1288cf-8eee-461b-8fdd-3ff82ef1f8c5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:35.032182 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:35.032182 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:35.055683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5de5a152-b4c7-4d62-b6a8-767f208bc9c3 req-8a5b0463-022a-4e83-8022-ed92517f9398 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:35.060497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5de5a152-b4c7-4d62-b6a8-767f208bc9c3 req-8a5b0463-022a-4e83-8022-ed92517f9398 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:35.104196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5de5a152-b4c7-4d62-b6a8-767f208bc9c3 req-8a5b0463-022a-4e83-8022-ed92517f9398 service nova] Creating event network-vif-plugged:af1288cf-8eee-461b-8fdd-3ff82ef1f8c5 for instance 8d94d265-92b9-424f-8314-b0fb321f73b5 on nch1-master-1 Feb 12 21:11:35.125485 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5de5a152-b4c7-4d62-b6a8-767f208bc9c3 req-8a5b0463-022a-4e83-8022-ed92517f9398 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125623 Feb 12 21:11:35.133253 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1282/2510] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:35.157062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:35.165735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:35.188073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:35.190999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:35.195009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:35.195785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:35.407426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:35.448817 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-acb53d48-2b29-493a-a387-3e00e0d1aeaf tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 200 len: 1427 microversion: 2.1 time: 0.313776 Feb 12 21:11:35.459143 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1283/2511] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:35 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 1427 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:35.469064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:35.472895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:35.494326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:35.496448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:35.500250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:35.500710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:36.280271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:36.293381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:36.298585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:36.304741 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-42fd4ccc-77a5-4261-aef2-c137f6e94868 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.846004 Feb 12 21:11:36.316431 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1284/2512] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:35 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:36.327181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:36.328166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:36.343905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:36.344778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:36.354543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:36.357852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:36.389263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Building network info cache for instance {{(pid=141726) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:11:36.902207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:36.932847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:36.936717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:36.940866 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc744e8e-40af-48d9-a5d5-d9b0fe714237 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.620706 Feb 12 21:11:36.942346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1285/2513] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:36 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:36.954878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:36.957605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:36.985018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:36.987695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:36.991486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:36.992197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.249941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:37.282554 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2cd0aebc-adb7-466c-938b-2c5b7ff3fc80 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1277 microversion: 2.1 time: 0.336179 Feb 12 21:11:37.288912 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1286/2514] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:36 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:37.306832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-da5a843c-1ef1-4f35-a188-9145f6f13676 req-c4d64230-d5b4-43da-9af3-be1234741b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c5b34-4f68-4c9d-a24c-092d1c4b35e9", "name": "network-vif-deleted", "tag": "9e9845e9-a042-45ae-b39d-5207ad5eef75"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:37.312264 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:37.312264 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:37.331808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-da5a843c-1ef1-4f35-a188-9145f6f13676 req-c4d64230-d5b4-43da-9af3-be1234741b8c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.334060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-da5a843c-1ef1-4f35-a188-9145f6f13676 req-c4d64230-d5b4-43da-9af3-be1234741b8c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.357108 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-da5a843c-1ef1-4f35-a188-9145f6f13676 req-c4d64230-d5b4-43da-9af3-be1234741b8c service nova] Creating event network-vif-deleted:9e9845e9-a042-45ae-b39d-5207ad5eef75 for instance 098c5b34-4f68-4c9d-a24c-092d1c4b35e9 on nch1-master-1 Feb 12 21:11:37.367373 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-da5a843c-1ef1-4f35-a188-9145f6f13676 req-c4d64230-d5b4-43da-9af3-be1234741b8c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076352 Feb 12 21:11:37.368647 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1287/2515] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:37.374367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:37.377567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:37.411162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.411721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.413518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.414906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.625600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:37.639422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0917fa74-22f8-442e-90e7-346f8033a3a4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.269322 Feb 12 21:11:37.640708 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1288/2516] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:37 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:37.654911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1a7c7d37-a556-426e-b50b-67ecead1d0dd req-7bef2947-2220-4f00-89e8-02a260b2ea61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:37.656919 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:37.656919 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:37.682150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1a7c7d37-a556-426e-b50b-67ecead1d0dd req-7bef2947-2220-4f00-89e8-02a260b2ea61 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.683021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1a7c7d37-a556-426e-b50b-67ecead1d0dd req-7bef2947-2220-4f00-89e8-02a260b2ea61 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.701251 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1a7c7d37-a556-426e-b50b-67ecead1d0dd req-7bef2947-2220-4f00-89e8-02a260b2ea61 service nova] Creating event network-changed:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:11:37.717217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1a7c7d37-a556-426e-b50b-67ecead1d0dd req-7bef2947-2220-4f00-89e8-02a260b2ea61 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074724 Feb 12 21:11:37.718096 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1289/2517] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:37.723161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:37.724931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: 098c5b34-4f68-4c9d-a24c-092d1c4b35e9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:37.747876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.747876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.747876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.747876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.780028 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] HTTP exception thrown: Instance 098c5b34-4f68-4c9d-a24c-092d1c4b35e9 could not be found. Feb 12 21:11:37.780635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Returning 404 to user: Instance 098c5b34-4f68-4c9d-a24c-092d1c4b35e9 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:37.789471 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc0995e0-d4b5-43e7-8389-c2038fe4e952 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9" status: 404 len: 111 microversion: 2.1 time: 0.062488 Feb 12 21:11:37.793377 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1290/2518] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:37 2022] GET /compute/v2.1/servers/098c5b34-4f68-4c9d-a24c-092d1c4b35e9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:37.799804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bfaea81f-cddc-4ad0-89f9-725610b703ea req-25d726f8-245b-4fc7-bf9a-b75963b1e496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92301117-2563-4606-aba3-80d2cdcf4214", "name": "network-vif-plugged", "status": "completed", "tag": "6c2d4fff-ca67-4966-a06e-aaa926490420"}, {"server_uuid": "13154ac3-ea21-4e42-874e-47df8fc0774a", "name": "network-vif-plugged", "status": "completed", "tag": "7de9234c-8a3c-4d65-9cee-718d58f221b1"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:37.801731 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:37.801731 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:37.813512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bfaea81f-cddc-4ad0-89f9-725610b703ea req-25d726f8-245b-4fc7-bf9a-b75963b1e496 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.814128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bfaea81f-cddc-4ad0-89f9-725610b703ea req-25d726f8-245b-4fc7-bf9a-b75963b1e496 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.830183 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bfaea81f-cddc-4ad0-89f9-725610b703ea req-25d726f8-245b-4fc7-bf9a-b75963b1e496 service nova] Creating event network-vif-plugged:6c2d4fff-ca67-4966-a06e-aaa926490420 for instance 92301117-2563-4606-aba3-80d2cdcf4214 on nch2-master-1 Feb 12 21:11:37.830843 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bfaea81f-cddc-4ad0-89f9-725610b703ea req-25d726f8-245b-4fc7-bf9a-b75963b1e496 service nova] Creating event network-vif-plugged:7de9234c-8a3c-4d65-9cee-718d58f221b1 for instance 13154ac3-ea21-4e42-874e-47df8fc0774a on nch2-master-1 Feb 12 21:11:37.840064 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bfaea81f-cddc-4ad0-89f9-725610b703ea req-25d726f8-245b-4fc7-bf9a-b75963b1e496 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045043 Feb 12 21:11:37.841022 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1291/2519] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:37.849100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:37.849100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:37.870326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.870950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:37.872711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:37.873322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.058400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Updating instance_info_cache with network_info: [{"id": "c0e4abe5-512a-438d-9ee8-c182fa52f022", "address": "fa:16:3e:85:dc:01", "network": {"id": "0667fd4a-8e2d-4583-adf6-fead39b333d4", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-435642992-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9627e1d31e814deb8265e43f63ac807c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc0e4abe5-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:11:38.157236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Releasing lock "refresh_cache-0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:11:38.166558 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08e6e706-74ed-4aa6-bcdf-743f38d137b2 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action" status: 202 len: 0 microversion: 2.1 time: 4.878306 Feb 12 21:11:38.166558 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1229/2520] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:33 2022] POST /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd/action => generated 0 bytes in 4881 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:11:38.166558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:38.166558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:38.175301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.176047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.178974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.179869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.221704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:38.474040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:38.500849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:38.502873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:38.504375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-618c1703-5c4c-442a-967d-da2c073a794c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.662095 Feb 12 21:11:38.518798 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1292/2521] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:37 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:38.524775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:38.532829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:38.545045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.548517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.549648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.557309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.883575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:38.893106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:38.895096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:38.896288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8774d26b-0971-4524-9f61-8ca28af10fb9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.376091 Feb 12 21:11:38.903509 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1293/2522] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:38 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:38.903509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:38.903509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:38.910240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.910701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.915009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.915656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.931532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] HTTP exception thrown: Instance 42793e4d-48dd-4081-bd66-942f8df5fa65 could not be found. Feb 12 21:11:38.932133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Returning 404 to user: Instance 42793e4d-48dd-4081-bd66-942f8df5fa65 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:38.932991 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9e2a661-6501-4208-925f-0ff27a4b1dde tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "DELETE /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 404 len: 111 microversion: 2.1 time: 0.034370 Feb 12 21:11:38.933756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1294/2523] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:38 2022] DELETE /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:38.938137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:38.938747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:38.945080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.945606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:38.946395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:38.946831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.217594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:39.225941 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89e8f327-2a46-4e15-91e5-a7ffdc642b7b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.290711 Feb 12 21:11:39.228699 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1295/2524] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:38 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:39.231068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:39.231869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:39.238229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.238685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.239492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.239929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.391042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:39.399598 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2874bd9b-5d19-4b0c-9d63-774767addcc0 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.171857 Feb 12 21:11:39.400105 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1296/2525] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:39 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:39.404533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:39.405144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 42793e4d-48dd-4081-bd66-942f8df5fa65] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:39.410963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.411418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.412206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.413267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.426700 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] HTTP exception thrown: Instance 42793e4d-48dd-4081-bd66-942f8df5fa65 could not be found. Feb 12 21:11:39.427288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Returning 404 to user: Instance 42793e4d-48dd-4081-bd66-942f8df5fa65 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:39.428675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ac12833-eeb9-454d-bd76-657d56a4800c tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65" status: 404 len: 111 microversion: 2.1 time: 0.027084 Feb 12 21:11:39.429402 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1297/2526] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:39 2022] GET /compute/v2.1/servers/42793e4d-48dd-4081-bd66-942f8df5fa65 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:39.436955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3adf2010-9fb2-4031-928a-749457213b7a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '.version_select at 0x7fa8fe27e280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:39.553608 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-47bd15a3-c34c-41b9-9b9c-cf3cbce98697 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "DELETE /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 204 len: 0 microversion: 2.1 time: 1.392952 Feb 12 21:11:39.554856 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1230/2527] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:38 2022] DELETE /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 0 bytes in 1396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:39.559914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:39.560624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:39.572263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.572726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.575733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.578599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.809610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:39.827031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:39.831074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:39.832282 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e6c65557-17a1-4f74-bfb9-c00e0f69bb97 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.276281 Feb 12 21:11:39.832855 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1231/2528] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:39 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:39.837652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:39.838973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:39.845830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.846286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:39.847526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:39.847794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.154059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:40.169540 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d851cce-5baa-4f51-9970-5bf957936189 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1469 microversion: 2.1 time: 0.335351 Feb 12 21:11:40.170132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1232/2529] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:39 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:40.174533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bbde59ad-c5a5-4d39-a3ec-03c87f630058 req-cf7197aa-a86f-4788-9799-22c2c963c609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6", "name": "network-vif-deleted", "tag": "e38f0d55-536c-4032-855c-af42ba5ed8b7"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:40.176360 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:40.176360 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:40.184501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bbde59ad-c5a5-4d39-a3ec-03c87f630058 req-cf7197aa-a86f-4788-9799-22c2c963c609 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.185232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bbde59ad-c5a5-4d39-a3ec-03c87f630058 req-cf7197aa-a86f-4788-9799-22c2c963c609 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.198495 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bbde59ad-c5a5-4d39-a3ec-03c87f630058 req-cf7197aa-a86f-4788-9799-22c2c963c609 service nova] Creating event network-vif-deleted:e38f0d55-536c-4032-855c-af42ba5ed8b7 for instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 on nch2-master-1 Feb 12 21:11:40.203733 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bbde59ad-c5a5-4d39-a3ec-03c87f630058 req-cf7197aa-a86f-4788-9799-22c2c963c609 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Feb 12 21:11:40.204376 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1233/2530] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:40.210364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:40.211386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:40.217802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.223466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.223466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.223466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.340759 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3adf2010-9fb2-4031-928a-749457213b7a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/a5c8cfb9-9afd-4ab2-9d97-be2e3ea74574" status: 202 len: 0 microversion: 2.1 time: 0.906948 Feb 12 21:11:40.346333 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1298/2531] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:11:39 2022] DELETE /compute/v2.1/os-floating-ips/a5c8cfb9-9afd-4ab2-9d97-be2e3ea74574 => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:11:40.347951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:40.348761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:40.356583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.357033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.358072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.358676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.504796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:40.504992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:40.512712 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3543e19c-cdba-4c54-880d-f8da7e9eceab tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.169592 Feb 12 21:11:40.513302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1299/2532] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:40 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:40.513862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:40.515499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:40.516785 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd32efb3-3992-4604-a87c-a21cc16c63a4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.310904 Feb 12 21:11:40.517424 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1234/2533] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:40 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:40.530086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:40.530086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:40.530086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.530086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.530086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.530086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.533462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:40.534085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:40.541989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.542441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.543242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.543686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.570112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:40.793242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:40.802284 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a8cfb7a1-abf0-465b-a822-0650f41e7f3e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1322 microversion: 2.1 time: 0.273155 Feb 12 21:11:40.803316 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1235/2534] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:40 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:40.851415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:40.852336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:40.859126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.859821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.860811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.861452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.868499 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ae08c1d-e0a9-40bf-97de-e766b8709e32 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 204 len: 0 microversion: 2.1 time: 0.353522 Feb 12 21:11:40.869880 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1300/2535] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:40 2022] DELETE /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:40.879784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:40.880602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:40.891516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.891977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:40.892791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:40.895312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.063941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.074334 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e1e8df3-55f8-4106-9629-a0095ee4dedc tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1526 microversion: 2.1 time: 0.199377 Feb 12 21:11:41.084726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1301/2536] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:40 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1526 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:41.112647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.123156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.124882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.126083 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-717859c1-407f-4ebe-91b3-4a4a32a7dcc3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.278816 Feb 12 21:11:41.127174 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1236/2537] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:40 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:41.186990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:41.187715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:41.194994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.195449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.199089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.199089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.458034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.466817 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7eb4fc74-8230-43eb-b435-922e43b19f21 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1469 microversion: 2.1 time: 0.283665 Feb 12 21:11:41.472955 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1302/2538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:41 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:41.531164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:41.531843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:41.540965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:41.543852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:41.547555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.549727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.550569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.551003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.559119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.559380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.560169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.560608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.708154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.716714 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54850f60-7ce4-4de6-a6e1-61c5689e99a9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.189633 Feb 12 21:11:41.717281 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1237/2539] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:41 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:41.819751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:41.820447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:41.826533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.826984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.827876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:41.828310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:41.848973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.858858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.866029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.866029 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fad5185c-f5c5-4053-9be9-18d0819a6338 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.328641 Feb 12 21:11:41.866029 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1303/2540] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:41 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:41.972101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:41.978599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-05bc4208-6d66-48e6-80bb-c86398bf6f2d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 200 len: 1513 microversion: 2.1 time: 0.162953 Feb 12 21:11:41.979181 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1238/2541] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:41 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:41.995621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:41.996741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.003613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.008428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.008428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.008428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.015262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-80fe29e2-17e4-43f9-9c97-dad884756aa3 req-2f6c39b7-d9d7-4e93-ba70-cf085c5eb06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7e1aca-9785-4119-a180-49e60318243e", "name": "network-vif-deleted", "tag": "79a28270-5b6e-4c46-9526-13bd9e1c0067"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:42.017242 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:42.017242 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:42.025932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-80fe29e2-17e4-43f9-9c97-dad884756aa3 req-2f6c39b7-d9d7-4e93-ba70-cf085c5eb06a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.026375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-80fe29e2-17e4-43f9-9c97-dad884756aa3 req-2f6c39b7-d9d7-4e93-ba70-cf085c5eb06a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.040041 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-80fe29e2-17e4-43f9-9c97-dad884756aa3 req-2f6c39b7-d9d7-4e93-ba70-cf085c5eb06a service nova] Creating event network-vif-deleted:79a28270-5b6e-4c46-9526-13bd9e1c0067 for instance fa7e1aca-9785-4119-a180-49e60318243e on nch1-master-1 Feb 12 21:11:42.045189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-80fe29e2-17e4-43f9-9c97-dad884756aa3 req-2f6c39b7-d9d7-4e93-ba70-cf085c5eb06a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039069 Feb 12 21:11:42.046399 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1239/2542] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:42.092909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.093495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.101397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.102184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.103345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.104011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.188315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.203126 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-86976d20-7a21-4ff7-99c3-08019ed9ee2a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5" status: 200 len: 1513 microversion: 2.1 time: 0.212186 Feb 12 21:11:42.216216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1304/2543] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:41 2022] GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:42.216216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.217102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.224841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.224841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.226932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.227392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.296030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.305647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f5117d6-7839-4ca6-a4c4-ff29fc2804a9 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1526 microversion: 2.1 time: 0.217748 Feb 12 21:11:42.306249 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1240/2544] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1526 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:42.313397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.313397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.318021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.318491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.319633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.320070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.380100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.389928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.391579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.392747 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fdb31e37-9952-4692-b7e7-796e8794fa1a tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.181461 Feb 12 21:11:42.393307 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1305/2545] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:42.408978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-07de1161-25b5-4d9e-8bba-781c3423ceeb req-fcc2e6e5-644c-449a-a0a7-0179b8a6629a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9045d14a-f3fd-4ac7-b7c3-80e22e9b0970", "tag": "ce0bcb3d-2043-41d3-a1f4-e06134cff0af"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:42.414255 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:42.414255 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:42.421856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-07de1161-25b5-4d9e-8bba-781c3423ceeb req-fcc2e6e5-644c-449a-a0a7-0179b8a6629a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.422419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-07de1161-25b5-4d9e-8bba-781c3423ceeb req-fcc2e6e5-644c-449a-a0a7-0179b8a6629a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.433904 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-07de1161-25b5-4d9e-8bba-781c3423ceeb req-fcc2e6e5-644c-449a-a0a7-0179b8a6629a service nova] Creating event network-changed:ce0bcb3d-2043-41d3-a1f4-e06134cff0af for instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 on nch2-master-1 Feb 12 21:11:42.438873 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-07de1161-25b5-4d9e-8bba-781c3423ceeb req-fcc2e6e5-644c-449a-a0a7-0179b8a6629a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033557 Feb 12 21:11:42.439382 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1306/2546] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:42.465445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.472912 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3ea609c-4767-4167-adc3-c9e88aaa559a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 200 len: 1513 microversion: 2.1 time: 0.165682 Feb 12 21:11:42.473767 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1241/2547] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:42.484331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.488039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.492132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.492665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.493575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.494298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.495414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.495919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.516511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.516981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.517844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.518366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.531018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.531577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.532111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lazy-loading 'fault' on Instance uuid fa7e1aca-9785-4119-a180-49e60318243e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:11:42.557636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:42.586290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17359f385cb64f9fa0fb079cb3cdae54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517a5f8cbeba42f6841e1eccf9c2914d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.594460 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-119b3fb5-5ddb-47a5-85cc-86acfc0da115 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 200 len: 1303 microversion: 2.1 time: 0.114090 Feb 12 21:11:42.597125 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1307/2548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:42.736228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.736845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.744331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.744793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.751026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.751525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.900479 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3666d559-5c52-487a-83c5-d32eaa6e6723 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "DELETE /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 204 len: 0 microversion: 2.1 time: 0.413455 Feb 12 21:11:42.901084 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1242/2549] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:42 2022] DELETE /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:11:42.907362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.909302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.916171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.916873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.918032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.918671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.921449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:42.931226 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b48489b4-debf-4928-a0c5-4af9dd5e955d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.198631 Feb 12 21:11:42.932178 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1308/2550] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:42.937632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:42.938501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:42.944927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.945421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:42.946251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:42.946701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.100888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.109486 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff74e925-1067-4efe-b5d5-287ea97d4bcc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 200 len: 1519 microversion: 2.1 time: 0.175450 Feb 12 21:11:43.119966 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1309/2551] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:43.322937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:43.323554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:43.329705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.330436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.331783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.332239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.386154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.392785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.394289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.395576 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbd77e03-27ed-4800-b389-5e36a225c0e9 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.493382 Feb 12 21:11:43.396141 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1243/2552] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:42 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:43.415207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:43.415892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:43.423228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.423761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.424969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.425654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.493559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.501313 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c4b8a1c-46ce-4075-abd8-5e49265168aa tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1526 microversion: 2.1 time: 0.182171 Feb 12 21:11:43.501902 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1310/2553] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:43 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:43.611696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:43.612316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] [instance: fa7e1aca-9785-4119-a180-49e60318243e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:43.618494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.619101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.619855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.620299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.635629 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] HTTP exception thrown: Instance fa7e1aca-9785-4119-a180-49e60318243e could not be found. Feb 12 21:11:43.636238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] Returning 404 to user: Instance fa7e1aca-9785-4119-a180-49e60318243e could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:43.637085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-784a1f6e-d38c-489f-b6f9-419f39685530 tempest-ServersAdminTestJSON-1716311096 tempest-ServersAdminTestJSON-1716311096-project] 10.222.0.31 "GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e" status: 404 len: 111 microversion: 2.1 time: 0.029108 Feb 12 21:11:43.637688 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1311/2554] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:43 2022] GET /compute/v2.1/servers/fa7e1aca-9785-4119-a180-49e60318243e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:11:43.746638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.756567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.761398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:43.762110 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10af40e7-186d-45c7-89b0-b008224647a6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.353222 Feb 12 21:11:43.762611 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1244/2555] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:43 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:43.955187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:43.955187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:43.961878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.962354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:43.963169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:43.963614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.106829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:44.114689 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4fed15aa-d1d9-481d-aeff-15c37a118ea9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.166950 Feb 12 21:11:44.122183 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1312/2556] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:43 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:44.131941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:44.132734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:44.139429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.139876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.140655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.141148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.375730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:44.384312 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b434a010-a023-43c3-9b80-088bbf25dd3f tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 200 len: 1519 microversion: 2.1 time: 0.256078 Feb 12 21:11:44.384910 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1245/2557] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:44 2022] GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:44.418382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:44.419347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:44.425758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.431293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.431293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.431293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.466427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-04152d45-06c8-43fb-9400-bd5c658713d3 req-c36d0751-e913-4197-a01a-38bceb859987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd", "name": "network-vif-deleted", "tag": "c0e4abe5-512a-438d-9ee8-c182fa52f022"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:44.469005 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:44.469005 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:44.477136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-04152d45-06c8-43fb-9400-bd5c658713d3 req-c36d0751-e913-4197-a01a-38bceb859987 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.483386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-04152d45-06c8-43fb-9400-bd5c658713d3 req-c36d0751-e913-4197-a01a-38bceb859987 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.489491 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-04152d45-06c8-43fb-9400-bd5c658713d3 req-c36d0751-e913-4197-a01a-38bceb859987 service nova] Creating event network-vif-deleted:c0e4abe5-512a-438d-9ee8-c182fa52f022 for instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd on nch2-master-1 Feb 12 21:11:44.495658 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-04152d45-06c8-43fb-9400-bd5c658713d3 req-c36d0751-e913-4197-a01a-38bceb859987 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Feb 12 21:11:44.496807 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1246/2558] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:44.521935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:44.523845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:44.532453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.538150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.539662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.540410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.599676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.599676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.600343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lazy-loading 'fault' on Instance uuid 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:11:44.654933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d49d7210e1490da25ef76c213f6059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9627e1d31e814deb8265e43f63ac807c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:44.669950 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-063fef3e-1f19-4b09-997c-3ddc28a2997a tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 200 len: 1314 microversion: 2.1 time: 0.148591 Feb 12 21:11:44.671214 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1247/2559] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:44 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:44.687304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:44.699918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:44.701541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:44.702718 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-af419617-e2a0-41ff-acd3-7ec8394045ff tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.288372 Feb 12 21:11:44.703822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1313/2560] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:44 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:44.781430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:44.788949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:44.792459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.793460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:44.794516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:44.795233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.034312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:45.044431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:45.045991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:45.047165 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4f2af5a-81b6-45a2-90f7-56a1215dc4af tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.270591 Feb 12 21:11:45.047899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1248/2561] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:44 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:45.138260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:45.139338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:45.147580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.148305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.149513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.150246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.329988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:45.342367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03b2e6d7-72fd-4811-b531-b3548bb54a94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.205169 Feb 12 21:11:45.342367 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1314/2562] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:45 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:45.401419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:45.402173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:45.415624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.416195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.417246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.419883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.462227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.463005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.464480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lazy-loading 'fault' on Instance uuid 13154ac3-ea21-4e42-874e-47df8fc0774a {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:11:45.513953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:45.521870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70be4a99-6e2a-42f1-8447-f7a75daf5f30 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 200 len: 1312 microversion: 2.1 time: 0.124438 Feb 12 21:11:45.522461 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1249/2563] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:45 2022] GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:45.688554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:45.689209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] [instance: 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:45.699240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.699934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.700969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.701862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.721168 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] HTTP exception thrown: Instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd could not be found. Feb 12 21:11:45.721168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] Returning 404 to user: Instance 0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:45.721168 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d25514d6-24c9-4e66-928e-1933e0238c51 tempest-FloatingIPsAssociationTestJSON-1723183957 tempest-FloatingIPsAssociationTestJSON-1723183957-project] 10.222.0.31 "GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd" status: 404 len: 111 microversion: 2.1 time: 0.034461 Feb 12 21:11:45.721168 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1315/2564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:45 2022] GET /compute/v2.1/servers/0f7b2ea8-8f39-4caa-9afc-4577ff6e9dbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:45.722215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:45.722901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:45.735618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.736073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:45.736866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:45.737298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.069456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.070871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:46.078708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.078934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.080049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.080487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.292293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.308377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.311218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.312616 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3894105e-1f52-46d3-bfeb-e42dfdc09d95 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.249334 Feb 12 21:11:46.324120 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1316/2565] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:46.324636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.333068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.335625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.337726 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98f49d50-2afb-4d51-8df2-9f3b37cf0436 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.618804 Feb 12 21:11:46.340418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1250/2566] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:45 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:46.364319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.364961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:46.373976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.374626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.376034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.377014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.536869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ead5b1a7-49fd-401e-abf7-486cc12973b7 req-efb0be8d-670d-4364-9897-e234ff3cb079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13154ac3-ea21-4e42-874e-47df8fc0774a", "name": "network-vif-deleted", "tag": "7de9234c-8a3c-4d65-9cee-718d58f221b1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:46.540298 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:46.540298 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:46.545707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.556506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-06a9a337-8cad-4adb-8811-34bdf08d2af3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.198855 Feb 12 21:11:46.557510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ead5b1a7-49fd-401e-abf7-486cc12973b7 req-efb0be8d-670d-4364-9897-e234ff3cb079 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.557880 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1317/2567] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:46.563509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.564705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:46.565640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ead5b1a7-49fd-401e-abf7-486cc12973b7 req-efb0be8d-670d-4364-9897-e234ff3cb079 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.572721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.573715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.574774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.575437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.583945 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ead5b1a7-49fd-401e-abf7-486cc12973b7 req-efb0be8d-670d-4364-9897-e234ff3cb079 service nova] Creating event network-vif-deleted:7de9234c-8a3c-4d65-9cee-718d58f221b1 for instance 13154ac3-ea21-4e42-874e-47df8fc0774a on nch2-master-1 Feb 12 21:11:46.589661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ead5b1a7-49fd-401e-abf7-486cc12973b7 req-efb0be8d-670d-4364-9897-e234ff3cb079 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056840 Feb 12 21:11:46.590254 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1251/2568] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:11:46.594028 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] HTTP exception thrown: Instance 13154ac3-ea21-4e42-874e-47df8fc0774a could not be found. Feb 12 21:11:46.595418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 404 to user: Instance 13154ac3-ea21-4e42-874e-47df8fc0774a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:46.596706 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77680655-f0a8-4903-a1af-e9d4f1ec60e6 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 404 len: 111 microversion: 2.1 time: 0.037610 Feb 12 21:11:46.597878 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1318/2569] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:46.608036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.612144 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:46.612144 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:46.613708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.614857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:46.621501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.624323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.624323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.624323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.711292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea47c66d-39a7-4eea-9df8-8dfa9e6f40b5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.107449 Feb 12 21:11:46.712337 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1252/2570] 10.222.0.31 () {58 vars in 1229 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:11:46.722922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ed41cad5-4a26-4d6c-9bc1-56d127cb6783 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.725921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ed41cad5-4a26-4d6c-9bc1-56d127cb6783 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:46.726955 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ed41cad5-4a26-4d6c-9bc1-56d127cb6783 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.007777 Feb 12 21:11:46.728031 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1319/2571] 10.222.0.31 () {58 vars in 1181 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:11:46.743004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.749607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.749607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:46.758898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.759351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.760168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.760605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.796936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:11:46.831234 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2b707da-b1f8-4d3c-b69c-87a07ef4206e tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.093394 Feb 12 21:11:46.837610 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1253/2572] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers => generated 681 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:46.842574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.846329 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:46.846329 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:46.847740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.849145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.servers [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Removing options 'limit' from query {{(pid=141727) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1488}} Feb 12 21:11:46.850820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:46.863830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.869202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.869202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:46.869202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:46.901982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:11:46.934978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2e8de94-f22f-4a05-9848-5f8acbfebe02 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.096405 Feb 12 21:11:46.936226 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1320/2573] 10.222.0.31 () {58 vars in 1143 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:46.947908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5763801-7dc4-4a28-9eb4-6d7e26abf2fc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.950138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5763801-7dc4-4a28-9eb4-6d7e26abf2fc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:46.961147 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5763801-7dc4-4a28-9eb4-6d7e26abf2fc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.007124 Feb 12 21:11:46.961147 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1254/2574] 10.222.0.31 () {58 vars in 1141 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:11:46.973422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db54b3cb-118f-4202-abf0-6973a16b4b68 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.975638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db54b3cb-118f-4202-abf0-6973a16b4b68 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:46.976452 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db54b3cb-118f-4202-abf0-6973a16b4b68 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.006781 Feb 12 21:11:46.976978 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1321/2575] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:11:46.995874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab08816e-cc9d-4053-b00f-a9f413602441 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:46.995874 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:46.995874 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:46.995874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab08816e-cc9d-4053-b00f-a9f413602441 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:46.995874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab08816e-cc9d-4053-b00f-a9f413602441 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:46.999515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.servers [None req-ab08816e-cc9d-4053-b00f-a9f413602441 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Flavor 'non_existing_flavor' could not be found {{(pid=141726) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Feb 12 21:11:47.000616 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab08816e-cc9d-4053-b00f-a9f413602441 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018460 Feb 12 21:11:47.005387 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1255/2576] 10.222.0.31 () {58 vars in 1177 bytes} [Sat Feb 12 21:11:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:11:47.013197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.017020 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:47.017020 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:47.018246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.029548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:47.029548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.029548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.029548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.029548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.117962 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-311e3f7d-90c5-41ed-ac8f-4494575443d4 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.108540 Feb 12 21:11:47.121497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1322/2577] 10.222.0.31 () {58 vars in 1173 bytes} [Sat Feb 12 21:11:47 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:11:47.129471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.134583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.135397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:47.142901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.142901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.142901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.143592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.255922 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a3c0feb-e3e8-46bc-b1ed-2540ba84fe4c tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.129943 Feb 12 21:11:47.263571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1256/2578] 10.222.0.31 () {58 vars in 1183 bytes} [Sat Feb 12 21:11:47 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:11:47.270557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.291640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.292466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:47.305148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.305992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.308160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.308321 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2444f949-6a73-441b-ba14-00cee9a65aa2 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] 10.222.0.31 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.148789 Feb 12 21:11:47.308978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.314200 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1323/2579] 10.222.0.31 () {58 vars in 1127 bytes} [Sat Feb 12 21:11:47 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 21:11:47.323426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b98bc3b-c5b9-45c3-b5a0-017983b9d7df tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Calling method '.version_select at 0x7fa904073b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.349665 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1b98bc3b-c5b9-45c3-b5a0-017983b9d7df tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] HTTP exception thrown: Image not found. Feb 12 21:11:47.352162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b98bc3b-c5b9-45c3-b5a0-017983b9d7df tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:47.359229 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b98bc3b-c5b9-45c3-b5a0-017983b9d7df tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] 10.222.0.31 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.037772 Feb 12 21:11:47.369534 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1324/2580] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 21:11:47 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:47.374503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.376847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:47.394174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.395421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.396594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.397075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.476381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:11:47.601590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.610201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.611121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.634566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.639405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.641413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.643571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1e5526a-6b89-4321-9c09-bd5658f5272e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.272933 Feb 12 21:11:47.644717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1325/2581] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:47 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:47.658405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e61edec8-4a61-4f87-ab02-0115fb68ac75 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Calling method '.version_select at 0x7fa8fe06a160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.728544 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-e61edec8-4a61-4f87-ab02-0115fb68ac75 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] HTTP exception thrown: Image not found. Feb 12 21:11:47.730155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e61edec8-4a61-4f87-ab02-0115fb68ac75 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:47.731572 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e61edec8-4a61-4f87-ab02-0115fb68ac75 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] 10.222.0.31 "DELETE /compute/v2.1/images/ef41aa31-7f76-4add-8795-cc2a1c4eef2j" status: 404 len: 62 microversion: 2.1 time: 0.085694 Feb 12 21:11:47.732522 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1326/2582] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:47 2022] DELETE /compute/v2.1/images/ef41aa31-7f76-4add-8795-cc2a1c4eef2j => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:47.738323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.739958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:47.755441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.756721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.757819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.758868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.870920 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c48a713-72ef-4431-a79c-a3b6b7169587 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 3019 microversion: 2.1 time: 0.606187 Feb 12 21:11:47.871617 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1257/2583] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:11:47 2022] GET /compute/v2.1/servers/detail => generated 3019 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:47.878061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:47.880555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:47.889297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.889911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.890933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:47.891545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:47.976748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.987332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.989325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:47.991496 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-78d2648c-a2aa-4abc-b619-ec8b3be06b91 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.256558 Feb 12 21:11:47.992315 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1327/2584] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:47 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:47.998618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-57776dff-3f23-4c33-af74-45c5be0287e0 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Calling method '.version_select at 0x7fa8fe06a3a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.020477 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-57776dff-3f23-4c33-af74-45c5be0287e0 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] HTTP exception thrown: Image not found. Feb 12 21:11:48.020477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-57776dff-3f23-4c33-af74-45c5be0287e0 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:48.020939 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-57776dff-3f23-4c33-af74-45c5be0287e0 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] 10.222.0.31 "DELETE /compute/v2.1/images/98597de1-73a8-4dd2-9d32-6fd6b95af0671" status: 404 len: 62 microversion: 2.1 time: 0.027307 Feb 12 21:11:48.021926 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1328/2585] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:47 2022] DELETE /compute/v2.1/images/98597de1-73a8-4dd2-9d32-6fd6b95af0671 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:48.026782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e47a409d-d68c-4a6d-9094-e09158609c4a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.030912 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:48.030912 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:48.032395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e47a409d-d68c-4a6d-9094-e09158609c4a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:48.033734 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e47a409d-d68c-4a6d-9094-e09158609c4a tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010451 Feb 12 21:11:48.035123 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1329/2586] 10.222.0.31 () {58 vars in 1177 bytes} [Sat Feb 12 21:11:48 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:11:48.047667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f42b41c-88ae-4f5c-950b-e33df1e3c251 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Calling method '.version_select at 0x7fa90801d8b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.072826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7f42b41c-88ae-4f5c-950b-e33df1e3c251 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] HTTP exception thrown: Image not found. Feb 12 21:11:48.074066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f42b41c-88ae-4f5c-950b-e33df1e3c251 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:48.074318 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f42b41c-88ae-4f5c-950b-e33df1e3c251 tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] 10.222.0.31 "DELETE /compute/v2.1/images/tempest-invalid-1612922819" status: 404 len: 62 microversion: 2.1 time: 0.031435 Feb 12 21:11:48.075089 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1330/2587] 10.222.0.31 () {58 vars in 1205 bytes} [Sat Feb 12 21:11:48 2022] DELETE /compute/v2.1/images/tempest-invalid-1612922819 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:48.080099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.093018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:48.102131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Searching by: {'deleted': False, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:11:48.110830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.111577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.112699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.113539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.144205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:11:48.193116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52cd6564-9d71-440d-9b56-ff70afc99989 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.116811 Feb 12 21:11:48.197771 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1331/2588] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:11:48 2022] GET /compute/v2.1/servers => generated 681 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:48.205122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c1707dcd-f895-47cf-b097-bbefa3b2c46f tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Calling method '.version_select at 0x7fa8fe1fbc10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.230204 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c1707dcd-f895-47cf-b097-bbefa3b2c46f tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] HTTP exception thrown: Image not found. Feb 12 21:11:48.231280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c1707dcd-f895-47cf-b097-bbefa3b2c46f tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:48.232324 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c1707dcd-f895-47cf-b097-bbefa3b2c46f tempest-ImagesDeleteNegativeTestJSON-102717130 tempest-ImagesDeleteNegativeTestJSON-102717130-project] 10.222.0.31 "DELETE /compute/v2.1/images/358bd26f-d286-4c6f-8131-65c25667c8d6" status: 404 len: 62 microversion: 2.1 time: 0.031796 Feb 12 21:11:48.233424 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1332/2589] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:48 2022] DELETE /compute/v2.1/images/358bd26f-d286-4c6f-8131-65c25667c8d6 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:48.244065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.244065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:48.252574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.253347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.254376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.255976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.276323 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] HTTP exception thrown: Instance 13154ac3-ea21-4e42-874e-47df8fc0774a could not be found. Feb 12 21:11:48.277876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 404 to user: Instance 13154ac3-ea21-4e42-874e-47df8fc0774a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:48.279307 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c4895e56-c1db-4bff-9586-88961fa01675 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "DELETE /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 404 len: 111 microversion: 2.1 time: 0.044273 Feb 12 21:11:48.280398 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1333/2590] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:48 2022] DELETE /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:48.294033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.294837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:48.304026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.305961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.307052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.307689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.347747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:48.470359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:48.479111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-65b91acf-c592-4b60-86be-2a193a3f51f1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.606039 Feb 12 21:11:48.480043 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1258/2591] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:47 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:48.664279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.667660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:48.677307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.678711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.682239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.684093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.835020 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b78fe1f-b663-4924-b23a-26389209a7e5 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5" status: 204 len: 0 microversion: 2.1 time: 0.547619 Feb 12 21:11:48.835020 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1334/2592] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:48 2022] DELETE /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:48.853088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:48.857837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:48.870458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:48.873322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.878758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.879450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:48.881920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:48.884150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:48.885330 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f129a311-8d56-46d3-b762-904f909f3743 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.226872 Feb 12 21:11:48.889692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:48.898207 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1259/2593] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:48 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:48.946006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:11:49.014457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:49.016367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:49.023450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.024336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.025607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.026285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.292643 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5f23c75-4c85-4834-8bb9-4233731a5e90 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "DELETE /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 204 len: 0 microversion: 2.1 time: 0.453158 Feb 12 21:11:49.294418 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1335/2594] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:11:48 2022] DELETE /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:49.306957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:49.308042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 13154ac3-ea21-4e42-874e-47df8fc0774a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:49.316524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.317144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.318215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.318411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.341492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] HTTP exception thrown: Instance 13154ac3-ea21-4e42-874e-47df8fc0774a could not be found. Feb 12 21:11:49.342391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 404 to user: Instance 13154ac3-ea21-4e42-874e-47df8fc0774a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:49.343402 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-521251d6-8272-4f5a-847f-5a164792a5b9 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a" status: 404 len: 111 microversion: 2.1 time: 0.044034 Feb 12 21:11:49.344296 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1336/2595] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:49 2022] GET /compute/v2.1/servers/13154ac3-ea21-4e42-874e-47df8fc0774a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:49.350558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:49.358736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:49.360858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:49.365287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:49.368613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:49.375002 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-42c557f3-af3d-4df1-88b6-a6e9248e0e7d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.364518 Feb 12 21:11:49.376142 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1260/2596] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:49 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:49.391957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.392418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.393234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.393721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.496199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:49.496823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:49.504219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.504682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.505558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.506544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.717685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:49.727979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-957abe6c-8da2-45cb-9556-f6347ccb968e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.235434 Feb 12 21:11:49.729453 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1261/2597] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:49 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:49.905180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:49.905996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:49.917208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.917208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:49.917786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:49.918228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:50.061233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.079925 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e37d40b-5c93-4570-a834-a9dfd458faf8 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5" status: 200 len: 1519 microversion: 2.1 time: 0.721354 Feb 12 21:11:50.088843 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1337/2598] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:49 2022] GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5 => generated 1519 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:50.108145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.116556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.118948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.120346 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82dca059-a0d7-4e7b-a51d-a2f9782c64df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.219851 Feb 12 21:11:50.120914 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1262/2599] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:49 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:50.252621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7b164263-c012-42b0-903a-ab2899a4b027 req-5517125e-633e-4dcb-828a-400b4f7716dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9045d14a-f3fd-4ac7-b7c3-80e22e9b0970", "name": "network-vif-plugged", "status": "completed", "tag": "ce0bcb3d-2043-41d3-a1f4-e06134cff0af"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:50.254392 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:50.254392 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:50.262958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7b164263-c012-42b0-903a-ab2899a4b027 req-5517125e-633e-4dcb-828a-400b4f7716dc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:50.263484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7b164263-c012-42b0-903a-ab2899a4b027 req-5517125e-633e-4dcb-828a-400b4f7716dc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:50.275427 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7b164263-c012-42b0-903a-ab2899a4b027 req-5517125e-633e-4dcb-828a-400b4f7716dc service nova] Creating event network-vif-plugged:ce0bcb3d-2043-41d3-a1f4-e06134cff0af for instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 on nch2-master-1 Feb 12 21:11:50.280659 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7b164263-c012-42b0-903a-ab2899a4b027 req-5517125e-633e-4dcb-828a-400b4f7716dc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Feb 12 21:11:50.281542 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1338/2600] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:50.395963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:50.397073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:50.410634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:50.411216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:50.414645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:50.415220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:50.764524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:50.773504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:50.773869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.779654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.781170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:50.786672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:50.787593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:50.788734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:50.788877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57949cdf-8a8b-41ec-b2a7-e742673b301d tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.396409 Feb 12 21:11:50.789818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1263/2601] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:50 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:50.790735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.104626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:51.105250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:51.112146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.112932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.113922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.114534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.114670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:51.123819 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-329f3049-54fb-45cf-8d8f-f6e5d926e481 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1307 microversion: 2.1 time: 0.380417 Feb 12 21:11:51.131910 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1339/2602] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:50 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:51.142444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:51.143064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:51.150706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.151096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.151899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.152349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.349290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:51.367951 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d444516-ce25-4aaa-8867-97816b0cfaa3 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5" status: 200 len: 1519 microversion: 2.1 time: 0.259410 Feb 12 21:11:51.367951 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1264/2603] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:51 2022] GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:51.414151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b41795ca-f1a9-4d14-a898-d4b1a63c13e1 req-7785741e-3251-44b2-bba3-7c4f4edfd11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d94d265-92b9-424f-8314-b0fb321f73b5", "name": "network-vif-deleted", "tag": "af1288cf-8eee-461b-8fdd-3ff82ef1f8c5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:51.415871 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:51.415871 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:51.438521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b41795ca-f1a9-4d14-a898-d4b1a63c13e1 req-7785741e-3251-44b2-bba3-7c4f4edfd11b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.442052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b41795ca-f1a9-4d14-a898-d4b1a63c13e1 req-7785741e-3251-44b2-bba3-7c4f4edfd11b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.466743 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b41795ca-f1a9-4d14-a898-d4b1a63c13e1 req-7785741e-3251-44b2-bba3-7c4f4edfd11b service nova] Creating event network-vif-deleted:af1288cf-8eee-461b-8fdd-3ff82ef1f8c5 for instance 8d94d265-92b9-424f-8314-b0fb321f73b5 on nch1-master-1 Feb 12 21:11:51.473000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b41795ca-f1a9-4d14-a898-d4b1a63c13e1 req-7785741e-3251-44b2-bba3-7c4f4edfd11b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067736 Feb 12 21:11:51.475500 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1265/2604] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:51.578439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c15e7cca-22ad-4170-9721-79c0d974dd07 req-3724e482-4b4a-4fa0-9f11-b1cf86b535fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92301117-2563-4606-aba3-80d2cdcf4214", "name": "network-vif-deleted", "tag": "6c2d4fff-ca67-4966-a06e-aaa926490420"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:51.581471 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:51.581471 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:51.592809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c15e7cca-22ad-4170-9721-79c0d974dd07 req-3724e482-4b4a-4fa0-9f11-b1cf86b535fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.593267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c15e7cca-22ad-4170-9721-79c0d974dd07 req-3724e482-4b4a-4fa0-9f11-b1cf86b535fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.609862 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c15e7cca-22ad-4170-9721-79c0d974dd07 req-3724e482-4b4a-4fa0-9f11-b1cf86b535fe service nova] Creating event network-vif-deleted:6c2d4fff-ca67-4966-a06e-aaa926490420 for instance 92301117-2563-4606-aba3-80d2cdcf4214 on nch2-master-1 Feb 12 21:11:51.616767 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c15e7cca-22ad-4170-9721-79c0d974dd07 req-3724e482-4b4a-4fa0-9f11-b1cf86b535fe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041661 Feb 12 21:11:51.617695 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1266/2605] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:51.655377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:51.665632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:51.667302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:51.668614 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2246fbd7-bd9b-4ef3-a885-e88136654076 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.533666 Feb 12 21:11:51.676072 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1340/2606] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:51 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:51.810704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:51.812242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:51.821009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.821683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:51.822493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:51.823125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.039136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7271e951-2082-4ed4-85d9-eccac2586832 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa8fec89ee0>, body: {"keypair": {"name": "tempest-keypair-545859005"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:52.053619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7271e951-2082-4ed4-85d9-eccac2586832 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:52.056923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.058726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7271e951-2082-4ed4-85d9-eccac2586832 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:52.066138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.067769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.069239 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-379440ab-fe2e-43db-ad6c-48b4450b7e04 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.264360 Feb 12 21:11:52.069878 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1267/2607] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:51 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:52.143556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:52.144161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:52.151136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.151583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.156070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.156070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.241818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7271e951-2082-4ed4-85d9-eccac2586832 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:52.248123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7271e951-2082-4ed4-85d9-eccac2586832 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:52.266667 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7271e951-2082-4ed4-85d9-eccac2586832 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.372550 Feb 12 21:11:52.267556 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1341/2608] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:51 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:11:52.279693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee404583-be48-484f-9989-361034162f3b tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fe1d7ca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:52.289078 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee404583-be48-484f-9989-361034162f3b tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs/tempest-keypair-545859005" status: 200 len: 706 microversion: 2.2 time: 0.013003 Feb 12 21:11:52.289877 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1342/2609] 10.222.0.31 () {60 vars in 1254 bytes} [Sat Feb 12 21:11:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-545859005 => generated 706 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:52.297555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-faf0f585-0507-420c-bdd3-61cc6b79a6c1 req-1d559821-ab30-4d6a-8908-fda3b8c010ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "name": "network-vif-plugged", "status": "completed", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:52.299435 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:52.299435 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:52.307680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-faf0f585-0507-420c-bdd3-61cc6b79a6c1 req-1d559821-ab30-4d6a-8908-fda3b8c010ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.307680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-faf0f585-0507-420c-bdd3-61cc6b79a6c1 req-1d559821-ab30-4d6a-8908-fda3b8c010ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.318132 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-faf0f585-0507-420c-bdd3-61cc6b79a6c1 req-1d559821-ab30-4d6a-8908-fda3b8c010ba service nova] Creating event network-vif-plugged:8a6d5784-855f-4db3-a849-95606d940801 for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 on nch2-master-1 Feb 12 21:11:52.323400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-faf0f585-0507-420c-bdd3-61cc6b79a6c1 req-1d559821-ab30-4d6a-8908-fda3b8c010ba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030021 Feb 12 21:11:52.324046 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1343/2610] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:11:52.328726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-761dd4f7-702b-4a80-9973-e067d2f06386 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fe1d7310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:52.333516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.341906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8e9732a-eabe-44ee-ac11-e77c05e8d025 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1486 microversion: 2.1 time: 0.201931 Feb 12 21:11:52.342717 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1268/2611] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:52 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1486 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:52.363977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb3b4395-86d1-4a00-af80-17ecce576743 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:52.370632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3b4395-86d1-4a00-af80-17ecce576743 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.371088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3b4395-86d1-4a00-af80-17ecce576743 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.444516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb3b4395-86d1-4a00-af80-17ecce576743 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Going to try to stop instance {{(pid=141726) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:11:52.497457 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-761dd4f7-702b-4a80-9973-e067d2f06386 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545859005" status: 204 len: 0 microversion: 2.2 time: 0.172385 Feb 12 21:11:52.498058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1344/2612] 10.222.0.31 () {60 vars in 1257 bytes} [Sat Feb 12 21:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545859005 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:52.504928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:52.505707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:52.513385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.513881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.514713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.515160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.548522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.549442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.550090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lazy-loading 'fault' on Instance uuid 8d94d265-92b9-424f-8314-b0fb321f73b5 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:11:52.604594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e22e951d6844d568a2fb90c8598e6b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8686c8d8414bd0a886dd2e33c3daf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.613281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f17d4fd-c34e-434d-8b05-f732434aafbc tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5" status: 200 len: 1312 microversion: 2.1 time: 0.113986 Feb 12 21:11:52.623508 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1345/2613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:52 2022] GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:52.628648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca2b7b64-d3c5-4d99-9fee-d0c0bb7994a4 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa8fed1f040>, body: {"keypair": {"name": "tempest-keypair-1501766871"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:52.646703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ca2b7b64-d3c5-4d99-9fee-d0c0bb7994a4 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:52.655169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ca2b7b64-d3c5-4d99-9fee-d0c0bb7994a4 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:52.681762 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb3b4395-86d1-4a00-af80-17ecce576743 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970/action" status: 202 len: 0 microversion: 2.1 time: 0.319259 Feb 12 21:11:52.681762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1269/2614] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:11:52 2022] POST /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:11:52.706511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:52.708454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:52.742840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.745116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.746400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.746945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.890959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.900518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.902345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:52.903875 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09ee9edf-2722-4c8c-9aad-08e614abc2a2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.213642 Feb 12 21:11:52.904672 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1270/2615] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:52 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:52.908359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ca2b7b64-d3c5-4d99-9fee-d0c0bb7994a4 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:52.909872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:52.910617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:52.914868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ca2b7b64-d3c5-4d99-9fee-d0c0bb7994a4 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:52.930425 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca2b7b64-d3c5-4d99-9fee-d0c0bb7994a4 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.305693 Feb 12 21:11:52.931346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1346/2616] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:52 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 307 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:52.937493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.937956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.938937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:52.939377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:52.940520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b2f8459-caec-4b59-b6e5-1855d0f27835 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fed561f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:53.023852 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b2f8459-caec-4b59-b6e5-1855d0f27835 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501766871" status: 204 len: 0 microversion: 2.2 time: 0.086913 Feb 12 21:11:53.024721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1347/2617] 10.222.0.31 () {60 vars in 1260 bytes} [Sat Feb 12 21:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501766871 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:53.034014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84de237e-4b72-4f36-aef3-7bc4ba64b680 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa8fed23ee0>, body: {"keypair": {"name": "tempest-keypair-1169706920", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:53.061468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-84de237e-4b72-4f36-aef3-7bc4ba64b680 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:53.067454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-84de237e-4b72-4f36-aef3-7bc4ba64b680 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:53.205887 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84de237e-4b72-4f36-aef3-7bc4ba64b680 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.175463 Feb 12 21:11:53.206519 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1348/2618] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:11:53 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Feb 12 21:11:53.220438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:53.221059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:53.229388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:53.229847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:53.231025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:53.235408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:53.376857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:53.387444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aee04fb7-cca6-4df3-ba22-deba45e98aae tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.481295 Feb 12 21:11:53.388515 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1271/2619] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:52 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:53.393619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c908515-0689-41a4-8950-a7c9bdf08d9a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fd8884c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:53.445122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:53.454533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:53.456049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:53.457211 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc30f6d7-1fd4-4d9f-9aca-3e495f91d543 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.240664 Feb 12 21:11:53.457811 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1349/2620] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:53 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:53.479892 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c908515-0689-41a4-8950-a7c9bdf08d9a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169706920" status: 204 len: 0 microversion: 2.2 time: 0.090147 Feb 12 21:11:53.480632 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1272/2621] 10.222.0.31 () {60 vars in 1260 bytes} [Sat Feb 12 21:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169706920 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:53.489670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c318fce6-66b2-4d61-b3ce-6e4a7cbb680a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa8fe1520d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-241248904"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:53.504613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c318fce6-66b2-4d61-b3ce-6e4a7cbb680a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:53.510085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c318fce6-66b2-4d61-b3ce-6e4a7cbb680a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:53.632024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:53.632646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 8d94d265-92b9-424f-8314-b0fb321f73b5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:53.639623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:53.640087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:53.641087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:53.641703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:53.656644 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] HTTP exception thrown: Instance 8d94d265-92b9-424f-8314-b0fb321f73b5 could not be found. Feb 12 21:11:53.657316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 404 to user: Instance 8d94d265-92b9-424f-8314-b0fb321f73b5 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:53.658372 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-05d82868-ee66-4609-a0e9-b7e8e9cc8e6d tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5" status: 404 len: 111 microversion: 2.1 time: 0.030395 Feb 12 21:11:53.658931 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1273/2622] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:53 2022] GET /compute/v2.1/servers/8d94d265-92b9-424f-8314-b0fb321f73b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:11:53.667232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:53.667866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] [instance: 92301117-2563-4606-aba3-80d2cdcf4214] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:53.673960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:53.674412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:53.675185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:53.675617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:53.689049 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] HTTP exception thrown: Instance 92301117-2563-4606-aba3-80d2cdcf4214 could not be found. Feb 12 21:11:53.689662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] Returning 404 to user: Instance 92301117-2563-4606-aba3-80d2cdcf4214 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:53.690581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3753bf76-ba41-45ed-bcfb-c758dc15b672 tempest-ListServersNegativeTestJSON-1674191681 tempest-ListServersNegativeTestJSON-1674191681-project] 10.222.0.31 "GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214" status: 404 len: 111 microversion: 2.1 time: 0.026806 Feb 12 21:11:53.691110 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1274/2623] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:53 2022] GET /compute/v2.1/servers/92301117-2563-4606-aba3-80d2cdcf4214 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:11:53.875854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c318fce6-66b2-4d61-b3ce-6e4a7cbb680a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:53.881169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c318fce6-66b2-4d61-b3ce-6e4a7cbb680a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:53.897174 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c318fce6-66b2-4d61-b3ce-6e4a7cbb680a tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.410724 Feb 12 21:11:53.898210 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1350/2624] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:53 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:53.907416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-46978e9f-9085-42da-bc58-e56d2502c136 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa8fed23430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-431592830"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:53.921399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-46978e9f-9085-42da-bc58-e56d2502c136 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:53.926482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-46978e9f-9085-42da-bc58-e56d2502c136 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:53.983142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1c70588-e7b2-4941-912f-e8c5bc5deb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Calling method '.version_select at 0x7fa907eb4700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:54.004058 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a1c70588-e7b2-4941-912f-e8c5bc5deb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] HTTP exception thrown: Image not found. Feb 12 21:11:54.004664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1c70588-e7b2-4941-912f-e8c5bc5deb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:54.005577 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1c70588-e7b2-4941-912f-e8c5bc5deb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] 10.222.0.31 "DELETE /compute/v2.1/images/c4793fb5-61e4-4596-94b3-97edc1604dc0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.149543 Feb 12 21:11:54.006238 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1275/2625] 10.222.0.31 () {58 vars in 1292 bytes} [Sat Feb 12 21:11:53 2022] DELETE /compute/v2.1/images/c4793fb5-61e4-4596-94b3-97edc1604dc0/metadata/os_distro => generated 62 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:11:54.012809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:54.013465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:54.020436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.024132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.024132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.024132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.393239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:54.407373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:54.409005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:54.410518 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c7e83d1-5a67-4f54-a264-fea4b0bfd58f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.402538 Feb 12 21:11:54.411650 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1276/2626] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:54 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:54.416553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb1d251b-a093-4ca7-9b04-56251968eb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Calling method '.version_select at 0x7fa907fbea60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-eb1d251b-a093-4ca7-9b04-56251968eb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] HTTP exception thrown: Image not found. Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb1d251b-a093-4ca7-9b04-56251968eb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb1d251b-a093-4ca7-9b04-56251968eb3e tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] 10.222.0.31 "GET /compute/v2.1/images/94abe766-11a4-4a8d-aa6c-7ad2675689ab/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.037717 Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1277/2627] 10.222.0.31 () {58 vars in 1292 bytes} [Sat Feb 12 21:11:54 2022] GET /compute/v2.1/images/94abe766-11a4-4a8d-aa6c-7ad2675689ab/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bd012a4b-bdc1-4159-a307-644f946fd1f6 req-1c229cc7-30e0-4129-9b53-338e533df03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "b2910da7-aefa-45b5-ab32-c4167ae080b7"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:54.458107 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:11:54.467258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bd012a4b-bdc1-4159-a307-644f946fd1f6 req-1c229cc7-30e0-4129-9b53-338e533df03c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.467710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bd012a4b-bdc1-4159-a307-644f946fd1f6 req-1c229cc7-30e0-4129-9b53-338e533df03c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.479500 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bd012a4b-bdc1-4159-a307-644f946fd1f6 req-1c229cc7-30e0-4129-9b53-338e533df03c service nova] Creating event network-vif-plugged:b2910da7-aefa-45b5-ab32-c4167ae080b7 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:54.485111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bd012a4b-bdc1-4159-a307-644f946fd1f6 req-1c229cc7-30e0-4129-9b53-338e533df03c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Feb 12 21:11:54.485750 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1278/2628] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:54.491133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:54.492467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:54.498656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.503920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.503920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.503920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.686851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-46978e9f-9085-42da-bc58-e56d2502c136 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:54.691891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:54.694442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-46978e9f-9085-42da-bc58-e56d2502c136 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:54.700794 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13972ff5-360e-4fd0-930e-b6b2f9ee8d46 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.213823 Feb 12 21:11:54.713101 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1279/2629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:54 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:54.719180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61503cee-934c-4222-b246-90cd0e102087 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Calling method '.version_select at 0x7fa907fbedc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:54.730622 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-46978e9f-9085-42da-bc58-e56d2502c136 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.826793 Feb 12 21:11:54.731229 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1351/2630] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:53 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 828 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:11:54.736794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:54.738030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:54.750380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.750838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.752500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:54.754170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:54.757381 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-61503cee-934c-4222-b246-90cd0e102087 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] HTTP exception thrown: Image not found. Feb 12 21:11:54.758503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61503cee-934c-4222-b246-90cd0e102087 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:54.759984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61503cee-934c-4222-b246-90cd0e102087 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] 10.222.0.31 "GET /compute/v2.1/images/3e09c520-9166-4fa1-b2ac-e6347edad9bf/metadata" status: 404 len: 62 microversion: 2.1 time: 0.045556 Feb 12 21:11:54.765087 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1280/2631] 10.222.0.31 () {58 vars in 1259 bytes} [Sat Feb 12 21:11:54 2022] GET /compute/v2.1/images/3e09c520-9166-4fa1-b2ac-e6347edad9bf/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:54.769914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ef3b5a8-db1c-4796-b524-bb2ac8136ab0 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa907fbe9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1811560582"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:54.788517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-1ef3b5a8-db1c-4796-b524-bb2ac8136ab0 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:54.794222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-1ef3b5a8-db1c-4796-b524-bb2ac8136ab0 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:55.009101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.018965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.020616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.022417 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3614ae26-7537-485d-ada6-e866de322426 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.289487 Feb 12 21:11:55.023658 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1352/2632] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:54 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:55.028487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f2c40ac-acd7-406a-aa83-2f91e1033539 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Action: 'update_all', calling method: .version_select at 0x7fa8fecc0f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:55.050610 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1f2c40ac-acd7-406a-aa83-2f91e1033539 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] HTTP exception thrown: Image not found. Feb 12 21:11:55.051285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f2c40ac-acd7-406a-aa83-2f91e1033539 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:55.052383 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f2c40ac-acd7-406a-aa83-2f91e1033539 tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] 10.222.0.31 "PUT /compute/v2.1/images/c933317e-0c4e-4912-aae1-9e81ee825d45/metadata" status: 404 len: 62 microversion: 2.1 time: 0.027727 Feb 12 21:11:55.053113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1353/2633] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:11:55 2022] PUT /compute/v2.1/images/c933317e-0c4e-4912-aae1-9e81ee825d45/metadata => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:55.062807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01afd2aa-f009-4c6c-938c-f2cb787649ee tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Action: 'update', calling method: .version_select at 0x7fa8fed1f040>, body: {"meta": {"os_distro": "alt"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:55.093566 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-01afd2aa-f009-4c6c-938c-f2cb787649ee tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] HTTP exception thrown: Image not found. Feb 12 21:11:55.093566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01afd2aa-f009-4c6c-938c-f2cb787649ee tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:55.093566 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-01afd2aa-f009-4c6c-938c-f2cb787649ee tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] 10.222.0.31 "PUT /compute/v2.1/images/7172f27d-1fd6-451c-86d2-5dbc86cbe7e0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.028064 Feb 12 21:11:55.093566 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1354/2634] 10.222.0.31 () {60 vars in 1309 bytes} [Sat Feb 12 21:11:55 2022] PUT /compute/v2.1/images/7172f27d-1fd6-451c-86d2-5dbc86cbe7e0/metadata/os_distro => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:11:55.096219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25203152-6d28-444a-aca7-bb88b616ffeb tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Action: 'create', calling method: .version_select at 0x7fa8fed560d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:55.101265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-1ef3b5a8-db1c-4796-b524-bb2ac8136ab0 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:55.107423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-1ef3b5a8-db1c-4796-b524-bb2ac8136ab0 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:55.117920 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-25203152-6d28-444a-aca7-bb88b616ffeb tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] HTTP exception thrown: Image not found. Feb 12 21:11:55.118525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25203152-6d28-444a-aca7-bb88b616ffeb tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:55.119359 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25203152-6d28-444a-aca7-bb88b616ffeb tempest-ImagesMetadataNegativeTestJSON-770739693 tempest-ImagesMetadataNegativeTestJSON-770739693-project] 10.222.0.31 "POST /compute/v2.1/images/3346644f-3441-4192-bd32-8256ed6bac35/metadata" status: 404 len: 62 microversion: 2.1 time: 0.026972 Feb 12 21:11:55.119935 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1355/2635] 10.222.0.31 () {60 vars in 1280 bytes} [Sat Feb 12 21:11:55 2022] POST /compute/v2.1/images/3346644f-3441-4192-bd32-8256ed6bac35/metadata => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:11:55.123909 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ef3b5a8-db1c-4796-b524-bb2ac8136ab0 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.357666 Feb 12 21:11:55.124506 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1281/2636] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:54 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 359 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:55.135719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3141257-5f4f-4af1-ba13-b5503bb5eb0b tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa9040734c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:55.139191 ncdv-master-1 devstack@n-api.service[141727]: WARNING oslo_db.sqlalchemy.utils [None req-d3141257-5f4f-4af1-ba13-b5503bb5eb0b tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 12 21:11:55.151803 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3141257-5f4f-4af1-ba13-b5503bb5eb0b tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.021772 Feb 12 21:11:55.152527 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1356/2637] 10.222.0.31 () {60 vars in 1176 bytes} [Sat Feb 12 21:11:55 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:55.163974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a8151df-9351-4f48-b7bd-5ae65bd6dca8 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa907fbe1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:55.268750 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a8151df-9351-4f48-b7bd-5ae65bd6dca8 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1811560582" status: 204 len: 0 microversion: 2.2 time: 0.109097 Feb 12 21:11:55.269347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1282/2638] 10.222.0.31 () {60 vars in 1320 bytes} [Sat Feb 12 21:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1811560582 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:55.278124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4dc857e3-354f-46a8-97fd-1078341b94fd tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fecc0940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:55.428376 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4dc857e3-354f-46a8-97fd-1078341b94fd tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-431592830" status: 204 len: 0 microversion: 2.2 time: 0.153905 Feb 12 21:11:55.429224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:55.429884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:55.433079 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1357/2639] 10.222.0.31 () {60 vars in 1317 bytes} [Sat Feb 12 21:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-431592830 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:55.441536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19640029-d70c-43c7-aa75-57f049cb8ebd tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fed23790>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:55.446122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:55.446598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:55.449905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:55.453059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:55.553038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19640029-d70c-43c7-aa75-57f049cb8ebd tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-241248904" status: 204 len: 0 microversion: 2.2 time: 0.115237 Feb 12 21:11:55.558353 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1358/2640] 10.222.0.31 () {60 vars in 1317 bytes} [Sat Feb 12 21:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-241248904 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:11:55.564119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d067cf52-ea72-460d-ac9b-f6e3333a5485 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa8fed413a0>, body: {"keypair": {"name": "tempest-keypair-483308653"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:55.607443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d067cf52-ea72-460d-ac9b-f6e3333a5485 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:55.621535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d067cf52-ea72-460d-ac9b-f6e3333a5485 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:55.641637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.654517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.656654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.658401 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8b70ffe4-d665-4add-b1eb-3f50d8f4c58d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1808 microversion: 2.20 time: 0.232575 Feb 12 21:11:55.659282 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1283/2641] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:55 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:55.720068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:55.720879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:55.728663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:55.733051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:55.733051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:55.733051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:55.948803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:55.957991 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c39b1a7-fd6b-4093-be04-ec8dd08f3cb8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.242159 Feb 12 21:11:55.971233 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1284/2642] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:55 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:56.042804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:56.043550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:56.057009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.059242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.059242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.061232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.387151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:56.392222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d067cf52-ea72-460d-ac9b-f6e3333a5485 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:56.398346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d067cf52-ea72-460d-ac9b-f6e3333a5485 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:56.400455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:56.402336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:56.404574 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8108d1fa-38f9-40a7-ae89-32a38e706c05 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.367300 Feb 12 21:11:56.406114 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1285/2643] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:56 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:56.426214 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d067cf52-ea72-460d-ac9b-f6e3333a5485 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.866689 Feb 12 21:11:56.426829 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1359/2644] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:55 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 868 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:56.436921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1988775d-27ba-42ea-a992-a0fd2785918c tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fd882d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:56.444860 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1988775d-27ba-42ea-a992-a0fd2785918c tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs/tempest-keypair-483308653" status: 200 len: 706 microversion: 2.2 time: 0.011786 Feb 12 21:11:56.445436 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1286/2645] 10.222.0.31 () {60 vars in 1254 bytes} [Sat Feb 12 21:11:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-483308653 => generated 706 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:56.455540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1f7d54d-a35e-4dd1-a860-9d75cd3666ef tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa8fec56940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:56.458509 ncdv-master-1 devstack@n-api.service[141727]: WARNING oslo_db.sqlalchemy.utils [None req-f1f7d54d-a35e-4dd1-a860-9d75cd3666ef tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 12 21:11:56.464603 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1f7d54d-a35e-4dd1-a860-9d75cd3666ef tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs" status: 200 len: 563 microversion: 2.2 time: 0.012812 Feb 12 21:11:56.465139 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1360/2646] 10.222.0.31 () {60 vars in 1176 bytes} [Sat Feb 12 21:11:56 2022] GET /compute/v2.1/os-keypairs => generated 563 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:11:56.474232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-41c12c6d-4b70-4539-8ae8-8709a3ef1978 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa907ff0af0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:56.512803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "cb16a4b9-5c35-4c83-b676-814b33f4354e"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "ea9dd83b-8155-49b9-9961-155b1a2273e6"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "c03b11d7-ad51-4a19-be11-d54473d9b412"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "db0ca88d-7497-4c86-9f77-a0e7753f1866"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:56.514717 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:56.514717 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:56.521879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.522535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.534724 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Creating event network-vif-plugged:cb16a4b9-5c35-4c83-b676-814b33f4354e for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:56.535248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Creating event network-vif-plugged:ea9dd83b-8155-49b9-9961-155b1a2273e6 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:56.535768 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Creating event network-vif-plugged:c03b11d7-ad51-4a19-be11-d54473d9b412 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:56.536272 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] Creating event network-vif-plugged:db0ca88d-7497-4c86-9f77-a0e7753f1866 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:56.542820 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-afaf4d4f-0187-43f0-bd47-467eb353eb44 req-976859cd-ae9c-4840-aca9-12ed2e81d67a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.033775 Feb 12 21:11:56.543610 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1361/2647] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:11:56.675943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-41c12c6d-4b70-4539-8ae8-8709a3ef1978 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483308653" status: 204 len: 0 microversion: 2.2 time: 0.205009 Feb 12 21:11:56.677347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1287/2648] 10.222.0.31 () {60 vars in 1257 bytes} [Sat Feb 12 21:11:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483308653 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:56.684880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:56.686470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:56.690304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Action: 'create', calling method: .version_select at 0x7fa907f82b80>, body: {"keypair": {"name": "tempest-keypair-274916478", "type": "x509"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:56.700936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.701721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.702916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.703359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.727077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:56.727319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:56.752433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.processutils [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcdzdrfzf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcdzdrfzf/temp.key -subj /CN=f909ed4af38b424596f53b86578f4385 -extensions v3_req_client {{(pid=141726) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:11:56.899922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:56.908969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:56.911298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:56.915030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a975277a-91fe-4252-817d-c910d369feb6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1795 microversion: 2.20 time: 0.238824 Feb 12 21:11:56.915030 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1362/2649] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:56 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1795 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:11:56.967719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.processutils [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcdzdrfzf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcdzdrfzf/temp.key -subj /CN=f909ed4af38b424596f53b86578f4385 -extensions v3_req_client" returned: 0 in 0.217s {{(pid=141726) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:11:56.969264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.processutils [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcdzdrfzf/temp.key -password pass: {{(pid=141726) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Feb 12 21:11:56.977818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:56.979203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:56.986240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.986825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.987641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:56.988088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:56.994769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.processutils [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcdzdrfzf/temp.key -password pass:" returned: 0 in 0.025s {{(pid=141726) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Feb 12 21:11:57.147408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:57.152705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Getting quotas for user f909ed4af38b424596f53b86578f4385 and project cd28c6c4d28f41e1b0d3af60d860f0a7. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:57.170444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a49b963b-6f46-4a6d-9a6c-4c94ff5704c5 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.484803 Feb 12 21:11:57.176406 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1288/2650] 10.222.0.31 () {62 vars in 1197 bytes} [Sat Feb 12 21:11:56 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:57.182668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d95dcc7-8cad-4b85-a8df-f4789c746cf6 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa907f821f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:57.192606 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d95dcc7-8cad-4b85-a8df-f4789c746cf6 tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs/tempest-keypair-274916478" status: 200 len: 1533 microversion: 2.2 time: 0.014955 Feb 12 21:11:57.201547 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1289/2651] 10.222.0.31 () {60 vars in 1254 bytes} [Sat Feb 12 21:11:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-274916478 => generated 1533 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:57.214751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6138f3a9-f63c-4479-9ab6-666923b8cdba tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa907ff0940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:57.221033 ncdv-master-1 devstack@n-api.service[141726]: WARNING oslo_db.sqlalchemy.utils [None req-6138f3a9-f63c-4479-9ab6-666923b8cdba tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 12 21:11:57.243219 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6138f3a9-f63c-4479-9ab6-666923b8cdba tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.036434 Feb 12 21:11:57.244853 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1290/2652] 10.222.0.31 () {60 vars in 1176 bytes} [Sat Feb 12 21:11:57 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:57.257923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-170869e7-7e26-4352-baca-d18c0b74caea tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] Calling method '.version_select at 0x7fa907e52ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:57.370427 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-170869e7-7e26-4352-baca-d18c0b74caea tempest-KeyPairsV22TestJSON-1388060325 tempest-KeyPairsV22TestJSON-1388060325-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274916478" status: 204 len: 0 microversion: 2.2 time: 0.118735 Feb 12 21:11:57.376725 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1291/2653] 10.222.0.31 () {60 vars in 1257 bytes} [Sat Feb 12 21:11:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274916478 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:11:57.391546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:57.400509 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d33616f-353e-4ab3-8c47-730ae8e280e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.428503 Feb 12 21:11:57.413785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1363/2654] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:56 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:57.424993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:57.425615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:57.433217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:57.433780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:57.434949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:57.435614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:57.716764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:57.728852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:57.730543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:57.731768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-546d73c9-8051-4128-aa0f-be44ead73762 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.311385 Feb 12 21:11:57.743602 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1292/2655] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:57 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:58.263279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b15de854-d676-479d-82f0-5ad0355b9bce tempest-ListImageFiltersNegativeTestJSON-1035253559 tempest-ListImageFiltersNegativeTestJSON-1035253559-project] Calling method '.version_select at 0x7fa8fecc08b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:58.284642 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b15de854-d676-479d-82f0-5ad0355b9bce tempest-ListImageFiltersNegativeTestJSON-1035253559 tempest-ListImageFiltersNegativeTestJSON-1035253559-project] HTTP exception thrown: Image not found. Feb 12 21:11:58.285250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b15de854-d676-479d-82f0-5ad0355b9bce tempest-ListImageFiltersNegativeTestJSON-1035253559 tempest-ListImageFiltersNegativeTestJSON-1035253559-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:11:58.286195 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b15de854-d676-479d-82f0-5ad0355b9bce tempest-ListImageFiltersNegativeTestJSON-1035253559 tempest-ListImageFiltersNegativeTestJSON-1035253559-project] 10.222.0.31 "GET /compute/v2.1/images/abb1a086-c932-4adb-927d-d8ecb65c882e" status: 404 len: 62 microversion: 2.1 time: 0.209640 Feb 12 21:11:58.286703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1364/2656] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:11:58 2022] GET /compute/v2.1/images/abb1a086-c932-4adb-927d-d8ecb65c882e => generated 62 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:11:58.419148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:58.419767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:58.426763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:58.428064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:58.428973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:58.429426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:58.570166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-eea95515-f27d-4db3-8bad-a2d7efd74819 req-784949f6-e9bb-485f-b452-b905360f5cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "335b0423-e329-43fd-bea1-28e4856ef8b9"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-plugged", "status": "completed", "tag": "17ba1c7f-90cf-4f91-a05e-68927bcbe7cc"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:58.573998 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:11:58.573998 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:11:58.581390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eea95515-f27d-4db3-8bad-a2d7efd74819 req-784949f6-e9bb-485f-b452-b905360f5cfd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:58.582066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eea95515-f27d-4db3-8bad-a2d7efd74819 req-784949f6-e9bb-485f-b452-b905360f5cfd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:58.582837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:58.592896 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28dd1ec0-1d2e-4287-8a38-c150d088a01c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.177341 Feb 12 21:11:58.593799 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1293/2657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:58 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:11:58.596506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-eea95515-f27d-4db3-8bad-a2d7efd74819 req-784949f6-e9bb-485f-b452-b905360f5cfd service nova] Creating event network-vif-plugged:335b0423-e329-43fd-bea1-28e4856ef8b9 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:58.596506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-eea95515-f27d-4db3-8bad-a2d7efd74819 req-784949f6-e9bb-485f-b452-b905360f5cfd service nova] Creating event network-vif-plugged:17ba1c7f-90cf-4f91-a05e-68927bcbe7cc for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:11:58.601958 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-eea95515-f27d-4db3-8bad-a2d7efd74819 req-784949f6-e9bb-485f-b452-b905360f5cfd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036263 Feb 12 21:11:58.603103 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1365/2658] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:11:58.753416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:58.754312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:58.764147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:58.767750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:58.768855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:58.773889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:59.056604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:59.066666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:59.068185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:59.069689 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9981d5f-7226-4543-adca-17b393892876 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.322633 Feb 12 21:11:59.070620 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1294/2659] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:11:58 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:11:59.148054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1450097914", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "58bc909b-cc56-4f2f-83e1-bb4ef072847b"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:11:59.203396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] validate_networks() for [('58bc909b-cc56-4f2f-83e1-bb4ef072847b', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:11:59.591785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:11:59.592370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:11:59.592680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:11:59.593087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:11:59.593922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:11:59.604137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:59.604594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:59.605553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:59.606203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:59.611141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:59.611737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:59.619795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:59.620256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:59.621058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:11:59.621540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:11:59.627408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Getting quotas for project 8a789726452342938ca48b6800ed43ac. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:11:59.635825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Getting quotas for user e1119ae97ce1444f9a61c508464d8f67 and project 8a789726452342938ca48b6800ed43ac. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:11:59.649542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:11:59.652248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:11:59.768087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3573b43b-74c6-4ba0-8405-c99fb73aeb5d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775243 Feb 12 21:11:59.769417 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1366/2660] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:11:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:11:59.787253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:59.795926 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-154612dd-a97a-453f-a2c4-12c89313a325 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.189139 Feb 12 21:11:59.797506 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1295/2661] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:59 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:11:59.810149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4e74638-fc71-4303-89c0-e1495fc6fbe8 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:11:59.810845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4e74638-fc71-4303-89c0-e1495fc6fbe8 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:11:59.896431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4e74638-fc71-4303-89c0-e1495fc6fbe8 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:11:59.904822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4e74638-fc71-4303-89c0-e1495fc6fbe8 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1216 microversion: 2.1 time: 0.105451 Feb 12 21:11:59.905433 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1296/2662] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:11:59 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:00.064554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f4786fc-c170-48e8-aa1b-7604b064651a tempest-AZV2TestJSON-915169452 tempest-AZV2TestJSON-915169452-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:00.066327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4786fc-c170-48e8-aa1b-7604b064651a tempest-AZV2TestJSON-915169452 tempest-AZV2TestJSON-915169452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:00.066943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4786fc-c170-48e8-aa1b-7604b064651a tempest-AZV2TestJSON-915169452 tempest-AZV2TestJSON-915169452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:00.067869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4786fc-c170-48e8-aa1b-7604b064651a tempest-AZV2TestJSON-915169452 tempest-AZV2TestJSON-915169452-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:00.069394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4786fc-c170-48e8-aa1b-7604b064651a tempest-AZV2TestJSON-915169452 tempest-AZV2TestJSON-915169452-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:00.089996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:00.091123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:00.098223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:00.098947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:00.100315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:00.100900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:00.105700 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f4786fc-c170-48e8-aa1b-7604b064651a tempest-AZV2TestJSON-915169452 tempest-AZV2TestJSON-915169452-project] 10.222.0.31 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.326025 Feb 12 21:12:00.106372 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1367/2663] 10.222.0.31 () {58 vars in 1163 bytes} [Sat Feb 12 21:11:59 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:12:00.313744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:00.325789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:00.329427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:00.329427 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0864074f-3303-4c37-a152-1d1cfccc40e6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.243943 Feb 12 21:12:00.329427 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1297/2664] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:00 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:00.814154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:00.815105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:00.837185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:00.838127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:00.839016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:00.839877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:00.978306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3868bb4b-b348-4029-9e94-8f2f76ebf9be tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa907e424c0>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:00.983381 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3868bb4b-b348-4029-9e94-8f2f76ebf9be tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Feb 12 21:12:00.984119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3868bb4b-b348-4029-9e94-8f2f76ebf9be tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:00.985205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3868bb4b-b348-4029-9e94-8f2f76ebf9be tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.144574 Feb 12 21:12:00.990293 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1298/2665] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:12:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:12:00.996216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a09f7b2c-6e9c-48b5-bf1f-2ccf3799e97d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:00.997082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a09f7b2c-6e9c-48b5-bf1f-2ccf3799e97d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:01.005619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:01.014611 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b711ae5d-3a9e-43a4-beb0-a4a7bd4cfe3a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.204140 Feb 12 21:12:01.022307 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1368/2666] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:00 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:01.022307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0aba30dd-8d9a-4478-a083-8f5a9633e8e1 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa90801dd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-142912576", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:01.035637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0aba30dd-8d9a-4478-a083-8f5a9633e8e1 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:01.040887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0aba30dd-8d9a-4478-a083-8f5a9633e8e1 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for user a68839eb3f48455eb7d6e5947e16bb72 and project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:01.060282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0aba30dd-8d9a-4478-a083-8f5a9633e8e1 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Feb 12 21:12:01.060895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0aba30dd-8d9a-4478-a083-8f5a9633e8e1 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:01.061760 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0aba30dd-8d9a-4478-a083-8f5a9633e8e1 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.045145 Feb 12 21:12:01.062312 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1369/2667] 10.222.0.31 () {60 vars in 1159 bytes} [Sat Feb 12 21:12:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:12:01.071989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddc30327-6298-4c1f-90f3-7834ffd3e15f tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa8fec3a820>, body: {"keypair": {"name": "tempest-keypair-1012439892"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:01.075735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a09f7b2c-6e9c-48b5-bf1f-2ccf3799e97d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:01.082209 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a09f7b2c-6e9c-48b5-bf1f-2ccf3799e97d tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1216 microversion: 2.1 time: 0.090114 Feb 12 21:12:01.082803 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1299/2668] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:00 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:01.089243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ddc30327-6298-4c1f-90f3-7834ffd3e15f tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:01.096895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ddc30327-6298-4c1f-90f3-7834ffd3e15f tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for user a68839eb3f48455eb7d6e5947e16bb72 and project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:01.348377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:01.349341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:01.359422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:01.359876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:01.361385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:01.362007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:01.561489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ddc30327-6298-4c1f-90f3-7834ffd3e15f tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:01.568384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:01.581187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ddc30327-6298-4c1f-90f3-7834ffd3e15f tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for user a68839eb3f48455eb7d6e5947e16bb72 and project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:01.582590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:01.584537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:01.586525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f1b83a9-66bb-4697-8758-765875d8f615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1880 microversion: 2.32 time: 0.242804 Feb 12 21:12:01.589192 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1300/2669] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:01 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1880 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:01.602379 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddc30327-6298-4c1f-90f3-7834ffd3e15f tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.534894 Feb 12 21:12:01.603244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1370/2670] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:12:01 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:01.614129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8baf9e1b-ff98-4e7c-9231-18a9d6322606 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa907ff0670>, body: {"keypair": {"name": "tempest-keypair-1012439892"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:01.628442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-8baf9e1b-ff98-4e7c-9231-18a9d6322606 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:01.634097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-8baf9e1b-ff98-4e7c-9231-18a9d6322606 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for user a68839eb3f48455eb7d6e5947e16bb72 and project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:01.789405 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8baf9e1b-ff98-4e7c-9231-18a9d6322606 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] HTTP exception thrown: Key pair 'tempest-keypair-1012439892' already exists. Feb 12 21:12:01.790027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8baf9e1b-ff98-4e7c-9231-18a9d6322606 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 409 to user: Key pair 'tempest-keypair-1012439892' already exists. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:01.790858 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8baf9e1b-ff98-4e7c-9231-18a9d6322606 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.180666 Feb 12 21:12:01.791515 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1301/2671] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:12:01 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:12:01.800113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60672d65-e83f-4aa0-922f-9e40259e56e8 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Calling method '.version_select at 0x7fa8fec3aee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:01.936073 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60672d65-e83f-4aa0-922f-9e40259e56e8 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012439892" status: 202 len: 0 microversion: 2.1 time: 0.139632 Feb 12 21:12:01.936784 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1371/2672] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012439892 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:12:01.947623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-990dadd5-b795-48fd-bea5-6b1de7086bc9 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa8fd909ca0>, body: {"keypair": {"name": ""}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:01.948837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-990dadd5-b795-48fd-bea5-6b1de7086bc9 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:01.949672 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-990dadd5-b795-48fd-bea5-6b1de7086bc9 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.007625 Feb 12 21:12:01.950207 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1302/2673] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:12:01 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:12:01.961089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4db81c45-4d35-4a10-816e-9031d4d9892e tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa8fe27e670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1652099061", "public_key": " "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:01.977488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4db81c45-4d35-4a10-816e-9031d4d9892e tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:01.982002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4db81c45-4d35-4a10-816e-9031d4d9892e tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for user a68839eb3f48455eb7d6e5947e16bb72 and project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:01.998934 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-4db81c45-4d35-4a10-816e-9031d4d9892e tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Feb 12 21:12:01.999542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4db81c45-4d35-4a10-816e-9031d4d9892e tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:02.000371 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4db81c45-4d35-4a10-816e-9031d4d9892e tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.044522 Feb 12 21:12:02.001160 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1372/2674] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:12:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:12:02.011232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-328ae1f6-b923-4bad-8c1b-ddf23bf506a9 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa907e42ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:02.012401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-328ae1f6-b923-4bad-8c1b-ddf23bf506a9 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:02.013242 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-328ae1f6-b923-4bad-8c1b-ddf23bf506a9 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.006258 Feb 12 21:12:02.013808 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1303/2675] 10.222.0.31 () {60 vars in 1158 bytes} [Sat Feb 12 21:12:02 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:12:02.027253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7470dac0-0f7d-4c32-bd29-7d8e07821a12 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Action: 'create', calling method: .version_select at 0x7fa8fed23e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-979740825", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:02.042276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:02.058663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:02.059102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7470dac0-0f7d-4c32-bd29-7d8e07821a12 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:02.059226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.059226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.059226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.059226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.059673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7470dac0-0f7d-4c32-bd29-7d8e07821a12 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Getting quotas for user a68839eb3f48455eb7d6e5947e16bb72 and project 389fb65c002f4e19b5d76c6221016783. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:02.077274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7470dac0-0f7d-4c32-bd29-7d8e07821a12 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Feb 12 21:12:02.080303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7470dac0-0f7d-4c32-bd29-7d8e07821a12 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:02.081462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7470dac0-0f7d-4c32-bd29-7d8e07821a12 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.059842 Feb 12 21:12:02.088269 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1373/2676] 10.222.0.31 () {60 vars in 1158 bytes} [Sat Feb 12 21:12:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:12:02.095677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b511cadb-1914-42e1-a805-8c877421a4d7 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Calling method '.version_select at 0x7fa8fed53d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:02.112191 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b511cadb-1914-42e1-a805-8c877421a4d7 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-326429875 not found for user a68839eb3f48455eb7d6e5947e16bb72 Feb 12 21:12:02.113103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b511cadb-1914-42e1-a805-8c877421a4d7 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] Returning 404 to user: Keypair tempest-keypair-non-existent-326429875 not found for user a68839eb3f48455eb7d6e5947e16bb72 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:02.114159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b511cadb-1914-42e1-a805-8c877421a4d7 tempest-KeyPairsNegativeTestJSON-1418979510 tempest-KeyPairsNegativeTestJSON-1418979510-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-326429875" status: 404 len: 144 microversion: 2.1 time: 0.024030 Feb 12 21:12:02.119399 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1374/2677] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 21:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-326429875 => generated 144 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:12:02.126224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:02.127165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:02.134436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.139522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.139522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.139522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.215137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:02.223416 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e0ebcce-d3dc-4db5-8ff2-0690d43f1a3a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1212 microversion: 2.1 time: 0.102628 Feb 12 21:12:02.233265 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1375/2678] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:02 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:02.242359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:02.253311 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc31d9f8-38d3-4588-9b1c-eebe291be836 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.218801 Feb 12 21:12:02.253935 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1304/2679] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:02 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:02.607349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:02.608200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:02.614252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.614918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.616500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.617160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.848791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:02.858525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:02.860189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:02.861480 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0562d9b0-8e1a-434e-8465-fec336b19d64 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2830 microversion: 2.32 time: 0.258024 Feb 12 21:12:02.862054 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1376/2680] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:02 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2830 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:02.886434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:02.887111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:02.894571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.896600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:02.898923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:02.898923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:03.137188 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7f7df944-ee0b-44a1-bda2-a8812ccdfba5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.256986 Feb 12 21:12:03.138163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1305/2681] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 21:12:02 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030/os-interface => generated 1829 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:03.240141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:03.240758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:03.248120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:03.248642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:03.252303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:03.252303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:03.273550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:03.274468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:03.282020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:03.283474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:03.285112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:03.286276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:03.343564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:03.358299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0dcd295a-63df-4daf-b91f-15965032713a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1276 microversion: 2.1 time: 0.120834 Feb 12 21:12:03.362919 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1377/2682] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:03 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:03.801664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:03.810035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c871b37-3b86-402d-a8d4-56cd5c4da5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.542287 Feb 12 21:12:03.810634 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1306/2683] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:03 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:04.380658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:04.382013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:04.389984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:04.390710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:04.391823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:04.392494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:04.483648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:04.496728 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0923b70e-c204-437e-9679-ae96de278afb tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1274 microversion: 2.1 time: 0.119843 Feb 12 21:12:04.497411 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1378/2684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:04 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:04.828746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:04.830068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:04.848372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:04.848828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:04.853985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:04.854666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.227639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:05.228847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:05.241219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.241219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.241219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.241219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.242027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:05.252618 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ddc82605-62a0-486f-a94a-80556d65188c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.428693 Feb 12 21:12:05.257291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1307/2685] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:04 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:05.266367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-09152a80-1d34-429b-85b8-0e004f64a72b req-b1f3c990-6062-404f-b223-f101df547efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "tag": "335b0423-e329-43fd-bea1-28e4856ef8b9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:05.269644 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:05.269644 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:05.295870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-09152a80-1d34-429b-85b8-0e004f64a72b req-b1f3c990-6062-404f-b223-f101df547efd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.295870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-09152a80-1d34-429b-85b8-0e004f64a72b req-b1f3c990-6062-404f-b223-f101df547efd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.321298 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-09152a80-1d34-429b-85b8-0e004f64a72b req-b1f3c990-6062-404f-b223-f101df547efd service nova] Creating event network-changed:335b0423-e329-43fd-bea1-28e4856ef8b9 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:12:05.330283 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-09152a80-1d34-429b-85b8-0e004f64a72b req-b1f3c990-6062-404f-b223-f101df547efd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071556 Feb 12 21:12:05.331608 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1308/2686] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:05.515120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:05.515948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:05.530604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.531428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.532573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.533210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.583590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:05.596583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:05.598789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:05.601295 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e9a720d3-16a9-4a4e-af64-570d274ee415 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2830 microversion: 2.32 time: 0.378374 Feb 12 21:12:05.602675 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1379/2687] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:05 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2830 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:05.643774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:05.644578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:05.653056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.653921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.655258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:05.657305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:05.928368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:05.937320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2bf9257-c68e-4691-89e5-cbd40a32b60a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.426784 Feb 12 21:12:05.938068 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1309/2688] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:05 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:05.963413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-210be291-130f-4c64-a96f-1f5e46adfcdc tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.323492 Feb 12 21:12:05.964285 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1380/2689] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 21:12:05 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030/os-interface => generated 1829 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:06.272616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:06.274903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:06.285465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:06.286175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:06.287996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:06.288867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:06.646207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:06.657806 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f64be21-1cfe-4a57-a968-870321e2a457 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.390100 Feb 12 21:12:06.659465 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1310/2690] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:06 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:06.955578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:06.956178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:06.963188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:06.963645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:06.964638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:06.965279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:07.301617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:07.312757 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5699a253-625f-4f92-8b2d-1ec73dea830e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.361993 Feb 12 21:12:07.313587 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1381/2691] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:06 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:07.346932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7b5b10b3-155e-49c1-9ea6-fd39f9fdf4f1 req-855de844-a6f0-4717-9726-11bf1fa04043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22219e23-c83e-49e4-920a-f55b54c573c5", "tag": "836c8ee4-03e1-4068-8f9c-f2b55d196f5a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:07.348606 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:07.348606 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:07.356123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7b5b10b3-155e-49c1-9ea6-fd39f9fdf4f1 req-855de844-a6f0-4717-9726-11bf1fa04043 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:07.356564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7b5b10b3-155e-49c1-9ea6-fd39f9fdf4f1 req-855de844-a6f0-4717-9726-11bf1fa04043 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:07.368581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7b5b10b3-155e-49c1-9ea6-fd39f9fdf4f1 req-855de844-a6f0-4717-9726-11bf1fa04043 service nova] Creating event network-changed:836c8ee4-03e1-4068-8f9c-f2b55d196f5a for instance 22219e23-c83e-49e4-920a-f55b54c573c5 on nch2-master-1 Feb 12 21:12:07.373481 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7b5b10b3-155e-49c1-9ea6-fd39f9fdf4f1 req-855de844-a6f0-4717-9726-11bf1fa04043 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031182 Feb 12 21:12:07.374096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1311/2692] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:07.675714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:07.678281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:07.684764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:07.685492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:07.689044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:07.689044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:07.951115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:07.959961 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb3441d6-7949-4931-8350-29aa91f514fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.288076 Feb 12 21:12:07.961274 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1382/2693] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:07 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:08.333292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:08.334105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:08.347876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:08.353052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:08.354381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:08.355025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:08.647792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:08.656945 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-634a3602-509d-43fe-8305-2151688648df tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.328219 Feb 12 21:12:08.667558 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1312/2694] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:08 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:09.237880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:09.237880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:09.237880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:09.237880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:09.237880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:09.237880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:09.315652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:09.328354 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-424a49f9-1e8b-48a0-9876-0d3c226f324b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.353334 Feb 12 21:12:09.329450 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1383/2695] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:08 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:09.677289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:09.679248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:09.700538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:09.704199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:09.704199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:09.704199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:10.015132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:10.023448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7df5963e-90be-4e25-83cf-ff869d93db0a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.352390 Feb 12 21:12:10.033726 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1313/2696] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:09 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:10.346230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:10.347520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:10.354933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:10.355685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:10.356618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:10.357196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:10.623478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:10.635635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6cbce6f1-e621-4abf-ba6a-324f725a24af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.293012 Feb 12 21:12:10.636605 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1384/2697] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:10 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:11.045688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:11.046909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:11.066668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:11.070165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:11.071199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:11.071901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:11.393823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:11.428772 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-752c719e-4b63-431f-8f26-de2d462c425b tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.383276 Feb 12 21:12:11.428772 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1314/2698] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:11 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:11.655415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:11.660164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:11.679624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:11.680087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:11.680877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:11.681372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:11.689042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1882157889", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:11.791821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] validate_networks() for [('0eb7ddfa-6a0c-4e38-80ad-311c5f8e6f5b', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:12:11.998407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:12.013178 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e7e0e64-998e-40d8-9e79-868d1908779b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.361622 Feb 12 21:12:12.014608 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1315/2699] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:11 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:12.370590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:12:12.371019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:12:12.371922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:12:12.373053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:12:12.373581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:12:12.385553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:12.386011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:12.390715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:12.390715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:12.419212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Getting quotas for project 7e9fbd43632c4530b8d993cde9cd2106. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:12.424605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Getting quotas for user d75cf4e88d6e4dcc82408554aa0cb6d6 and project 7e9fbd43632c4530b8d993cde9cd2106. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:12.437488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:12.438826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:12.439187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:12:12.441838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:12:12.449710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:12.451049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:12.453910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:12.453910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:12.577017 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c374e690-cdfe-4f7a-bf1b-e8808ebf18d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.120511 Feb 12 21:12:12.578356 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1385/2700] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:12:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:12:12.593814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-20a78441-380e-4dcc-9f28-d324b7de2e4b req-2918ded9-d01f-4c92-a45b-29819210a324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22219e23-c83e-49e4-920a-f55b54c573c5", "name": "network-vif-plugged", "status": "completed", "tag": "836c8ee4-03e1-4068-8f9c-f2b55d196f5a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:12.596028 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:12.596028 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:12.604269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-20a78441-380e-4dcc-9f28-d324b7de2e4b req-2918ded9-d01f-4c92-a45b-29819210a324 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:12.604848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-20a78441-380e-4dcc-9f28-d324b7de2e4b req-2918ded9-d01f-4c92-a45b-29819210a324 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:12.633297 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-20a78441-380e-4dcc-9f28-d324b7de2e4b req-2918ded9-d01f-4c92-a45b-29819210a324 service nova] Creating event network-vif-plugged:836c8ee4-03e1-4068-8f9c-f2b55d196f5a for instance 22219e23-c83e-49e4-920a-f55b54c573c5 on nch2-master-1 Feb 12 21:12:12.653877 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-20a78441-380e-4dcc-9f28-d324b7de2e4b req-2918ded9-d01f-4c92-a45b-29819210a324 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073672 Feb 12 21:12:12.694531 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1386/2701] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:12.731129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-274409a7-f543-4b16-ad35-14e78d09a908 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:12.731129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-274409a7-f543-4b16-ad35-14e78d09a908 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:12.828230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-274409a7-f543-4b16-ad35-14e78d09a908 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:12.841293 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-274409a7-f543-4b16-ad35-14e78d09a908 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1222 microversion: 2.1 time: 0.141203 Feb 12 21:12:12.844174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1387/2702] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:12 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:12.917245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:12.946154 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-58aec170-91a6-4f7f-8ec1-8372cd9f917a tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.513775 Feb 12 21:12:12.959281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-959713488", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:12.959913 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1316/2703] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:12 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:13.031843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:13.032689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:13.040780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:13.041947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:13.042057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] validate_networks() for [('0eb7ddfa-6a0c-4e38-80ad-311c5f8e6f5b', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:12:13.043382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:13.044345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:13.448795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:13.467503 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f99aaa57-9526-4e16-8c01-0d3269e16dc4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.432293 Feb 12 21:12:13.472315 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1317/2704] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:13 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:13.589128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:12:13.589787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:12:13.590535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:12:13.591088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:12:13.591653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:12:13.606753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:13.607967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:13.611220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:13.611923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:13.654281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Getting quotas for project 7e9fbd43632c4530b8d993cde9cd2106. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:13.670599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Getting quotas for user d75cf4e88d6e4dcc82408554aa0cb6d6 and project 7e9fbd43632c4530b8d993cde9cd2106. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:13.707682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:12:13.712678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:12:13.960534 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-123e368e-74f7-4532-b924-7fad8a497e19 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.009414 Feb 12 21:12:13.963578 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1388/2705] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:12:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:12:13.965266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:13.965978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:13.976594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:13.979694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f8b72c4-9c22-4359-a194-c6a67c157358 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:13.980311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:13.980542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f8b72c4-9c22-4359-a194-c6a67c157358 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:13.981894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:13.982577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:14.117791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f8b72c4-9c22-4359-a194-c6a67c157358 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:14.135924 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f8b72c4-9c22-4359-a194-c6a67c157358 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1221 microversion: 2.1 time: 0.161620 Feb 12 21:12:14.151135 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1389/2706] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:13 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:14.294072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96303760-c2a2-4a5f-81ab-efe016487e52 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Action: 'create', calling method: .version_select at 0x7fa90801d4c0>, body: {"keypair": {"name": "tempest-keypair-1831086224"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:14.311702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:14.322622 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b66210bd-86e2-485d-bcf1-3cb8d92f5c91 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1316 microversion: 2.1 time: 0.362769 Feb 12 21:12:14.324180 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1318/2707] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:13 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:14.337390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-96303760-c2a2-4a5f-81ab-efe016487e52 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for project 8ad1d954f50f46459af1b6dbfb179207. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:14.344101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-96303760-c2a2-4a5f-81ab-efe016487e52 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for user a8859c1af22f453fbff6e63689b5d6da and project 8ad1d954f50f46459af1b6dbfb179207. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:14.482825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:14.486159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:14.498224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:14.499410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:14.501317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:14.501992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:14.575203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-96303760-c2a2-4a5f-81ab-efe016487e52 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for project 8ad1d954f50f46459af1b6dbfb179207. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:14.583175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-96303760-c2a2-4a5f-81ab-efe016487e52 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for user a8859c1af22f453fbff6e63689b5d6da and project 8ad1d954f50f46459af1b6dbfb179207. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:14.608000 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96303760-c2a2-4a5f-81ab-efe016487e52 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.438535 Feb 12 21:12:14.609140 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1390/2708] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:12:14 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:14.754723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:14.768081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2eb49712-b212-4211-b174-7e4e0117568c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.290944 Feb 12 21:12:14.769284 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1319/2709] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:14 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:15.155618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-71e65701-b64c-495c-bbe1-ee050c697a33 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:15.156292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-71e65701-b64c-495c-bbe1-ee050c697a33 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:15.227249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71e65701-b64c-495c-bbe1-ee050c697a33 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:15.235913 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-71e65701-b64c-495c-bbe1-ee050c697a33 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1221 microversion: 2.1 time: 0.083646 Feb 12 21:12:15.236633 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1391/2710] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:15 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:15.342702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:15.343739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:15.353859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.354542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.355361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.355959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.607476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:15.617777 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b847d727-4cfb-410c-ad9e-ec9e85098f5e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1504 microversion: 2.1 time: 0.280862 Feb 12 21:12:15.619325 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1320/2711] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:15 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:15.641781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:15.642508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:15.652023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.652727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.653790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.654461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.789915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:15.790949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:15.798373 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9fd2d55b-ad29-4ba8-902d-04b13567173e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "DELETE /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.163869 Feb 12 21:12:15.805914 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1392/2712] 10.222.0.31 () {58 vars in 1295 bytes} [Sat Feb 12 21:12:15 2022] DELETE /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5/os-server-password => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:12:15.812854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:15.813678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:15.817349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.817840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.820754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.821494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.822018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.822624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.823584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.824153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.876318 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-236c5dcd-f249-4ab1-bdc6-bedd36acf2b5 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.069104 Feb 12 21:12:15.884776 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1393/2713] 10.222.0.31 () {58 vars in 1292 bytes} [Sat Feb 12 21:12:15 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5/os-server-password => generated 16 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:12:15.895703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:15.896819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:15.909921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.910383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.911218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:15.918121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:15.979626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:12:16.160654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:16.170422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e96f16f6-7055-4dfe-abda-d86cdf44358c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.386096 Feb 12 21:12:16.171586 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1321/2714] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:15 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:16.256372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:16.257518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:16.265831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:16.266551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:16.267617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:16.268727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:16.383632 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e8e2639-33df-40ad-a809-8eb2e7e2496e tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "DELETE /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 204 len: 0 microversion: 2.1 time: 0.496707 Feb 12 21:12:16.384557 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1394/2715] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:12:15 2022] DELETE /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:12:16.403890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:16.404027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:16.407290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:16.414830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:16.415416 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f53f0937-5586-4f56-aadc-bffa849df9ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1273 microversion: 2.1 time: 0.161667 Feb 12 21:12:16.415548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:16.416062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1322/2716] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:16 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:16.418166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:16.418861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:16.967952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:16.989644 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2ea904eb-6fb9-4dcc-be78-1731d656f455 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1510 microversion: 2.1 time: 0.594514 Feb 12 21:12:17.009008 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1395/2717] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:16 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1510 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:17.190624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:17.192024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:17.213770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:17.214801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:17.215991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:17.216691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:17.437612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:17.438541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:17.457918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:17.459755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:17.462178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:17.462996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:17.564236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:17.576968 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-328c584a-8f0d-4d4a-9cc8-fb2e4c9d9874 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.391417 Feb 12 21:12:17.588466 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1323/2718] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:17 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:17.681073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:17.691732 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d597eebc-d52a-4f78-8f9d-f10807018e6a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1279 microversion: 2.1 time: 0.259450 Feb 12 21:12:17.694693 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1396/2719] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:17 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:18.013341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:18.014267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:18.026102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:18.029665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:18.029665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:18.029665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:18.522384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:18.531752 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90d5f0cb-41d8-4414-bd01-87e74b1c94ea tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1510 microversion: 2.1 time: 0.522947 Feb 12 21:12:18.533078 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1324/2720] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:18 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1510 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:18.596590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:18.597279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:18.605499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:18.606927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:18.608012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:18.608680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:18.712447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:18.713739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:18.720427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:18.723995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:18.723995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:18.723995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:19.004984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:19.013772 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ee7e723-ef46-49e6-8388-160a1df247c8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.421683 Feb 12 21:12:19.014706 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1397/2721] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:18 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:19.158680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1378635278", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "38dc5d11-f6b5-4bd7-8e40-a539ee0cb9f2"}], "security_groups": [{"name": "tempest-securitygroup--2066519051"}], "key_name": "tempest-keypair-1831086224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:19.293312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:19.301276 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0102f54-761e-43e2-a0a2-9825c1f50b18 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.594055 Feb 12 21:12:19.301901 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1325/2722] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:18 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:19.316598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] validate_networks() for [('38dc5d11-f6b5-4bd7-8e40-a539ee0cb9f2', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:12:19.473912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-88b7312e-8220-4c7d-96e4-1eb22dc4e7a8 req-faf5b876-6224-469c-96a4-8d17af235edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22219e23-c83e-49e4-920a-f55b54c573c5", "name": "network-vif-deleted", "tag": "836c8ee4-03e1-4068-8f9c-f2b55d196f5a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:19.476613 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:19.476613 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:19.492654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-88b7312e-8220-4c7d-96e4-1eb22dc4e7a8 req-faf5b876-6224-469c-96a4-8d17af235edb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:19.493391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-88b7312e-8220-4c7d-96e4-1eb22dc4e7a8 req-faf5b876-6224-469c-96a4-8d17af235edb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:19.532308 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-88b7312e-8220-4c7d-96e4-1eb22dc4e7a8 req-faf5b876-6224-469c-96a4-8d17af235edb service nova] Creating event network-vif-deleted:836c8ee4-03e1-4068-8f9c-f2b55d196f5a for instance 22219e23-c83e-49e4-920a-f55b54c573c5 on nch2-master-1 Feb 12 21:12:19.539490 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-88b7312e-8220-4c7d-96e4-1eb22dc4e7a8 req-faf5b876-6224-469c-96a4-8d17af235edb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175031 Feb 12 21:12:19.540668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1326/2723] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:19.553706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:19.555390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:19.565052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:19.565792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:19.566835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:19.567507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:19.661441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1119ae97ce1444f9a61c508464d8f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a789726452342938ca48b6800ed43ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:19.673810 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd7577cc-19c8-48ef-97e8-01ae4d8975ac tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 200 len: 1301 microversion: 2.1 time: 0.127601 Feb 12 21:12:19.681781 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1327/2724] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:19 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 1301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:20.033787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:20.034657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:20.058017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.058984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.061688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.062638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.221858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for project 8ad1d954f50f46459af1b6dbfb179207. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:20.227965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for user a8859c1af22f453fbff6e63689b5d6da and project 8ad1d954f50f46459af1b6dbfb179207. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:20.243504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:12:20.244238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:12:20.244886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:12:20.245305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:12:20.245748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:12:20.256563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.257030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.257899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.258350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.277377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for project 8ad1d954f50f46459af1b6dbfb179207. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:20.283043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Getting quotas for user a8859c1af22f453fbff6e63689b5d6da and project 8ad1d954f50f46459af1b6dbfb179207. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:20.297850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:12:20.300563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:12:20.324766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:20.332356 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68aa51f6-d59c-452e-99e7-0cdb165695ad tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.304594 Feb 12 21:12:20.332981 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1328/2725] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:20 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:20.429052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9154d08b-33d5-4de1-8006-416a45566d44 req-4e64104d-cc33-43cf-8ce3-aade6f66520e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4a76f8f-ed14-4d6c-9296-e0e3113005c5", "tag": "5f4e3cbc-9227-49a5-bcc1-1d8f6884d82a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:20.431302 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:20.431302 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:20.443366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9154d08b-33d5-4de1-8006-416a45566d44 req-4e64104d-cc33-43cf-8ce3-aade6f66520e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.445152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9154d08b-33d5-4de1-8006-416a45566d44 req-4e64104d-cc33-43cf-8ce3-aade6f66520e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.461069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9154d08b-33d5-4de1-8006-416a45566d44 req-4e64104d-cc33-43cf-8ce3-aade6f66520e service nova] Creating event network-changed:5f4e3cbc-9227-49a5-bcc1-1d8f6884d82a for instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 on nch1-master-1 Feb 12 21:12:20.466770 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9154d08b-33d5-4de1-8006-416a45566d44 req-4e64104d-cc33-43cf-8ce3-aade6f66520e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132451 Feb 12 21:12:20.467770 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1329/2726] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:20.475200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:20.476147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:20.483403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.483879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.484690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.485347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.536072 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52fddf25-ce05-4adf-9e7b-255e807e5c04 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.383887 Feb 12 21:12:20.537697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1398/2727] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:12:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:12:20.554121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5e86aa0-fced-4bd5-ad71-8f46c0bd8ff3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:20.558647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5e86aa0-fced-4bd5-ad71-8f46c0bd8ff3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:20.653207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b5e86aa0-fced-4bd5-ad71-8f46c0bd8ff3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:20.666752 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5e86aa0-fced-4bd5-ad71-8f46c0bd8ff3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1270 microversion: 2.1 time: 0.122944 Feb 12 21:12:20.668019 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1399/2728] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:20 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:20.695732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:20.699103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:20.700059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] [instance: 22219e23-c83e-49e4-920a-f55b54c573c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:20.706939 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-045f6a4c-2208-46fe-9b2d-4b6f13adcea7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.237513 Feb 12 21:12:20.711047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.711675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.712198 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1330/2729] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:20 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:20.723504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:20.723961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:20.745522 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] HTTP exception thrown: Instance 22219e23-c83e-49e4-920a-f55b54c573c5 could not be found. Feb 12 21:12:20.746147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] Returning 404 to user: Instance 22219e23-c83e-49e4-920a-f55b54c573c5 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:20.747001 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f9204ae-2b83-4f69-a9a6-ad477bffba85 tempest-ServerPasswordTestJSON-2028965231 tempest-ServerPasswordTestJSON-2028965231-project] 10.222.0.31 "GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5" status: 404 len: 111 microversion: 2.1 time: 0.053885 Feb 12 21:12:20.751500 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1400/2730] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:20 2022] GET /compute/v2.1/servers/22219e23-c83e-49e4-920a-f55b54c573c5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:12:21.350020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:21.350905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:21.362989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:21.367502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:21.368382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:21.368819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:21.620350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9f4855b2-ee46-429a-8416-6cb3fd57361c req-36653ec7-1a65-48be-bd0f-74458bf3a557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29124640-751c-4a46-bc3d-dd666846f4a9", "tag": "8717c413-817e-4ebb-805c-d6db55691f8e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:21.621972 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:21.621972 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:21.629323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9f4855b2-ee46-429a-8416-6cb3fd57361c req-36653ec7-1a65-48be-bd0f-74458bf3a557 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:21.629802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9f4855b2-ee46-429a-8416-6cb3fd57361c req-36653ec7-1a65-48be-bd0f-74458bf3a557 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:21.636605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:21.641568 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9f4855b2-ee46-429a-8416-6cb3fd57361c req-36653ec7-1a65-48be-bd0f-74458bf3a557 service nova] Creating event network-changed:8717c413-817e-4ebb-805c-d6db55691f8e for instance 29124640-751c-4a46-bc3d-dd666846f4a9 on nch1-master-1 Feb 12 21:12:21.645344 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2bd4d97-ae92-432a-8ebb-b5b59e6e9051 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.298431 Feb 12 21:12:21.646518 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1331/2731] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:21 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:21.647179 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9f4855b2-ee46-429a-8416-6cb3fd57361c req-36653ec7-1a65-48be-bd0f-74458bf3a557 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030131 Feb 12 21:12:21.647856 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1401/2732] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:21.684395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a9e159f-d72c-4dfb-be60-5b0d5474b55d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:21.685013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3a9e159f-d72c-4dfb-be60-5b0d5474b55d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:21.733005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:21.733319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:21.741861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:21.742420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:21.743455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:21.744192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:21.774819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3a9e159f-d72c-4dfb-be60-5b0d5474b55d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:21.784720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a9e159f-d72c-4dfb-be60-5b0d5474b55d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1270 microversion: 2.1 time: 0.103982 Feb 12 21:12:21.787198 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1332/2733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:21 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:22.318069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:22.325731 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7b16707-55aa-4957-87c4-81d549674f30 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.601339 Feb 12 21:12:22.326556 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1402/2734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:21 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:22.663587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:22.664212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:22.673977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:22.674435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:22.675286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:22.675829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:22.804588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:22.806440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:22.813633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:22.814426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:22.815326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:22.815775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:22.830179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:22.839202 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28bd8557-d3c4-47b0-a7af-e562c07b8812 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1496 microversion: 2.1 time: 0.180489 Feb 12 21:12:22.840766 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1333/2735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:22 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1496 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:22.888375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:22.896763 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a8594c6-d729-4152-addc-6a03eb2576ae tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1322 microversion: 2.1 time: 0.096450 Feb 12 21:12:22.898557 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1403/2736] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:22 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:23.344184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:23.345610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:23.356017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:23.356684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:23.357548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:23.358925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:23.546675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:23.555299 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c46dd507-428e-4605-a639-9f7e6a86f1f2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.215908 Feb 12 21:12:23.555894 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1334/2737] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:23 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:23.860627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:23.861465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:23.870453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:23.871235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:23.872199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:23.872644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:23.914700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:23.915898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:23.922185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:23.922645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:23.923592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:23.924033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:24.010662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:24.020867 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f23347e3-a198-4f42-ae81-9226570389be tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1328 microversion: 2.1 time: 0.110212 Feb 12 21:12:24.025505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:24.033075 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1335/2738] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:23 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:24.034903 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f4dd88e-c68a-47a0-a2eb-52766d9d2da3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 200 len: 1473 microversion: 2.1 time: 0.178231 Feb 12 21:12:24.035749 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1404/2739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:23 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:24.055528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1461970674"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:24.056867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:24.063055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:24.063511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:24.064304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:24.064799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:24.572986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:24.573647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:24.580809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:24.581614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:24.582706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:24.583222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:24.710132 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-928f8de5-c5a2-4ab0-bd24-a1cc29e6c8e7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970/action" status: 202 len: 0 microversion: 2.1 time: 0.654454 Feb 12 21:12:24.710960 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1336/2740] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:12:24 2022] POST /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:12:24.726578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f099443-3f9a-493f-b0e9-59e754573a8b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907e420d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:24.803635 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f099443-3f9a-493f-b0e9-59e754573a8b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.084730 Feb 12 21:12:24.804467 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1337/2741] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:24 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:24.834777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:24.848314 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bac583b5-3078-44bf-9a65-99dd24bdaa02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.279993 Feb 12 21:12:24.849490 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1405/2742] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:24 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:25.041973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:25.043340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:25.050661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:25.051220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:25.052321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:25.053089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:25.366056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:25.375493 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f61e5b78-4105-419d-80e2-69e1f5d214a0 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.339264 Feb 12 21:12:25.376136 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1338/2743] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:25 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:25.819467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e3134b15-a312-4b11-8ed7-60eaa3e44433 req-aae0040d-f9db-4faf-b4f3-1d4ff97e0526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cd2675-603b-4cf7-a9df-6d2d936caad9", "tag": "56212d07-715f-4e11-9f22-211463c39d54"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:25.821410 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:25.821410 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:25.822660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2c5a6c70-0be9-4330-9adb-5f01d93a93ac tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fed3bb80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:25.828794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e3134b15-a312-4b11-8ed7-60eaa3e44433 req-aae0040d-f9db-4faf-b4f3-1d4ff97e0526 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:25.829455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e3134b15-a312-4b11-8ed7-60eaa3e44433 req-aae0040d-f9db-4faf-b4f3-1d4ff97e0526 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:25.847561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e3134b15-a312-4b11-8ed7-60eaa3e44433 req-aae0040d-f9db-4faf-b4f3-1d4ff97e0526 service nova] Creating event network-changed:56212d07-715f-4e11-9f22-211463c39d54 for instance 84cd2675-603b-4cf7-a9df-6d2d936caad9 on nch2-master-1 Feb 12 21:12:25.856883 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e3134b15-a312-4b11-8ed7-60eaa3e44433 req-aae0040d-f9db-4faf-b4f3-1d4ff97e0526 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041595 Feb 12 21:12:25.857997 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1339/2744] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:25.873419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:25.884475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:25.892589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:25.894222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:25.898208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:25.898782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:25.904353 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2c5a6c70-0be9-4330-9adb-5f01d93a93ac tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.089401 Feb 12 21:12:25.906072 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1406/2745] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:25 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:26.242512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:26.250102 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08e9c764-02fa-4ad5-9262-80018deda458 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.386320 Feb 12 21:12:26.250683 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1340/2746] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:25 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:26.393541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:26.394178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:26.401605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:26.402070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:26.402881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:26.403329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:26.558602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:26.566412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-523726d6-bb63-4d1b-a358-aaededf90cb4 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.176958 Feb 12 21:12:26.567993 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1407/2747] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:26 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:26.918911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0efca89b-e0cb-4e76-b09f-2e4bf1652ba5 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fbe310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:26.969551 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0efca89b-e0cb-4e76-b09f-2e4bf1652ba5 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.054318 Feb 12 21:12:26.970172 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1341/2748] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:26 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:27.268353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:27.268966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:27.277068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:27.277575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:27.278373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:27.278810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:27.422900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:27.431289 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e23d563-59e3-413a-bbe3-b3873f9b2485 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.167006 Feb 12 21:12:27.431885 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1408/2749] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:27 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:27.584043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:27.584929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:27.592061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:27.592519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:27.593322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:27.593811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:27.848873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:27.857213 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9007c452-e76e-4421-8a96-7ba7f03de236 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.277783 Feb 12 21:12:27.857911 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1342/2750] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:27 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:27.983336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c834f884-734b-427a-849a-c68734134ce2 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fec569d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:28.035115 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c834f884-734b-427a-849a-c68734134ce2 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.055430 Feb 12 21:12:28.036144 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1409/2751] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:27 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:28.449017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:28.449831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:28.456246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:28.456978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:28.457913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:28.458883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:28.594965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c4fd17f0-6b5d-4e0e-9dcc-602fa4f5aafe req-9e3cec3f-4a01-4411-830b-90ad4848b679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a76f8f-ed14-4d6c-9296-e0e3113005c5", "name": "network-vif-plugged", "status": "completed", "tag": "5f4e3cbc-9227-49a5-bcc1-1d8f6884d82a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:28.598190 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:28.598190 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:28.614844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c4fd17f0-6b5d-4e0e-9dcc-602fa4f5aafe req-9e3cec3f-4a01-4411-830b-90ad4848b679 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:28.615737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c4fd17f0-6b5d-4e0e-9dcc-602fa4f5aafe req-9e3cec3f-4a01-4411-830b-90ad4848b679 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:28.629585 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c4fd17f0-6b5d-4e0e-9dcc-602fa4f5aafe req-9e3cec3f-4a01-4411-830b-90ad4848b679 service nova] Creating event network-vif-plugged:5f4e3cbc-9227-49a5-bcc1-1d8f6884d82a for instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 on nch1-master-1 Feb 12 21:12:28.637692 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c4fd17f0-6b5d-4e0e-9dcc-602fa4f5aafe req-9e3cec3f-4a01-4411-830b-90ad4848b679 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048043 Feb 12 21:12:28.639042 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1410/2752] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:28.743187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:28.768043 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-078842ed-8d7e-4bee-83e7-38e50c064b70 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.322927 Feb 12 21:12:28.770572 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1343/2753] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:28 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:28.876377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:28.877495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:28.886624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:28.887556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:28.889258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:28.890005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.051674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-675c61fb-4e38-4cdc-a2a0-6b4e6687cb26 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fe2430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:29.102118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:29.119006 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a32c0c64-4ad4-47b0-b618-277da988674a tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.244105 Feb 12 21:12:29.119006 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1411/2754] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:28 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:29.133813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-675c61fb-4e38-4cdc-a2a0-6b4e6687cb26 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.087337 Feb 12 21:12:29.135050 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1344/2755] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:29 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:29.635087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:29.635599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:29.644243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:29.644870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.646566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:29.647153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.684115 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-85ea368b-28ae-4fb1-bee7-9decaf374801 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments/5583872c-2e0a-476f-bbb0-bfbbf03d7db2" status: 200 len: 194 microversion: 2.20 time: 0.053112 Feb 12 21:12:29.685481 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1412/2756] 10.222.0.31 () {60 vars in 1453 bytes} [Sat Feb 12 21:12:29 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments/5583872c-2e0a-476f-bbb0-bfbbf03d7db2 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:12:29.774421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:29.774960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:29.787539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:29.788362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:29.795550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:29.796009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.796808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:29.797266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.800801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:29.801255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.802627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:29.803068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:29.919124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lazy-loading 'services' on Instance uuid ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:12:30.097031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:30.109749 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e354387-121f-4872-a14c-f4fc35f92384 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.326405 Feb 12 21:12:30.110820 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1413/2757] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:29 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:30.142683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:30.143326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:30.151370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:30.151845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:30.152661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:30.153112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:30.198487 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f44b640d-64ce-4959-878f-18dab3888a89 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments/5583872c-2e0a-476f-bbb0-bfbbf03d7db2" status: 202 len: 0 microversion: 2.20 time: 0.429871 Feb 12 21:12:30.199363 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1345/2758] 10.222.0.31 () {60 vars in 1456 bytes} [Sat Feb 12 21:12:29 2022] DELETE /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments/5583872c-2e0a-476f-bbb0-bfbbf03d7db2 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:12:30.211143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-497b8f36-3b96-43b7-b322-8f410833c79b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fdbdc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:30.303300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-497b8f36-3b96-43b7-b322-8f410833c79b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.097244 Feb 12 21:12:30.311924 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1346/2759] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:30 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:30.329726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:30.339118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:30.366520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:30.369666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:30.371257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:30.373227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:30.470200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:30.472801 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ac97d80-578a-43d1-b966-daef6407b807 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158870 Feb 12 21:12:30.478690 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1347/2760] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:12:30 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:12:30.484302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-08ba2453-5238-412f-8758-ec9644842f41 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.355516 Feb 12 21:12:30.484913 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1414/2761] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:30 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:30.856977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3e5a993a-c1ad-4072-aac5-53c71ee03915 req-f89f2424-cd79-4351-83ce-28517b3c71c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29124640-751c-4a46-bc3d-dd666846f4a9", "name": "network-vif-plugged", "status": "completed", "tag": "8717c413-817e-4ebb-805c-d6db55691f8e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:30.858845 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:30.858845 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:30.871848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3e5a993a-c1ad-4072-aac5-53c71ee03915 req-f89f2424-cd79-4351-83ce-28517b3c71c7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:30.872616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3e5a993a-c1ad-4072-aac5-53c71ee03915 req-f89f2424-cd79-4351-83ce-28517b3c71c7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:30.899379 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3e5a993a-c1ad-4072-aac5-53c71ee03915 req-f89f2424-cd79-4351-83ce-28517b3c71c7 service nova] Creating event network-vif-plugged:8717c413-817e-4ebb-805c-d6db55691f8e for instance 29124640-751c-4a46-bc3d-dd666846f4a9 on nch1-master-1 Feb 12 21:12:30.906007 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3e5a993a-c1ad-4072-aac5-53c71ee03915 req-f89f2424-cd79-4351-83ce-28517b3c71c7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249284 Feb 12 21:12:30.907269 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1348/2762] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:31.127683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:31.128464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:31.147785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.148232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.149142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.150528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.324126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0af482a4-6422-47f2-8270-b2ab0592b49e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fdb280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:31.417989 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0af482a4-6422-47f2-8270-b2ab0592b49e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.101403 Feb 12 21:12:31.423687 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1349/2763] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:31 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:31.425438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:31.434955 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6b4790cf-bc42-4237-9c92-b5537be9b56d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1321 microversion: 2.1 time: 0.311546 Feb 12 21:12:31.437256 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1415/2764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:31 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:31.485227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:31.486380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:31.498065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.499424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.500925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.501568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.503479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:31.504349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:31.511763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.515026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.516234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.516902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.557005 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10c73be2-59ea-47f4-9298-12c07bddb641 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075590 Feb 12 21:12:31.558003 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1350/2765] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:12:31 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:31.655649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:31.656093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:31.662379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.662853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.663658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:31.664101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:31.707929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:12:31.826332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:31.836646 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5378b47c-a705-47fd-ae68-fa810d34e169 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.337181 Feb 12 21:12:31.850285 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1416/2766] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:31 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:32.044145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-623476422", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:32.117741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] validate_networks() for [('04053501-c602-45a2-b372-831dd8f55883', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:12:32.156232 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-790343df-33d5-42af-9e06-2fc7542e0b8f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 204 len: 0 microversion: 2.20 time: 0.504354 Feb 12 21:12:32.156832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1351/2767] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:12:31 2022] DELETE /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:12:32.172554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:32.173583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:32.182482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:32.183262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:32.184301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:32.187251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:32.485115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:32.495788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:32.497405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:32.498803 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b3646fb8-1d07-412c-a8f3-83cbba8b9a3e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.337128 Feb 12 21:12:32.511539 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1352/2768] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:32 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:32.516833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36275450-cd43-4602-bbc1-4e304dca9397 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907f695e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:32.592545 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36275450-cd43-4602-bbc1-4e304dca9397 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.079457 Feb 12 21:12:32.599433 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1353/2769] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:32 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:32.619750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:32.620450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:32.639288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:32.640012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:32.641601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:32.642260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:32.772001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:12:32.773532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:12:32.774358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:12:32.774994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:12:32.775746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:12:32.790148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:32.791187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:32.792597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:32.793257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:32.826697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Getting quotas for project 184a5eeefb1f41d2b34ac8b7b3dee122. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:32.833458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Getting quotas for user 8be38201410d4e21ae786b2345428332 and project 184a5eeefb1f41d2b34ac8b7b3dee122. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:32.848969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:12:32.853171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:12:33.024377 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2ce3716a-ab02-4d72-bf3c-158c9480367c tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.091257 Feb 12 21:12:33.025060 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1417/2770] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:12:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:12:33.032371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:33.033038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:33.040856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.041273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.042218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.042758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.279931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:33.292803 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa64cf80-d35b-4fbf-98c8-da143281f574 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.266621 Feb 12 21:12:33.293841 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1418/2771] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:33 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:33.309537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7ea1abe7-d0bc-4fcc-92cd-c94192a66bde req-137b1126-3fd4-49a0-9f6c-844ecbafbde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9045d14a-f3fd-4ac7-b7c3-80e22e9b0970", "name": "network-vif-plugged", "status": "completed", "tag": "ce0bcb3d-2043-41d3-a1f4-e06134cff0af"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:33.311940 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:33.311940 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:33.320499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7ea1abe7-d0bc-4fcc-92cd-c94192a66bde req-137b1126-3fd4-49a0-9f6c-844ecbafbde7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.321264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7ea1abe7-d0bc-4fcc-92cd-c94192a66bde req-137b1126-3fd4-49a0-9f6c-844ecbafbde7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.334528 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7ea1abe7-d0bc-4fcc-92cd-c94192a66bde req-137b1126-3fd4-49a0-9f6c-844ecbafbde7 service nova] Creating event network-vif-plugged:ce0bcb3d-2043-41d3-a1f4-e06134cff0af for instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 on nch2-master-1 Feb 12 21:12:33.340329 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7ea1abe7-d0bc-4fcc-92cd-c94192a66bde req-137b1126-3fd4-49a0-9f6c-844ecbafbde7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044981 Feb 12 21:12:33.341578 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1419/2772] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:33.348553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb624bf7-93cb-43e1-aaec-2dd8b79de543 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:33.350044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb624bf7-93cb-43e1-aaec-2dd8b79de543 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:33.415293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:33.428820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb624bf7-93cb-43e1-aaec-2dd8b79de543 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:33.436851 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb624bf7-93cb-43e1-aaec-2dd8b79de543 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1222 microversion: 2.1 time: 0.093644 Feb 12 21:12:33.437790 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1420/2773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:33 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:33.449057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a7aa051-56d1-4e59-b9d8-33db3fa8dd55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1516 microversion: 2.1 time: 0.840932 Feb 12 21:12:33.452250 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1354/2774] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:32 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1516 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:33.473732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:33.475555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:33.499919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.500579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.511691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.512259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.518757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:33.519390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:33.526722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.527178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.527981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:33.535883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:33.598055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'flavor' on Instance uuid 29124640-751c-4a46-bc3d-dd666846f4a9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:12:33.864047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:33.880974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:33.883868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:33.885442 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a2e5bf14-4057-4a3d-b69a-f94f57e1bf84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1723 microversion: 2.20 time: 0.370660 Feb 12 21:12:33.887085 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1355/2775] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:33 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:33.892788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce174bc0-848d-4bf0-b1dc-f8fb00c212fa tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fb19d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:33.963504 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce174bc0-848d-4bf0-b1dc-f8fb00c212fa tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.074895 Feb 12 21:12:33.964243 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1356/2776] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:33 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:34.238863 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e80dee5f-263e-49e4-b776-b608724eaf02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9/action" status: 200 len: 32 microversion: 2.1 time: 0.772629 Feb 12 21:12:34.240053 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1421/2777] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:12:33 2022] POST /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9/action => generated 32 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:12:34.259146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:34.261785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:34.280392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:34.283306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:34.284539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:34.285226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:34.312881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:34.314467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:34.357596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:34.358940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:34.361830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:34.365884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:34.746952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:34.760743 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3cba0dc4-a9d6-4334-b162-021597b25efc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.513368 Feb 12 21:12:34.761402 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1357/2778] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:34 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:34.774943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-938cdd06-5fad-48f4-9614-b6312a6cebbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:34.775517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-938cdd06-5fad-48f4-9614-b6312a6cebbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:34.807687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:34.831715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c8509ed-fc0b-4b4f-8cf6-3a58058c1a44 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.524606 Feb 12 21:12:34.832558 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1422/2779] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:34 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:34.897460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-938cdd06-5fad-48f4-9614-b6312a6cebbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:34.905984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:34.906601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:34.909622 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-938cdd06-5fad-48f4-9614-b6312a6cebbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1222 microversion: 2.1 time: 0.145400 Feb 12 21:12:34.921910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:34.921910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:34.921910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:34.921910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:34.926707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1358/2780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:34 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:34.993255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ef3a736-c3a2-45a1-a6d9-105b11b12b35 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa90806aca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:35.102570 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ef3a736-c3a2-45a1-a6d9-105b11b12b35 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.126148 Feb 12 21:12:35.104047 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1359/2781] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:34 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:35.173400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:35.186609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:35.189176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:35.196945 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d525d7d-30f2-4268-ab6a-91b8058cef27 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1655 microversion: 2.20 time: 0.294770 Feb 12 21:12:35.209788 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1423/2782] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:34 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1655 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:35.359604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b7a69333-cfa4-4044-afea-09f4f88f30c3 req-41d346cc-bc5e-401d-be28-f16ed25d72d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cd2675-603b-4cf7-a9df-6d2d936caad9", "name": "network-vif-plugged", "status": "completed", "tag": "56212d07-715f-4e11-9f22-211463c39d54"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:35.363952 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:35.363952 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:35.386786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b7a69333-cfa4-4044-afea-09f4f88f30c3 req-41d346cc-bc5e-401d-be28-f16ed25d72d4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:35.387762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b7a69333-cfa4-4044-afea-09f4f88f30c3 req-41d346cc-bc5e-401d-be28-f16ed25d72d4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:35.416696 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b7a69333-cfa4-4044-afea-09f4f88f30c3 req-41d346cc-bc5e-401d-be28-f16ed25d72d4 service nova] Creating event network-vif-plugged:56212d07-715f-4e11-9f22-211463c39d54 for instance 84cd2675-603b-4cf7-a9df-6d2d936caad9 on nch2-master-1 Feb 12 21:12:35.436759 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b7a69333-cfa4-4044-afea-09f4f88f30c3 req-41d346cc-bc5e-401d-be28-f16ed25d72d4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081981 Feb 12 21:12:35.438103 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1360/2783] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:35.778201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:35.778822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:35.788413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:35.791294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:35.796785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:35.797471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:35.851617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:35.852355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:35.865738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:35.866420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:35.872082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:35.874546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:36.094056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:36.104397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b2c8e4be-c416-4f57-bdfc-22438e5df8f4 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.329940 Feb 12 21:12:36.106331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1424/2784] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:35 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:36.122924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:36.125771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:36.135546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:36.137053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:36.138151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:36.140621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:36.272337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:36.283053 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eade218b-d287-48f4-9556-5075059eaba4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1274 microversion: 2.1 time: 0.175406 Feb 12 21:12:36.284207 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1425/2785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:36 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:36.290417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65b3f2ab-9bd2-43d2-908c-50b44441af00 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe27e280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:36.350239 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65b3f2ab-9bd2-43d2-908c-50b44441af00 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.063539 Feb 12 21:12:36.351208 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1426/2786] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:36 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:36.362860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:36.362860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:36.367371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:36.368093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:36.369127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:36.369805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:36.403359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:36.411158 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6cf3e08-4abf-46cc-94b0-b0e98549eddb tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1396 microversion: 2.1 time: 0.565503 Feb 12 21:12:36.418326 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1361/2787] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:35 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1396 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:36.425722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c5ecd74d-5491-47d2-9434-328b9cf97c2d req-63b2f96b-c17a-4df3-8b9c-67e85f50be89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7ceb24-719e-4fcb-b272-f1ed4dbd8514", "name": "network-vif-deleted", "tag": "8a6d5784-855f-4db3-a849-95606d940801"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:36.435507 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:36.435507 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:36.449391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c5ecd74d-5491-47d2-9434-328b9cf97c2d req-63b2f96b-c17a-4df3-8b9c-67e85f50be89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:36.451698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c5ecd74d-5491-47d2-9434-328b9cf97c2d req-63b2f96b-c17a-4df3-8b9c-67e85f50be89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:36.455438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:36.478467 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c5ecd74d-5491-47d2-9434-328b9cf97c2d req-63b2f96b-c17a-4df3-8b9c-67e85f50be89 service nova] Creating event network-vif-deleted:8a6d5784-855f-4db3-a849-95606d940801 for instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 on nch2-master-1 Feb 12 21:12:36.489612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:36.493258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c5ecd74d-5491-47d2-9434-328b9cf97c2d req-63b2f96b-c17a-4df3-8b9c-67e85f50be89 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073200 Feb 12 21:12:36.494751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1362/2788] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:36.509551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:36.512343 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f0b81963-38ea-42d5-88bd-8201be0349fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 200 len: 1655 microversion: 2.20 time: 0.159953 Feb 12 21:12:36.512946 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1427/2789] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:36 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:37.123982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:37.125440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:37.137918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.138704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.139678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.140273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.300904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:37.301851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:37.315112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.318833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.319971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.321914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.483340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:37.501197 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dcbed46d-a2c1-4a3b-b3dd-c11034732f01 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1282 microversion: 2.1 time: 0.203966 Feb 12 21:12:37.515314 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1428/2790] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:37 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:37.530398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44ede545-40c4-48a5-8fcc-61878509da37 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fec89040>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:37.635565 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44ede545-40c4-48a5-8fcc-61878509da37 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.117144 Feb 12 21:12:37.636665 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1429/2791] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:37 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:37.648059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:37.665865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:37.679694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.681991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.683658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.686890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.819222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:37.830775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d5f4053f-6204-499c-a74a-730309b3d412 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.711582 Feb 12 21:12:37.840820 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1363/2792] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:37 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:37.859634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:37.860688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:37.875838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.877098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.879175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:37.882539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:37.930159 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] HTTP exception thrown: Instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 could not be found. Feb 12 21:12:37.930159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Returning 404 to user: Instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:12:37.930159 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15a8b3c3-bcef-44d1-8a1b-e042a772321e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 404 len: 111 microversion: 2.20 time: 0.079339 Feb 12 21:12:37.934439 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1364/2793] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:37 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:12:37.944653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7f61a542-647a-4a74-90c5-ee074daef1be tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '.version_select at 0x7fa90806f4c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:37.984176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:37.999798 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-33c20d58-967b-4662-a4f9-a87e851808f5 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1577 microversion: 2.1 time: 0.361895 Feb 12 21:12:38.004183 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1430/2794] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:37 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1577 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:38.028836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:38.029493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:38.048509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:38.049073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:38.051233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:38.054340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:38.069422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7f61a542-647a-4a74-90c5-ee074daef1be tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829506185" status: 204 len: 0 microversion: 2.20 time: 0.133709 Feb 12 21:12:38.070258 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1365/2795] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829506185 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:12:38.263683 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b1ca2f9-9748-4dde-85a8-d16faa7aacb7 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242742 Feb 12 21:12:38.264858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1431/2796] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:12:38 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:38.524932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:38.526229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:38.539964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:38.540428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:38.541244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:38.541714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:38.650376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-42727c85-069d-4dc2-a307-cbc32f933d4d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8feada550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:38.675038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:38.694601 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64418d10-1ee0-4864-b846-290757aef7c7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1280 microversion: 2.1 time: 0.174229 Feb 12 21:12:38.698573 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1366/2797] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:38 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:38.742011 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-42727c85-069d-4dc2-a307-cbc32f933d4d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.095898 Feb 12 21:12:38.742809 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1432/2798] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:38 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:38.858466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:38.858466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:38.872444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:38.872925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:38.874027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:38.874699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:39.275013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:39.278366 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0422aee6-2a8e-42d4-833b-0eb0396fb63c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.424662 Feb 12 21:12:39.283291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1367/2799] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:38 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:39.717044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:39.717692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:39.734120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:39.734572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:39.735404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:39.735849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:39.757406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c520d04-da7e-42f5-b6b2-02b0ea5db623 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa90800cca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:39.839011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c520d04-da7e-42f5-b6b2-02b0ea5db623 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.085530 Feb 12 21:12:39.840053 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1368/2800] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:39 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:39.902835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2097146c-fd86-4825-b21d-677823e05718 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'create', calling method: .version_select at 0x7fa90806f1f0>, body: {"keypair": {"name": "tempest-keypair-1232732563"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:39.947332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2097146c-fd86-4825-b21d-677823e05718 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:39.957645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2097146c-fd86-4825-b21d-677823e05718 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for user d856ca6f15d74ea483e6c02dee0e0dc9 and project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:40.103331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:40.120060 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d8a462ae-31c6-4632-9d94-68b89807e2fa tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.407524 Feb 12 21:12:40.132950 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1433/2801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:39 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:40.144467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:40.149138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:40.168307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:40.168767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:40.170080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:40.170621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:40.349657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:40.357989 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a0dd187a-c346-449a-aa48-e399ee4e83b8 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1577 microversion: 2.1 time: 0.220009 Feb 12 21:12:40.358580 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1434/2802] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:40 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:40.362986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a9d17198-441d-4940-a392-9d5d650de44d req-1bf3b3c3-ac09-4035-ab2e-7a4783a684cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84cd2675-603b-4cf7-a9df-6d2d936caad9", "tag": "56212d07-715f-4e11-9f22-211463c39d54"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:40.364570 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:40.364570 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:40.371679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a9d17198-441d-4940-a392-9d5d650de44d req-1bf3b3c3-ac09-4035-ab2e-7a4783a684cb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:40.372133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a9d17198-441d-4940-a392-9d5d650de44d req-1bf3b3c3-ac09-4035-ab2e-7a4783a684cb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:40.391423 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a9d17198-441d-4940-a392-9d5d650de44d req-1bf3b3c3-ac09-4035-ab2e-7a4783a684cb service nova] Creating event network-changed:56212d07-715f-4e11-9f22-211463c39d54 for instance 84cd2675-603b-4cf7-a9df-6d2d936caad9 on nch2-master-1 Feb 12 21:12:40.397077 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a9d17198-441d-4940-a392-9d5d650de44d req-1bf3b3c3-ac09-4035-ab2e-7a4783a684cb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037285 Feb 12 21:12:40.397696 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1435/2803] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:40.403381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:40.404243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:40.412921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:40.415862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:40.415862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:40.415862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:40.506228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2097146c-fd86-4825-b21d-677823e05718 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:40.512170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2097146c-fd86-4825-b21d-677823e05718 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for user d856ca6f15d74ea483e6c02dee0e0dc9 and project 2094e607f7bf4345beb838fc2e483911. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:40.537118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2097146c-fd86-4825-b21d-677823e05718 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.637552 Feb 12 21:12:40.543403 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1369/2804] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:12:39 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 645 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:12:40.602049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:40.611385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5c78797-a7dd-4476-9849-425f5ad60033 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.211411 Feb 12 21:12:40.611999 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1436/2805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:40 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:40.854631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae14bdf2-615c-4a9a-b6e2-3e153b74c80c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fbe3a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:40.953407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae14bdf2-615c-4a9a-b6e2-3e153b74c80c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.103911 Feb 12 21:12:40.958387 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1370/2806] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:40 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:41.139709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:41.143542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:41.160272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:41.160766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:41.169259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:41.170212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:41.629209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:41.631967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:41.641591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:41.641591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:41.648973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:41.649514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:41.953706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:41.962075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-111ed994-2b5d-41e8-a98f-64baa8d10f87 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.826786 Feb 12 21:12:41.971738 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1437/2807] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:41 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:41.975568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c6a34a77-42b0-41c6-a051-144fac529e0d req-61b345db-0814-42e7-b65e-1cacf1d4bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:41.977219 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:41.977219 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:42.004641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c6a34a77-42b0-41c6-a051-144fac529e0d req-61b345db-0814-42e7-b65e-1cacf1d4bba0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:42.010568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c6a34a77-42b0-41c6-a051-144fac529e0d req-61b345db-0814-42e7-b65e-1cacf1d4bba0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:42.048428 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c6a34a77-42b0-41c6-a051-144fac529e0d req-61b345db-0814-42e7-b65e-1cacf1d4bba0 service nova] Creating event network-changed:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:12:42.057790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c6a34a77-42b0-41c6-a051-144fac529e0d req-61b345db-0814-42e7-b65e-1cacf1d4bba0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085485 Feb 12 21:12:42.058643 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1438/2808] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:42.066080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b829118e-4cd0-4e23-a1e2-3f2bab0b904b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fec7a4c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:42.095439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:42.112012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10b24f3d-992f-4485-9cdb-806cb096c569 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.486380 Feb 12 21:12:42.112615 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1371/2809] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:41 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:42.150397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b829118e-4cd0-4e23-a1e2-3f2bab0b904b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.090671 Feb 12 21:12:42.151925 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1439/2810] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:42 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:42.978361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:42.978957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:42.986953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:42.987733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:42.988756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:42.989562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:43.129463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:43.130258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:43.148257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:43.148963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:43.149984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:43.150573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:43.362125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:43.370052 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0eda0b4c-fdd9-4849-9ed1-28548d6e617e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.244091 Feb 12 21:12:43.373214 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1440/2811] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:43 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:43.378006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d0c7ca8b-891f-4d57-b087-3c1e05c696ef tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fec7a280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:43.403538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:43.419419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a6cc9764-dd76-4d71-a51e-be91c368d0c8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.443647 Feb 12 21:12:43.420112 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1372/2812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:42 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:43.439359 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d0c7ca8b-891f-4d57-b087-3c1e05c696ef tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.064701 Feb 12 21:12:43.440031 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1441/2813] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:43 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:44.313985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-39987538", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4558dc02-1bc4-4b41-a16f-8a68e939fe76"}], "security_groups": [{"name": "tempest-securitygroup--170515330"}], "key_name": "tempest-keypair-1232732563", "user_data": "}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:44.388636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:44.389910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:44.398514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:44.398974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:44.399781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:44.400226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:44.446037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] validate_networks() for [('4558dc02-1bc4-4b41-a16f-8a68e939fe76', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:12:44.548091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:44.555860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b499bc51-6cd4-4135-8ed7-33d99e12926c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.172328 Feb 12 21:12:44.556448 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1442/2814] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:44 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:44.570309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:44.570839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:44.576854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:44.577314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:44.578129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:44.578564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:44.736437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:44.744507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7472c77f-6689-4f7d-aea5-d7596f57ffd2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.178059 Feb 12 21:12:44.745673 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1443/2815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:44 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:44.750344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d284c8e-4d63-409b-ae7e-55b0f5359d20 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fed50dc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:44.798297 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d284c8e-4d63-409b-ae7e-55b0f5359d20 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1414 microversion: 2.1 time: 0.051241 Feb 12 21:12:44.798888 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1444/2816] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:44 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1414 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:44.935367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:12:44.935367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:12:44.935367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:12:44.935660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:12:44.936407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:12:44.947295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:44.949666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:44.949666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:44.949666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:44.968076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for project 2094e607f7bf4345beb838fc2e483911. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:44.974397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Getting quotas for user d856ca6f15d74ea483e6c02dee0e0dc9 and project 2094e607f7bf4345beb838fc2e483911. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:44.988639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:12:45.005581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:12:45.201036 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51a11e49-a4eb-484f-8d50-68a914e9fd2f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.891467 Feb 12 21:12:45.201734 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1373/2817] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:12:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 12 21:12:45.212446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-451dbb7b-5601-472e-9fa8-99b6f84fd8ee tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:45.213070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-451dbb7b-5601-472e-9fa8-99b6f84fd8ee tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:45.273459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-451dbb7b-5601-472e-9fa8-99b6f84fd8ee tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:45.280864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-451dbb7b-5601-472e-9fa8-99b6f84fd8ee tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:45.282414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-451dbb7b-5601-472e-9fa8-99b6f84fd8ee tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:45.283735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-451dbb7b-5601-472e-9fa8-99b6f84fd8ee tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1280 microversion: 2.20 time: 0.075688 Feb 12 21:12:45.284302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1445/2818] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:45 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:45.573544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:45.578138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:45.583116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:45.583564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:45.584482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:45.584990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:45.743826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:45.751855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27d7a8cb-b92d-408b-b02a-5bfe46e546bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.183364 Feb 12 21:12:45.752300 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1374/2819] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:45 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:45.761701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:45.762311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:45.770122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:45.770580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:45.771369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:45.771831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:45.812782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fcf9f7db-5218-4142-b9f8-41e87b5657c3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fe1d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:45.859222 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fcf9f7db-5218-4142-b9f8-41e87b5657c3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1423 microversion: 2.1 time: 0.050672 Feb 12 21:12:45.860804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1375/2820] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:45 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1423 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:45.871569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9745ea71-60f8-4ecb-8bcf-d2a9cf6a5c81 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fcd1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:45.914779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:45.917592 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9745ea71-60f8-4ecb-8bcf-d2a9cf6a5c81 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 200 len: 1423 microversion: 2.1 time: 0.049598 Feb 12 21:12:45.922718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1376/2821] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:12:45 2022] GET /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 1423 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:45.922912 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bbe606b5-d59e-4142-9894-4ef43f3199ff tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.165213 Feb 12 21:12:45.923502 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1446/2822] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:45 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:45.929880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-afa4115c-464e-4ebf-869a-5825e9a79279 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fcd820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:46.302679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:46.303833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:46.309997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:46.310457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:46.311251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:46.311692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:46.373778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:46.385309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:46.386667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:46.387800 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e31017c-351e-4247-aea2-1e61bc215a5f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1284 microversion: 2.20 time: 0.088956 Feb 12 21:12:46.388569 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1447/2823] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:46 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:46.769597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:46.770211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:46.777850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:46.778318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:46.779117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:46.779728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.203344 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-afa4115c-464e-4ebf-869a-5825e9a79279 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 204 len: 0 microversion: 2.1 time: 1.277529 Feb 12 21:12:47.204426 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1377/2824] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:45 2022] DELETE /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 0 bytes in 1279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:12:47.209602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:47.210427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:47.217481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:47.218719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.220613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:47.220613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.230554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:47.238829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-697d274c-bfc1-420f-be3e-2485a9c2f729 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.472944 Feb 12 21:12:47.243646 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1448/2825] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:46 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:47.244637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:47.245207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:47.251342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:47.251888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.252677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:47.253119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.292559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:12:47.369829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:47.377348 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93d6879f-6c0a-4ad5-8b05-684da96efe49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.171736 Feb 12 21:12:47.377939 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1378/2826] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:47 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:47.405891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:47.406530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:47.413440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:47.413894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.414872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:47.415312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:47.530154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:47.543288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:47.545053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:47.546225 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a918379-7922-4d7b-bde7-6a347e5ae9df tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1340 microversion: 2.20 time: 0.144016 Feb 12 21:12:47.546961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1379/2827] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:47 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1340 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:47.644114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ed08417-2d38-445a-a531-7b94f65e76b8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 204 len: 0 microversion: 2.1 time: 0.403286 Feb 12 21:12:47.648217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1449/2828] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:12:47 2022] DELETE /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:12:47.755527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1372157788", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:47.811101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] validate_networks() for [('4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:12:48.257423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:48.257870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:48.265906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.266510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.267392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.268079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.400225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:12:48.400918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:12:48.401644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:12:48.402461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:12:48.403136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:12:48.412760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.412941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:48.413663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.414581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.415101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.423132 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3cea17a4-74d6-40cf-a100-bf3388aa323f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.170607 Feb 12 21:12:48.423943 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1450/2829] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:48 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:48.436507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:12:48.438622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:48.440672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:48.442038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for user 1cec3ccfc53b48bfa8bc879989b720b8 and project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:12:48.448532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.448997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.449819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.450409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.458183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:12:48.461253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:12:48.602224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6afe5c83-3ca5-4e35-95f4-da706bcc8aed tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850610 Feb 12 21:12:48.603493 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1380/2830] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:12:48.609690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-82b99d66-2873-43f2-9867-c91ef2cbbbb5 req-bf672f1a-1343-4f25-a038-4a3d72fee2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "name": "network-vif-plugged", "status": "completed", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:48.611784 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:48.611784 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:48.620713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-82b99d66-2873-43f2-9867-c91ef2cbbbb5 req-bf672f1a-1343-4f25-a038-4a3d72fee2d5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.625280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-82b99d66-2873-43f2-9867-c91ef2cbbbb5 req-bf672f1a-1343-4f25-a038-4a3d72fee2d5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.634668 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-82b99d66-2873-43f2-9867-c91ef2cbbbb5 req-bf672f1a-1343-4f25-a038-4a3d72fee2d5 service nova] Creating event network-vif-plugged:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:12:48.640394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-82b99d66-2873-43f2-9867-c91ef2cbbbb5 req-bf672f1a-1343-4f25-a038-4a3d72fee2d5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Feb 12 21:12:48.641021 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1381/2831] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:48.646311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:48.648671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:48.655485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.656099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.656925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:48.657461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:48.663609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:48.700168 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-120a573d-b590-4162-bd7f-7f7a2966a7ec tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.265051 Feb 12 21:12:48.717742 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1451/2832] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:48 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:48.722798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8cedd1a3-eb8b-4f66-9c47-d86657ec6ec2 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:48.730097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8cedd1a3-eb8b-4f66-9c47-d86657ec6ec2 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:48.827536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8cedd1a3-eb8b-4f66-9c47-d86657ec6ec2 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:48.832944 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8cedd1a3-eb8b-4f66-9c47-d86657ec6ec2 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1208 microversion: 2.1 time: 0.113713 Feb 12 21:12:48.843434 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1452/2833] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:48 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:49.061527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:49.070725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:49.074490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:49.075964 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1a41479-1c85-431b-9288-f244efe9c678 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.433678 Feb 12 21:12:49.076904 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1382/2834] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:48 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:49.440717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:49.441616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:49.454475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:49.455155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:49.456054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:49.456708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:49.624879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:49.634934 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cccc2296-b16d-4b91-947d-01789dc94a97 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.198174 Feb 12 21:12:49.635932 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1453/2835] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:49 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:49.720674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:49.722364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:49.732286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:49.732743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:49.733579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:49.734017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:49.850547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:49.851148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:49.857147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:49.857633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:49.858450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:49.858889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:49.925373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:49.935025 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f7f48c2-eca3-43a8-a757-4ac8476c8188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1212 microversion: 2.1 time: 0.088137 Feb 12 21:12:49.939813 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1454/2836] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:49 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:50.029207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9402ccda-dec8-4089-a3ef-962098d29bbf req-a36de893-3d5b-4f7f-aa1a-8a2d41b1541c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:50.031748 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:50.031748 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:50.040431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9402ccda-dec8-4089-a3ef-962098d29bbf req-a36de893-3d5b-4f7f-aa1a-8a2d41b1541c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.041556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9402ccda-dec8-4089-a3ef-962098d29bbf req-a36de893-3d5b-4f7f-aa1a-8a2d41b1541c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.053790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9402ccda-dec8-4089-a3ef-962098d29bbf req-a36de893-3d5b-4f7f-aa1a-8a2d41b1541c service nova] Creating event network-changed:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch1-master-1 Feb 12 21:12:50.059801 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9402ccda-dec8-4089-a3ef-962098d29bbf req-a36de893-3d5b-4f7f-aa1a-8a2d41b1541c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035890 Feb 12 21:12:50.061053 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1455/2837] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:50.062756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:50.070607 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-250b287a-405f-4a4d-9683-4e3b64d809e2 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1322 microversion: 2.1 time: 0.354274 Feb 12 21:12:50.071593 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1383/2838] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:49 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:50.098396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:50.099214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:50.112227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.112757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.113680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.114189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.290075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:50.300432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:50.301808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:50.309511 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-99b479e4-ee7d-4859-829d-eb6fa081a358 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.211892 Feb 12 21:12:50.310576 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1456/2839] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:50 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:50.655696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:50.656831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:50.657243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-acb64a6c-cc10-4c29-8110-d84a908715bd req-556edc91-8014-4c84-ac84-e1bd4b022a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9045d14a-f3fd-4ac7-b7c3-80e22e9b0970", "name": "network-vif-unplugged", "status": "completed", "tag": "ce0bcb3d-2043-41d3-a1f4-e06134cff0af"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:50.659651 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:50.659651 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:50.670288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-acb64a6c-cc10-4c29-8110-d84a908715bd req-556edc91-8014-4c84-ac84-e1bd4b022a67 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.670964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-acb64a6c-cc10-4c29-8110-d84a908715bd req-556edc91-8014-4c84-ac84-e1bd4b022a67 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.675781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.680339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.680339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.680339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.684571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-acb64a6c-cc10-4c29-8110-d84a908715bd req-556edc91-8014-4c84-ac84-e1bd4b022a67 service nova] Creating event network-vif-unplugged:ce0bcb3d-2043-41d3-a1f4-e06134cff0af for instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 on nch2-master-1 Feb 12 21:12:50.690358 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-acb64a6c-cc10-4c29-8110-d84a908715bd req-556edc91-8014-4c84-ac84-e1bd4b022a67 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036766 Feb 12 21:12:50.695272 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1457/2840] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:12:50.952803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:50.955078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:50.962915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.963466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:50.964354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:50.964870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.034711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:51.042837 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e02e203e-97c9-4c3f-a274-42d417a8236d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1268 microversion: 2.1 time: 0.094247 Feb 12 21:12:51.043546 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1458/2841] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:50 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1268 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:51.088407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:51.089146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:51.097083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.097868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.098659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.099141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.268235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:51.277072 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4c8ad5b1-5a5f-4750-80ec-10edb8c5bf6a tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1515 microversion: 2.1 time: 0.193178 Feb 12 21:12:51.277786 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1459/2842] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:51 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:51.300646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:51.301662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:51.308797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.308797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.310198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.310198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.340109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lazy-loading 'flavor' on Instance uuid 576b4285-d489-4d23-8406-e71cbf2e0106 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:12:51.377222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:51.385464 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61aed571-decb-4817-a83d-3f9f41e4bad9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.735487 Feb 12 21:12:51.386152 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1384/2843] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:50 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:51.390721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:51.391530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:51.400633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.401088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.401928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.402367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.624734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:51.633265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:51.635103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:51.636268 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e939edea-6d56-4652-a11d-975f06b763ab tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.249128 Feb 12 21:12:51.637011 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1385/2844] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:51 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:51.758376 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ebda3dcb-7290-47b3-b95a-5a99a4d8f1c5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action" status: 200 len: 32 microversion: 2.1 time: 0.461652 Feb 12 21:12:51.759266 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1460/2845] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:12:51 2022] POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:12:51.768084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:51.768700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:51.776420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.777179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:51.782525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:51.782525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.017431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:52.027073 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97a3e75d-e3d7-403d-81cf-150333a636ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.262704 Feb 12 21:12:52.027672 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1386/2846] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:51 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:52.060935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:52.061673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:52.068514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.069206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.070489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.071071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.095375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-98989554-cea1-4632-a454-04386cf343a2 req-fb849019-78a3-4767-b288-93939b9ea5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9045d14a-f3fd-4ac7-b7c3-80e22e9b0970", "name": "network-vif-deleted", "tag": "ce0bcb3d-2043-41d3-a1f4-e06134cff0af"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:52.098517 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:52.098517 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:52.106819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-98989554-cea1-4632-a454-04386cf343a2 req-fb849019-78a3-4767-b288-93939b9ea5bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.107533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-98989554-cea1-4632-a454-04386cf343a2 req-fb849019-78a3-4767-b288-93939b9ea5bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.119792 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-98989554-cea1-4632-a454-04386cf343a2 req-fb849019-78a3-4767-b288-93939b9ea5bb service nova] Creating event network-vif-deleted:ce0bcb3d-2043-41d3-a1f4-e06134cff0af for instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 on nch2-master-1 Feb 12 21:12:52.126259 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-98989554-cea1-4632-a454-04386cf343a2 req-fb849019-78a3-4767-b288-93939b9ea5bb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036275 Feb 12 21:12:52.126928 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1387/2847] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:52.148990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:52.156880 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-97378924-822d-45ea-aa1d-0dd42149f2f8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1266 microversion: 2.1 time: 0.100184 Feb 12 21:12:52.157579 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1461/2848] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:52 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:52.403621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:52.404340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:52.410649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.411108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.411899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.412987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.654574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:52.655199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:52.661575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.662115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.663727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:52.664178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:52.710007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:52.718083 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b5c956d-afd2-49b0-8031-12853f802d9a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.318745 Feb 12 21:12:52.718934 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1388/2849] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:52 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:52.810853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:52.820305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:52.822283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:52.823659 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddf57fb1-c7e3-4d39-9ac3-6e4a40e27f9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.172669 Feb 12 21:12:52.824551 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1462/2850] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:52 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:53.044574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:53.045248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:53.052176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.052632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.053737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.054184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.179972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:53.180811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:53.188821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.188821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.189246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.189722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.238493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:53.246165 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d484519a-2e20-4aa7-86df-b009df049231 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.205254 Feb 12 21:12:53.246746 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1389/2851] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:53 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:53.332839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:53.340636 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-01d3ff0f-8804-4b88-8d00-98e1d97026c1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1308 microversion: 2.1 time: 0.165139 Feb 12 21:12:53.341216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1463/2852] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:53 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:12:53.736013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:53.736674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:53.743227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.743687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.744493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.744961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.843278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:53.843806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:53.850890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.851350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.852148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:53.852592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:53.900578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:53.910226 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2765a159-e887-4a2c-bb86-8e219465e56e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.177989 Feb 12 21:12:53.910824 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1390/2853] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:53 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:53.996182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:54.004155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:54.005696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:54.007349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b90bdc4f-69fc-4e37-842c-8292cb7cbf50 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.168426 Feb 12 21:12:54.007918 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1464/2854] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:53 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:54.141945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ec6b7102-a404-471b-b1da-54f83331e8f3 req-e7176193-18b8-4326-ac24-79cf8b052d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79709269-3992-4499-9554-9f8e806a6b1e", "tag": "b25ff654-6b35-4608-9611-19d43612bf7b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:54.143856 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:54.143856 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:12:54.152610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ec6b7102-a404-471b-b1da-54f83331e8f3 req-e7176193-18b8-4326-ac24-79cf8b052d4a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.153087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ec6b7102-a404-471b-b1da-54f83331e8f3 req-e7176193-18b8-4326-ac24-79cf8b052d4a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:54.164386 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ec6b7102-a404-471b-b1da-54f83331e8f3 req-e7176193-18b8-4326-ac24-79cf8b052d4a service nova] Creating event network-changed:b25ff654-6b35-4608-9611-19d43612bf7b for instance 79709269-3992-4499-9554-9f8e806a6b1e on nch2-master-1 Feb 12 21:12:54.169433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ec6b7102-a404-471b-b1da-54f83331e8f3 req-e7176193-18b8-4326-ac24-79cf8b052d4a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031167 Feb 12 21:12:54.170160 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1391/2855] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:54.263179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:54.264111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:54.271563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.272556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:54.273473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.274130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:54.360375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:54.361405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:54.368503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.369151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:54.369996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.370677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:54.427800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:54.436774 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0986d4b0-42f2-4b6b-822b-1db6b48cddc8 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.177715 Feb 12 21:12:54.438196 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1465/2856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:54 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:54.631397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:54.639751 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a35a8a4-29da-48f3-b917-d4e2c47b3d94 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1308 microversion: 2.1 time: 0.285671 Feb 12 21:12:54.649402 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1392/2857] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:54 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:54.928386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:54.929009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:54.935550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.936003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:54.936782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:54.937219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.026333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:55.026881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:55.033105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:55.033582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.034376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:55.034815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.078152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:55.087215 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a33bcff0-1fa3-44a6-bbe2-29fede034d75 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.162868 Feb 12 21:12:55.087802 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1466/2858] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:54 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:55.187490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:55.196409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:55.197947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:55.199296 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86b0ac23-79e1-4a5b-a60c-d3df262400c9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.177318 Feb 12 21:12:55.199630 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1393/2859] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:55 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:55.455007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:55.455656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:55.462327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:55.462783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.463570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:55.464010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.597812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:55.606310 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70925db6-7f55-438b-b9d7-226e91bc5601 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.155109 Feb 12 21:12:55.606917 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1467/2860] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:55 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:55.657544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:55.658242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:55.664783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:55.665207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.666007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:55.666450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:55.805717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:55.813151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9bd621de-01b6-4021-83e6-0f0144ec844c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1308 microversion: 2.1 time: 0.159553 Feb 12 21:12:55.813756 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1394/2861] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:55 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:56.104771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:56.105343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:56.112020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.112475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.113259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.113729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.216973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:56.217739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:56.224642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.225805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.226607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.227046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.253711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:56.261866 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-57e64a99-de8c-4b94-8490-a847385e6a8f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.160959 Feb 12 21:12:56.263143 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1468/2862] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:56 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:56.366754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:56.375102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:56.377522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:56.378119 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55eb8bf7-0c1e-480b-aee2-b5c340dba051 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.164593 Feb 12 21:12:56.378791 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1395/2863] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:56 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:56.623746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:56.624300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:56.630695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.631787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.632538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.633035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.774978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:56.782559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13c7818a-6638-4bb8-b6f2-362f8ed9d9f4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.162657 Feb 12 21:12:56.783132 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1469/2864] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:56 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:56.829325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:56.830371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:56.836796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.837247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.838060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:56.838496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:56.973470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:56.981783 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-be78cd83-69bf-4284-afdb-7738506316a1 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1308 microversion: 2.1 time: 0.156135 Feb 12 21:12:56.982361 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1396/2865] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:56 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:57.279085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:57.279670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:57.286172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:57.286632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:57.287963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:57.288403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:57.397132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:57.397808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:57.405171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:57.405663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:57.406464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:57.406948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:57.425718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:57.433183 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a2f0630-03f1-4c40-8eaa-63d9f2e3ece6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.157964 Feb 12 21:12:57.433792 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1470/2866] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:57 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:57.541981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:57.550193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:57.551700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:57.552863 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9b68418-6d51-495d-8555-0d289f7e934d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.159949 Feb 12 21:12:57.554068 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1397/2867] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:57 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:12:57.799094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:57.799742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:57.806638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:57.807101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:57.807895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:57.808345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:57.948417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:57.956013 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-61d28afe-8e0d-4e0b-8f08-039606c7b89f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.160745 Feb 12 21:12:57.956591 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1471/2868] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:57 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:57.998537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:57.999148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:58.005236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.005745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.007124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.007559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.147078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:58.154658 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2501686-2deb-4f10-a2e5-91064ed8d44a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1308 microversion: 2.1 time: 0.159837 Feb 12 21:12:58.155236 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1398/2869] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:57 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:58.450665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:58.451281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:58.457856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.458319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.459485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.459485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.572857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:58.573514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:58.580229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.580652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.581486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.582139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.599078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:58.609729 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9069e6fb-0d72-47d7-b4a4-ebcd76179a48 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.161204 Feb 12 21:12:58.609729 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1472/2870] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:58 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:58.613459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9abf98b4-d721-498c-91a5-81d6c12602dd req-408ff6a0-bbff-4ed7-ab36-eae82a98aad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79709269-3992-4499-9554-9f8e806a6b1e", "name": "network-vif-plugged", "status": "completed", "tag": "b25ff654-6b35-4608-9611-19d43612bf7b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:12:58.615089 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:12:58.615089 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:12:58.623028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9abf98b4-d721-498c-91a5-81d6c12602dd req-408ff6a0-bbff-4ed7-ab36-eae82a98aad3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.623624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9abf98b4-d721-498c-91a5-81d6c12602dd req-408ff6a0-bbff-4ed7-ab36-eae82a98aad3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.638618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9abf98b4-d721-498c-91a5-81d6c12602dd req-408ff6a0-bbff-4ed7-ab36-eae82a98aad3 service nova] Creating event network-vif-plugged:b25ff654-6b35-4608-9611-19d43612bf7b for instance 79709269-3992-4499-9554-9f8e806a6b1e on nch2-master-1 Feb 12 21:12:58.647018 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9abf98b4-d721-498c-91a5-81d6c12602dd req-408ff6a0-bbff-4ed7-ab36-eae82a98aad3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 Feb 12 21:12:58.647846 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1473/2871] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:12:58.769513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:58.779285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:58.780794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:58.781941 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea72e25d-97c7-44ba-8c63-688797629b20 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.214157 Feb 12 21:12:58.782518 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1399/2872] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:58 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:12:58.974403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:58.975362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:58.981782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.982237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:58.983025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:58.983466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.123168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:59.130936 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b6abc762-9976-4899-a8d6-b8b34583e24f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.161149 Feb 12 21:12:59.132239 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1474/2873] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:58 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:59.171711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:59.172359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:59.179184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:59.179639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.180430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:59.180868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.318691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:59.326141 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2e3e99a4-d2da-4154-b657-971e2930d3ea tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1308 microversion: 2.1 time: 0.158124 Feb 12 21:12:59.326712 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1400/2874] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:59 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:59.625568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:59.626103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:59.633041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:59.633548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.634588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:59.635025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.768552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:59.777144 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a2ff745-c975-4592-a3ad-ab8f3e65f2ac tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.155423 Feb 12 21:12:59.777757 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1475/2875] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:12:59 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:12:59.799921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:12:59.800680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:12:59.807700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:59.808155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.808951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:12:59.809412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:12:59.950009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:59.958085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:59.960327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:12:59.961506 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-640af41a-d9dd-41dd-a65f-de6bbcace6f3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.165372 Feb 12 21:12:59.962112 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1401/2876] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:12:59 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:13:00.148900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:00.149473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:00.156336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.156789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.157686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.158126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.293850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:00.301237 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1dd331c7-1944-4cc8-81cf-f4d2622b10af tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.156847 Feb 12 21:13:00.301986 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1476/2877] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:00 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:00.342654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:00.343268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:00.349465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.349997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.350783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.351224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.489721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:00.498662 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-541bc26b-8650-4cc4-8ba3-85e0787fd446 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1487 microversion: 2.1 time: 0.159802 Feb 12 21:13:00.499253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1402/2878] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:00 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1487 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:00.521372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:00.522233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:00.528484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.528942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.529758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.530215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.554860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lazy-loading 'flavor' on Instance uuid 79709269-3992-4499-9554-9f8e806a6b1e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:00.662734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-0442696a-d51c-4592-85cd-a91294c6d195 req-61b8f93a-c8b6-4b4d-a534-e56f892fa8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "name": "network-vif-plugged", "status": "completed", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:00.664547 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:00.664547 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:00.671464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0442696a-d51c-4592-85cd-a91294c6d195 req-61b8f93a-c8b6-4b4d-a534-e56f892fa8b3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.671948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0442696a-d51c-4592-85cd-a91294c6d195 req-61b8f93a-c8b6-4b4d-a534-e56f892fa8b3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.683703 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-0442696a-d51c-4592-85cd-a91294c6d195 req-61b8f93a-c8b6-4b4d-a534-e56f892fa8b3 service nova] Creating event network-vif-plugged:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch1-master-1 Feb 12 21:13:00.688956 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-0442696a-d51c-4592-85cd-a91294c6d195 req-61b8f93a-c8b6-4b4d-a534-e56f892fa8b3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030006 Feb 12 21:13:00.689527 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1403/2879] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:00.795006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:00.795761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:00.802009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.802558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.803999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.804436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.841974 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a014b5f8-42d2-4a32-a1cd-9f00f6719202 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e/action" status: 202 len: 0 microversion: 2.1 time: 0.324242 Feb 12 21:13:00.846090 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1477/2880] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:00 2022] POST /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:00.852120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:00.852824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:00.860203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.860668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.862090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.862210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.956107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:00.964269 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f74dd1a4-28e6-4ba8-8218-d63f1d1ccafc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.173447 Feb 12 21:13:00.964955 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1404/2881] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:00 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:00.979729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:00.980349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:00.986510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.986967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:00.987756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:00.988200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:01.012072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:01.020015 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7b9e325-d717-40c4-becc-a2fc0bcffffb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1495 microversion: 2.1 time: 0.172518 Feb 12 21:13:01.020587 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1478/2882] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:00 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1495 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:01.126613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:01.135058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:01.136577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:01.137720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-568956c8-b742-4e70-a62d-f87e90a837f5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.161960 Feb 12 21:13:01.138299 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1405/2883] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:00 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:13:01.318138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:01.319241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:01.325766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:01.326221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:01.327002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:01.327439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:01.466607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:01.474627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b469894c-f125-4e31-958b-087213bf8218 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.160336 Feb 12 21:13:01.475473 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1479/2884] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:01 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:01.981722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:01.982360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:01.989263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:01.989749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:01.990535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:01.990974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.037250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:02.037801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:02.045449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.045842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.046653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.047098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.138259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:02.145779 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-701bb707-8935-4c2d-acff-aad74a6a406c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.168395 Feb 12 21:13:02.146362 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1406/2885] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:01 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:02.156031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:02.156795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:02.163097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.163563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.164357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.164799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.197017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:02.205867 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e1e5d945-3b5c-404b-99b2-49a55305f1e9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 200 len: 1478 microversion: 2.1 time: 0.172399 Feb 12 21:13:02.206465 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1480/2886] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:02 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 1478 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:02.222522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1000634542"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:02.223601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:02.230381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.230894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.231692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.232136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.308319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:02.316414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:02.317963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:02.319137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a67f1fa-0c20-41cc-b7c1-e5822e1a925d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1405 microversion: 2.20 time: 0.166738 Feb 12 21:13:02.319707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1407/2887] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:02 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:13:02.492131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:02.492810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:02.499614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.500071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.500854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:02.501293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:02.636255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:02.643580 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5c9eff9-1e89-43e6-bf9b-4383b6d5f1a9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.155202 Feb 12 21:13:02.644151 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1408/2888] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:02 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:02.756669 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4dcf690c-cfeb-470e-aaba-6ca07ece2e1a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e/action" status: 202 len: 0 microversion: 2.1 time: 0.537629 Feb 12 21:13:02.757371 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1481/2889] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:02 2022] POST /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Feb 12 21:13:02.767727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3086c134-3514-416a-a20a-3edf44baa78e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa90806ad30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:02.812049 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3086c134-3514-416a-a20a-3edf44baa78e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.048160 Feb 12 21:13:02.812677 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1409/2890] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:02 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:03.164222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:03.164933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:03.171554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.172011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.172827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.173265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.315865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:03.324269 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e127320-f42a-4ebb-8e87-1ff98b3b7cf0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.164525 Feb 12 21:13:03.324844 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1482/2891] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:03 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:03.338561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:03.339293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:03.346496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.346954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.347756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.348200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.490241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:03.499273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:03.500794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:03.502173 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7196181c-03c6-4316-be97-b45cc5c69ff8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1598 microversion: 2.20 time: 0.168509 Feb 12 21:13:03.502744 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1410/2892] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:03 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:13:03.520425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:03.520926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:03.527513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.527973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.528767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.529858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.613577 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd4eb601-c2fb-48c4-aa13-428d554777fb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096893 Feb 12 21:13:03.614195 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1483/2893] 10.222.0.31 () {60 vars in 1315 bytes} [Sat Feb 12 21:13:03 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:13:03.660230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:03.660848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:03.668001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.668461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.669265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:03.669744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:03.809568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:03.817011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21f6cbc9-54e6-4fd4-8324-c4bf38fdda4d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.160709 Feb 12 21:13:03.817731 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1411/2894] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:03 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:03.825513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f0142a62-1ed3-4c1f-ae6a-28cb7e1dfb0c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fea3cb80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:03.871440 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f0142a62-1ed3-4c1f-ae6a-28cb7e1dfb0c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.050036 Feb 12 21:13:03.872019 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1484/2895] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:03 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:04.342223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:04.342841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:04.349982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.350448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.351289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.351737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.494726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:04.502503 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-729ec278-0827-4bb7-80c1-39252ed94473 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.164250 Feb 12 21:13:04.503090 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1412/2896] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:04 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:04.683234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:04.683732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:04.684819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-66a51d81-aa01-4570-942e-1f5f96b319a9 req-1d08da78-7319-44fa-adbd-6438d03cab92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:04.686455 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:04.686455 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:04.690867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.691255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.692093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.693149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.694309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-66a51d81-aa01-4570-942e-1f5f96b319a9 req-1d08da78-7319-44fa-adbd-6438d03cab92 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.694762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-66a51d81-aa01-4570-942e-1f5f96b319a9 req-1d08da78-7319-44fa-adbd-6438d03cab92 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.707514 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-66a51d81-aa01-4570-942e-1f5f96b319a9 req-1d08da78-7319-44fa-adbd-6438d03cab92 service nova] Creating event network-changed:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch1-master-1 Feb 12 21:13:04.713046 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-66a51d81-aa01-4570-942e-1f5f96b319a9 req-1d08da78-7319-44fa-adbd-6438d03cab92 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Feb 12 21:13:04.713981 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1413/2897] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:04.725298 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f864cc2-853b-4052-a638-4e80b85f76e5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/ips" status: 200 len: 113 microversion: 2.20 time: 0.046911 Feb 12 21:13:04.726302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1485/2898] 10.222.0.31 () {60 vars in 1288 bytes} [Sat Feb 12 21:13:04 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/ips => generated 113 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:13:04.838403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:04.839608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:04.849143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.850047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.851003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:04.851449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:04.886121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-55c890b5-9eda-481f-9418-7af5c2dea04c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe898b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:04.941589 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-55c890b5-9eda-481f-9418-7af5c2dea04c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.059964 Feb 12 21:13:04.942489 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1486/2899] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:04 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:05.104377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:05.114223 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08aec33a-8b07-4275-99dc-f41398fb6d9f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.281921 Feb 12 21:13:05.115039 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1414/2900] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:04 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:05.520895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:05.521835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:05.529053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:05.531708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:05.532588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:05.533631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:05.705545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:05.723860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d746c5e3-2bd5-4f95-9da8-c4f34d89d605 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.204940 Feb 12 21:13:05.723860 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1487/2901] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:05 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:05.957325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ade2899-79f7-4a06-a8ba-aed5b5089f3b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa9080454c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:06.011734 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ade2899-79f7-4a06-a8ba-aed5b5089f3b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.058146 Feb 12 21:13:06.013220 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1415/2902] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:05 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:06.130640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:06.131261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:06.139028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:06.139815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:06.140721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:06.141241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:06.281212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:06.293059 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b69ca970-2ea9-4469-9c10-a1ca59b4333e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.165636 Feb 12 21:13:06.294126 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1488/2903] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:06 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:06.740663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:06.741285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:06.748771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:06.749224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:06.750049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:06.750492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:06.917608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:06.929708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f49b2458-b41f-48e3-a204-7ef74c464932 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.190614 Feb 12 21:13:06.932071 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1416/2904] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:06 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:07.032777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b01c0a62-ed2d-4415-8c9b-d3be10549ca8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fea3c820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:07.092709 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b01c0a62-ed2d-4415-8c9b-d3be10549ca8 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.071375 Feb 12 21:13:07.093842 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1489/2905] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:07 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:07.312672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:07.314046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:07.325018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:07.330468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:07.331592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:07.332363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:07.519496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:07.533835 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-492b3f7f-ba0f-452f-a722-1bf0f4bca404 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.221517 Feb 12 21:13:07.543756 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1417/2906] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:07 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:07.949139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:07.949795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:07.957164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:07.957656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:07.958667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:07.959316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:08.112645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-62693414-5402-4249-970e-66a4980f5715 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa90806f1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:08.121621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:08.131525 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e5f6072-f32f-44ea-b04c-4f6391bbd031 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1522 microversion: 2.1 time: 0.186854 Feb 12 21:13:08.132279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1490/2907] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:07 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:08.185252 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-62693414-5402-4249-970e-66a4980f5715 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.083338 Feb 12 21:13:08.185878 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1418/2908] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:08 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:08.522869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2c7d101d-8854-4c87-99ec-3fbfb7596253 req-b7faea81-cad9-458a-bc82-f760a0708357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79709269-3992-4499-9554-9f8e806a6b1e", "name": "network-vif-plugged", "status": "completed", "tag": "b25ff654-6b35-4608-9611-19d43612bf7b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:08.527576 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:08.527576 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:08.537997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2c7d101d-8854-4c87-99ec-3fbfb7596253 req-b7faea81-cad9-458a-bc82-f760a0708357 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:08.538749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2c7d101d-8854-4c87-99ec-3fbfb7596253 req-b7faea81-cad9-458a-bc82-f760a0708357 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:08.550695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:08.551909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:08.553494 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2c7d101d-8854-4c87-99ec-3fbfb7596253 req-b7faea81-cad9-458a-bc82-f760a0708357 service nova] Creating event network-vif-plugged:b25ff654-6b35-4608-9611-19d43612bf7b for instance 79709269-3992-4499-9554-9f8e806a6b1e on nch2-master-1 Feb 12 21:13:08.560091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2c7d101d-8854-4c87-99ec-3fbfb7596253 req-b7faea81-cad9-458a-bc82-f760a0708357 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041667 Feb 12 21:13:08.560659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:08.561128 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1491/2909] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:08.564147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:08.565084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:08.565588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:08.764367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:08.779591 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-435d27f9-7abe-4f99-9935-7ca7bceb2cef tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.232278 Feb 12 21:13:08.780181 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1419/2910] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:08 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:09.150583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:09.151247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:09.159138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.159724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.160561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.161010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.202481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cc1cafd-c831-4902-8f5d-7382d5822f24 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907fc5310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:09.257075 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3cc1cafd-c831-4902-8f5d-7382d5822f24 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.058265 Feb 12 21:13:09.258068 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1420/2911] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:09 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:09.338176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:09.346121 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa6b8b6b-d697-4da5-99e3-0ff58c18e451 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1502 microversion: 2.1 time: 0.200274 Feb 12 21:13:09.346596 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1492/2912] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:09 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:09.363577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:09.364196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:09.371437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.371896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.372726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.373240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.530414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:09.537872 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4181c534-af9d-4682-afdd-d94225fb57ef tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1517 microversion: 2.1 time: 0.178326 Feb 12 21:13:09.538542 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1421/2913] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:09 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:09.557962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5897d2e7-fdb0-463c-acbf-55ec3f98ed85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:09.574047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5897d2e7-fdb0-463c-acbf-55ec3f98ed85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 18aa77ea-efae-4bfd-aaae-828c32f96ace] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:09.574047 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-5897d2e7-fdb0-463c-acbf-55ec3f98ed85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Instance 18aa77ea-efae-4bfd-aaae-828c32f96ace could not be found. Feb 12 21:13:09.574047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5897d2e7-fdb0-463c-acbf-55ec3f98ed85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 404 to user: Instance 18aa77ea-efae-4bfd-aaae-828c32f96ace could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:09.574047 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5897d2e7-fdb0-463c-acbf-55ec3f98ed85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/18aa77ea-efae-4bfd-aaae-828c32f96ace/action" status: 404 len: 111 microversion: 2.1 time: 0.012722 Feb 12 21:13:09.574047 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1493/2914] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:09 2022] POST /compute/v2.1/servers/18aa77ea-efae-4bfd-aaae-828c32f96ace/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:09.581693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:09.582256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:09.589690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.590148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.591266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.591361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.799442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:09.800071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:09.808454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.808928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.809764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.810383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.847467 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c843674-89e0-4422-bae3-b5d74d9989d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 202 len: 0 microversion: 2.1 time: 0.269360 Feb 12 21:13:09.849741 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1422/2915] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:09 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:09.873883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:09.874615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:09.891719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.892671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:09.893781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:09.894383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:10.064681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:10.076183 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca3ee0f3-08c1-41cb-ac12-6d061437cde6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.280555 Feb 12 21:13:10.077603 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1494/2916] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:09 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:10.088436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:10.097864 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31dd595f-8c78-4c23-9bec-7f1ef341e2f7 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1522 microversion: 2.1 time: 0.233145 Feb 12 21:13:10.102179 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1423/2917] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:09 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:10.270946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41f738f2-3d95-4de0-a557-49395f05650a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fecf0e50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:10.336407 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41f738f2-3d95-4de0-a557-49395f05650a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.069614 Feb 12 21:13:10.341451 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1495/2918] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:10 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:11.093644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:11.094274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:11.101929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.102381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.103190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.103660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.120697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:11.121756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:11.130319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.131095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.132124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.132662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.268050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:11.285254 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-01e5aba2-e7e3-49d6-b37c-d79cc1912b39 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.194487 Feb 12 21:13:11.296129 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1424/2919] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:11 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:11.342223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:11.355358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14300932-7a81-46ef-9a66-adb0b63b4e0a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe5a15e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:11.363513 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6649016a-fd6a-4d2f-af01-e5352cd3882b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1502 microversion: 2.1 time: 0.247298 Feb 12 21:13:11.365303 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1496/2920] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:11 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:11.391191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:11.392713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:11.402274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.402988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.404089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.404705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.423398 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14300932-7a81-46ef-9a66-adb0b63b4e0a tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.072661 Feb 12 21:13:11.424642 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1425/2921] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:11 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:11.440509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'flavor' on Instance uuid c4a76f8f-ed14-4d6c-9296-e0e3113005c5 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:11.457627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Cannot 'rescue' instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 while it is in vm_state paused Feb 12 21:13:11.458535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 409 to user: Cannot 'rescue' instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 while it is in vm_state paused {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:11.459395 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-59a7d12a-0d7a-46b9-8f54-d694ba410c1e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 409 len: 144 microversion: 2.1 time: 0.072162 Feb 12 21:13:11.461721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1497/2922] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:11 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 144 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:13:11.471012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:11.471579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:11.478457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.479068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.479961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.480570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.777235 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-415ae40f-14aa-4db6-99ff-4568d83e60d3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 202 len: 0 microversion: 2.1 time: 0.312006 Feb 12 21:13:11.781839 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1426/2923] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:11 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:11.788976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:11.793996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:11.800735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.801261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.802153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:11.802591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:11.970215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:11.983587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b8317326-a39d-47cb-98b0-215148ef45d2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1509 microversion: 2.1 time: 0.198246 Feb 12 21:13:11.984600 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1498/2924] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:11 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:12.305508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:12.306766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:12.313947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:12.314403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:12.315328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:12.315779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:12.438638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-71ee0f56-207d-48eb-8df1-89947a07ca39 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fec56820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:12.481309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:12.484292 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-71ee0f56-207d-48eb-8df1-89947a07ca39 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.049726 Feb 12 21:13:12.484793 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1499/2925] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:12 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:12.489626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-853b063c-fad7-418e-9e22-d34a2fb5153f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.189445 Feb 12 21:13:12.490199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1427/2926] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:12 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:13.000322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:13.002778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:13.010972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:13.014017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:13.014017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:13.014017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:13.185710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:13.196050 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bec3dfd2-4471-48df-bf29-9c2625632826 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1517 microversion: 2.1 time: 0.199509 Feb 12 21:13:13.206575 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1500/2927] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:12 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:13.500419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-588d411e-f266-4038-9786-29cb95a3a4af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe5a1ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:13.511851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:13.511851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:13.518247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:13.518983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:13.519971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:13.520732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:13.553806 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-588d411e-f266-4038-9786-29cb95a3a4af tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.058310 Feb 12 21:13:13.554709 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1428/2928] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:13 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:13.722075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:13.733463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9944ef20-58fe-4120-9667-0fc4cdba3bbe tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.227897 Feb 12 21:13:13.733463 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1501/2929] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:13 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:14.569343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-39b37715-5e24-44ff-ba9f-64c5044c9c6c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe6514c0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:14.624478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-39b37715-5e24-44ff-ba9f-64c5044c9c6c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.060080 Feb 12 21:13:14.625190 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1429/2930] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:14 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:14.748043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:14.748666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:14.756448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:14.756911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:14.757739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:14.758188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:14.945829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:14.961492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-86c40ee5-7d6c-440f-9311-e3323d78ed4f tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.211809 Feb 12 21:13:14.961492 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1502/2931] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:14 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:15.639354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-886682a7-ace9-4eff-b2a0-79a23d2dfb56 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa9044ba160>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:15.687521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-886682a7-ace9-4eff-b2a0-79a23d2dfb56 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1440 microversion: 2.1 time: 0.053424 Feb 12 21:13:15.689755 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1430/2932] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:15 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1440 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:15.979141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:15.981271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:15.988054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:15.988721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:15.989728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:15.990320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.039142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:16.040227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:16.047381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.049742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.049742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.049742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.076612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'flavor' on Instance uuid c4a76f8f-ed14-4d6c-9296-e0e3113005c5 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:16.152156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:16.159726 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-559369ea-fe85-46e3-a87e-0a8fdb186887 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.186856 Feb 12 21:13:16.160304 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1503/2933] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:15 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:16.399440 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15711ca0-deaf-4b4e-91c5-2addedcdcd08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 200 len: 32 microversion: 2.1 time: 0.364121 Feb 12 21:13:16.400048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1431/2934] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:16 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:13:16.409089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:16.409882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:16.416061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.416519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.417825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.418267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.564307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:16.572996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6a77cda-d694-45e8-addb-64e4e75d11eb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.167666 Feb 12 21:13:16.575211 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1504/2935] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:16 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:16.702679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3aceac2-2a34-4a2e-8222-d015e26878a4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe5a1820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:16.757874 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3aceac2-2a34-4a2e-8222-d015e26878a4 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1449 microversion: 2.1 time: 0.061068 Feb 12 21:13:16.758462 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1432/2936] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:16 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1449 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:16.770724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-105f1375-f238-4ff5-8d6b-53d3a4ce82fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fec89c10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:16.814367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-105f1375-f238-4ff5-8d6b-53d3a4ce82fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 200 len: 1449 microversion: 2.1 time: 0.047291 Feb 12 21:13:16.814953 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1505/2937] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:16 2022] GET /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 1449 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:16.826597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4096814-288d-4eb5-ae66-60823a439188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe600940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:16.833490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:16.836775 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:16.836775 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:16.837811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:16.838565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Searching by: {'deleted': False, 'project_id': '8ad1d954f50f46459af1b6dbfb179207'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:13:16.844794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.845185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.846038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.846475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.874062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:13:16.906508 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3e11d07-be13-460a-b5c8-d49e92ba6270 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.077166 Feb 12 21:13:16.907297 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1506/2938] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:13:16 2022] GET /compute/v2.1/servers => generated 334 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:16.920218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:16.924394 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:16.924394 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:16.926232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:16.927254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Searching by: {'deleted': False, 'project_id': '8ad1d954f50f46459af1b6dbfb179207'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:13:16.934732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.935408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.936364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:16.936736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:16.975755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:13:17.006088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:17.013735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.014185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.143152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c798925-2173-489a-ad74-ab968c631663 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.228326 Feb 12 21:13:17.143683 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1507/2939] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:13:16 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:17.163559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f48ef113-451f-414d-adf4-d11dd9a80102 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:17.173016 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f48ef113-451f-414d-adf4-d11dd9a80102 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014061 Feb 12 21:13:17.173646 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1508/2940] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:13:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:17.177922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:17.178566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:17.185225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.185697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.190723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.190723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.325700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:17.333372 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-344488e5-fac9-4b31-acb3-45b6ef7be899 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.158753 Feb 12 21:13:17.333956 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1509/2941] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:17 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:17.591915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:17.592536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:17.598945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.599318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.600149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.600598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.744696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:17.753038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e5416ba-d57d-4210-a7b7-dfc66bcd200c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.165457 Feb 12 21:13:17.754757 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1510/2942] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:17 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:17.882879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:17.883388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:17.890224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.890676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.891464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.891904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.917890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:13:17.942728 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4096814-288d-4eb5-ae66-60823a439188 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 204 len: 0 microversion: 2.1 time: 1.120274 Feb 12 21:13:17.943365 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1433/2943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:16 2022] DELETE /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:13:17.951905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:17.952835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:17.958977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.959467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.960291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:17.960772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:17.986101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:13:18.209865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd145f6f-07f3-4cc2-a866-755eef12b6c3 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "DELETE /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 204 len: 0 microversion: 2.1 time: 0.330153 Feb 12 21:13:18.210463 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1511/2944] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:17 2022] DELETE /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:13:18.219746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:18.220463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:18.226526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.226986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.227783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.228227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.295607 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa305740-8152-4edd-bc32-10360c0db712 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 204 len: 0 microversion: 2.1 time: 0.347586 Feb 12 21:13:18.296294 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1434/2945] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:17 2022] DELETE /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:13:18.348198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-704958374", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:18.371978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:18.379459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6de94c36-9f4e-4a47-9012-70a8e22478c9 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1702 microversion: 2.1 time: 0.164158 Feb 12 21:13:18.380051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1512/2946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:18 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1702 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:18.393947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:18.394566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:18.400839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.401340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.402293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.402740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.403387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] validate_networks() for [('4ef335b6-69bf-4c69-80a0-3d63bc5c8bf2', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:13:18.540071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:18.548492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eadba667-68bd-457d-8a07-cd22c98084c4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.167366 Feb 12 21:13:18.549086 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1513/2947] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:18 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:18.771014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:18.771625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:18.772564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:13:18.773032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:13:18.773582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:13:18.774192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:13:18.775938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:13:18.778837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.779286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.781052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.781052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.787105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.787598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.788488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:18.789011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:18.811638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:13:18.817703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Getting quotas for user 1cec3ccfc53b48bfa8bc879989b720b8 and project e3c778564eef403aa9d4a76e4c1d3c20. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:13:18.830979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:13:18.834915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:13:18.927140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:18.935234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5e7aefc-47ee-481e-b9ca-b867fcb602fd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.167928 Feb 12 21:13:18.935809 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1514/2948] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:18 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:19.039846 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb3a0a93-1b30-4d47-a23f-6c46080849fb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695679 Feb 12 21:13:19.040450 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1435/2949] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:13:19.050439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-762d49b9-046f-43d4-a526-53373fc053bb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:19.051045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-762d49b9-046f-43d4-a526-53373fc053bb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:19.106049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-762d49b9-046f-43d4-a526-53373fc053bb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:19.112870 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-762d49b9-046f-43d4-a526-53373fc053bb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1207 microversion: 2.1 time: 0.066078 Feb 12 21:13:19.114957 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1515/2950] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:19 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:19.399306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:19.399959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:19.406464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:19.411573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:19.411573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:19.411573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:19.560572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:19.565556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:19.566198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:19.575596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:19.576013 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ddccd243-7659-415a-982a-64fb38b7fc33 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1702 microversion: 2.1 time: 0.182270 Feb 12 21:13:19.576129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:19.578180 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1436/2951] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:19 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1702 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:19.578301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:19.578301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:19.719424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:19.727155 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47222124-5297-46e3-aff7-c7b46c62ba90 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.165159 Feb 12 21:13:19.727747 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1516/2952] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:19 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:19.952942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:19.953944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:19.961160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:19.961647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:19.963398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:19.963398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.132588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:20.137895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:20.142507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.142955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.143958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.144572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.235356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:20.243772 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fc5ef59-e7cc-4044-8168-7699c900f1d9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1211 microversion: 2.1 time: 0.115153 Feb 12 21:13:20.244748 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1517/2953] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:20 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:20.357025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:20.367320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bdbdc701-7e4a-4da1-8279-7b5cebc56bff tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.418610 Feb 12 21:13:20.368458 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1437/2954] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:19 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:20.592814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:20.593449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:20.600996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.606112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.606112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.606112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.725627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e115a64e-a2c3-4643-a56c-19d46dd6ade0 req-50a3ce1d-7910-41c1-bc0a-a9e8ba49fb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79709269-3992-4499-9554-9f8e806a6b1e", "name": "network-vif-deleted", "tag": "b25ff654-6b35-4608-9611-19d43612bf7b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:20.727982 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:20.727982 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:20.738765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e115a64e-a2c3-4643-a56c-19d46dd6ade0 req-50a3ce1d-7910-41c1-bc0a-a9e8ba49fb82 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.739794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e115a64e-a2c3-4643-a56c-19d46dd6ade0 req-50a3ce1d-7910-41c1-bc0a-a9e8ba49fb82 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.765833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e115a64e-a2c3-4643-a56c-19d46dd6ade0 req-50a3ce1d-7910-41c1-bc0a-a9e8ba49fb82 service nova] Creating event network-vif-deleted:b25ff654-6b35-4608-9611-19d43612bf7b for instance 79709269-3992-4499-9554-9f8e806a6b1e on nch2-master-1 Feb 12 21:13:20.772148 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e115a64e-a2c3-4643-a56c-19d46dd6ade0 req-50a3ce1d-7910-41c1-bc0a-a9e8ba49fb82 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052802 Feb 12 21:13:20.772804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1438/2955] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:20.781416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:20.783280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:20.797175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.798778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.799820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:20.800510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:20.817068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:20.826113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b38f433d-8fcb-4089-9804-dc5e7890353d tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1702 microversion: 2.1 time: 0.237043 Feb 12 21:13:20.826932 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1518/2956] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:20 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1702 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:21.046710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:21.054521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-62a898dc-b1d2-4d7c-b1ba-2f321f143694 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.279115 Feb 12 21:13:21.055098 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1439/2957] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:20 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:21.164116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d83a7de5-591c-48cd-bfd6-85b06f0f1e19 req-e9160029-01bc-44f9-8ec2-f657c85d7baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84cd2675-603b-4cf7-a9df-6d2d936caad9", "name": "network-vif-deleted", "tag": "56212d07-715f-4e11-9f22-211463c39d54"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:21.167933 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:21.167933 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:21.177637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d83a7de5-591c-48cd-bfd6-85b06f0f1e19 req-e9160029-01bc-44f9-8ec2-f657c85d7baf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.178900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d83a7de5-591c-48cd-bfd6-85b06f0f1e19 req-e9160029-01bc-44f9-8ec2-f657c85d7baf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.215034 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d83a7de5-591c-48cd-bfd6-85b06f0f1e19 req-e9160029-01bc-44f9-8ec2-f657c85d7baf service nova] Creating event network-vif-deleted:56212d07-715f-4e11-9f22-211463c39d54 for instance 84cd2675-603b-4cf7-a9df-6d2d936caad9 on nch2-master-1 Feb 12 21:13:21.226160 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d83a7de5-591c-48cd-bfd6-85b06f0f1e19 req-e9160029-01bc-44f9-8ec2-f657c85d7baf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070686 Feb 12 21:13:21.230430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1519/2958] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:21.262268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:21.269119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:21.272192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.272820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.273807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.274680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.385798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:21.387308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:21.394220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:21.400409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.400840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.408847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.411327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.415265 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e178da6e-6d38-43a2-b454-9025c28fb190 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1267 microversion: 2.1 time: 0.157429 Feb 12 21:13:21.416631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1440/2959] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:21 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:21.601343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:21.612364 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d28360da-f0f6-4667-8e4c-ccf37d317b2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.231292 Feb 12 21:13:21.613449 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1520/2960] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:21 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:21.844770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:21.845726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:21.852066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.852545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.853439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.853951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.890022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:21.890839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:21.891255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lazy-loading 'fault' on Instance uuid 84cd2675-603b-4cf7-a9df-6d2d936caad9 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:21.951345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8859c1af22f453fbff6e63689b5d6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad1d954f50f46459af1b6dbfb179207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:21.959012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-901a7947-d430-4002-afba-6c28ad013b17 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 200 len: 1360 microversion: 2.1 time: 0.118399 Feb 12 21:13:21.959596 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1441/2961] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:21 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 1360 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:22.073121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:22.074444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:22.080899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.081514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.082332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.082782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.243655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:22.252307 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0c88cf26-3cfc-402c-888e-9100e41253c9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.183470 Feb 12 21:13:22.253197 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1521/2962] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:22 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:22.434753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:22.435903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:22.442964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.443421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.444245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.444691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.630310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:22.630952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:22.637764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.639023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.639023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.639607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.672098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:22.679960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-74633213-2516-482d-8a05-4870b7af86cc tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.249845 Feb 12 21:13:22.684421 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1442/2963] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:22 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:22.785035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:22.793129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38add20c-4f1c-41c1-992f-cdd3b1c8b604 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.166645 Feb 12 21:13:22.794444 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1522/2964] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:22 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:22.976826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:22.977566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] [instance: 84cd2675-603b-4cf7-a9df-6d2d936caad9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:22.983887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.984483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.985383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:22.985867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:22.999913 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] HTTP exception thrown: Instance 84cd2675-603b-4cf7-a9df-6d2d936caad9 could not be found. Feb 12 21:13:23.000515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Returning 404 to user: Instance 84cd2675-603b-4cf7-a9df-6d2d936caad9 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:23.001336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8221e89b-b068-43cb-8164-9b3cdf960154 tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9" status: 404 len: 111 microversion: 2.1 time: 0.028465 Feb 12 21:13:23.001932 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1443/2965] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:22 2022] GET /compute/v2.1/servers/84cd2675-603b-4cf7-a9df-6d2d936caad9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:23.012030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-02813124-9cbd-4641-a0c4-654d5a588b9c tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] Calling method '.version_select at 0x7fa8fead2af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:23.106040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-02813124-9cbd-4641-a0c4-654d5a588b9c tempest-ServersTestJSON-1891601635 tempest-ServersTestJSON-1891601635-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831086224" status: 202 len: 0 microversion: 2.1 time: 0.098316 Feb 12 21:13:23.106703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1523/2966] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831086224 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:23.249741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-64f35a8a-91a1-4aba-8645-440ef537aabf req-c6e27e76-1a7d-49ac-81b0-14978b4bc438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042df63a-9c4e-48d7-816b-872d5ec3a8b9", "tag": "561753eb-dbf7-4e5f-a226-0a1a83afc52f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:23.251299 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:23.251299 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:23.258369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-64f35a8a-91a1-4aba-8645-440ef537aabf req-c6e27e76-1a7d-49ac-81b0-14978b4bc438 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.258809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-64f35a8a-91a1-4aba-8645-440ef537aabf req-c6e27e76-1a7d-49ac-81b0-14978b4bc438 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.270379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:23.270592 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-64f35a8a-91a1-4aba-8645-440ef537aabf req-c6e27e76-1a7d-49ac-81b0-14978b4bc438 service nova] Creating event network-changed:561753eb-dbf7-4e5f-a226-0a1a83afc52f for instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 on nch1-master-1 Feb 12 21:13:23.271774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:23.275540 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-64f35a8a-91a1-4aba-8645-440ef537aabf req-c6e27e76-1a7d-49ac-81b0-14978b4bc438 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030007 Feb 12 21:13:23.276030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1444/2967] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:23.281132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.281637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.282453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.282894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.558454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:23.567878 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d173a25-92d1-4965-87f0-391c9b17a09e tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1521 microversion: 2.1 time: 0.301308 Feb 12 21:13:23.568617 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1524/2968] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:23 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:23.711922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:23.713228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:23.720462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.720921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.721754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.722226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.810593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:23.811356 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:23.818321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.820886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.820886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:23.820886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:23.891561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:23.900426 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-38d80b31-1435-4d34-b4af-60161f693690 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.206362 Feb 12 21:13:23.901018 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1445/2969] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:23 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:24.041036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:24.049425 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79cc2437-2cb6-4e66-a0ef-6e46c9fd1939 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.242872 Feb 12 21:13:24.059010 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1525/2970] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:23 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:24.584681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:24.585372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:24.602635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:24.602635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:24.602635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:24.602635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:24.832775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:24.840306 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-008bd6c5-2b9e-410e-9b0f-1c7de099714d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1501 microversion: 2.1 time: 0.259272 Feb 12 21:13:24.840930 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1446/2971] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:24 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:24.857646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f4b0e812-ea0b-436c-bf88-6562851b0d6b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'create', calling method: .version_select at 0x7fa8fe87e8b0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1984496408", "description": "tempest-description-1314065753"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:24.918063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:24.918783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:24.924968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:24.925540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:24.926392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:24.926899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:25.225418 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f4b0e812-ea0b-436c-bf88-6562851b0d6b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.372257 Feb 12 21:13:25.226235 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1526/2972] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:13:24 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:25.238916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:25.239534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:25.248708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:25.248708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:25.248708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:25.248708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:25.397151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:25.405058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-18efbe63-2a17-44fd-917b-b7abd960d7b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.170062 Feb 12 21:13:25.405681 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1527/2973] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:25 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:25.411028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1984496408"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:25.411572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:25.418771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:25.419223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:25.420021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:25.420461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:25.463171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:25.474938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e8f8d763-13f5-479d-8331-f5d34db8b062 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.561220 Feb 12 21:13:25.475706 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1447/2974] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:24 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:25.556877 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.network.security_group_api [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Adding security group e6efcbea-2208-417f-b450-670a5d9db5b6 to port 7aef0ce7-550d-4329-9dc1-3a0237bf7a36 Feb 12 21:13:26.407281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c030abe8-1195-48ab-9a3a-06eefa0103e4 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action" status: 202 len: 0 microversion: 2.1 time: 1.000535 Feb 12 21:13:26.425932 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1528/2975] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:25 2022] POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:26.433813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bd33acea-57fa-4ffb-9cab-5ed7eae316e8 req-5c3ab6d1-a8cd-4134-bd2b-1385a9c71907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:26.436130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1984496408"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:26.437021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:26.437178 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:26.437178 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:26.446083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.446803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:26.448050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.450148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:26.461722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bd33acea-57fa-4ffb-9cab-5ed7eae316e8 req-5c3ab6d1-a8cd-4134-bd2b-1385a9c71907 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.462496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bd33acea-57fa-4ffb-9cab-5ed7eae316e8 req-5c3ab6d1-a8cd-4134-bd2b-1385a9c71907 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:26.481730 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bd33acea-57fa-4ffb-9cab-5ed7eae316e8 req-5c3ab6d1-a8cd-4134-bd2b-1385a9c71907 service nova] Creating event network-changed:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:13:26.488447 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bd33acea-57fa-4ffb-9cab-5ed7eae316e8 req-5c3ab6d1-a8cd-4134-bd2b-1385a9c71907 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075508 Feb 12 21:13:26.489682 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1448/2976] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:26.496973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:26.497826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:26.504623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.505226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:26.506082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.506526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:26.696110 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.network.security_group_api [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Removing security group e6efcbea-2208-417f-b450-670a5d9db5b6 from port 7aef0ce7-550d-4329-9dc1-3a0237bf7a36 Feb 12 21:13:26.760698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:26.770851 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e405436d-c7f6-4e1a-af38-d5311518147b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.279283 Feb 12 21:13:26.787646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1449/2977] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:26 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:26.790125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:26.791458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:26.798893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.799525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:26.800482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:26.801495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:27.083060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:27.094437 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ea3af6a-1857-4f46-a4af-a1e556b80889 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.307155 Feb 12 21:13:27.105241 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1450/2978] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:26 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:27.497118 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e919a59c-fc8a-4780-ba9d-c9eca5b348d7 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action" status: 202 len: 0 microversion: 2.1 time: 1.069911 Feb 12 21:13:27.498089 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1529/2979] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:26 2022] POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action => generated 0 bytes in 1071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:27.508345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee5878c5-64a2-4b80-8224-76abccde0a49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'create', calling method: .version_select at 0x7fa907fb19d0>, body: {"pool": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:27.789896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:27.791581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:27.798737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:27.799419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:27.800411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:27.800876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:28.069226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:28.079944 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b24c06b-9105-424d-8bdc-7a14cd0cba85 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.293870 Feb 12 21:13:28.080911 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1530/2980] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:27 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:28.111307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:28.112044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:28.118619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:28.119287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:28.120831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:28.121278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:28.302875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:28.311399 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d3d9062-f8a9-4fc3-8a78-61a0a36d2afb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.203919 Feb 12 21:13:28.311989 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1531/2981] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:28 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:28.528228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b8857d77-e451-4634-a92a-d9902b45a6b9 req-b16a3ea9-fb3b-4449-9a5f-9f843f0f4e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:28.531324 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:28.531324 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:28.539012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b8857d77-e451-4634-a92a-d9902b45a6b9 req-b16a3ea9-fb3b-4449-9a5f-9f843f0f4e72 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:28.539465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b8857d77-e451-4634-a92a-d9902b45a6b9 req-b16a3ea9-fb3b-4449-9a5f-9f843f0f4e72 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:28.562595 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b8857d77-e451-4634-a92a-d9902b45a6b9 req-b16a3ea9-fb3b-4449-9a5f-9f843f0f4e72 service nova] Creating event network-changed:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:13:28.568171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b8857d77-e451-4634-a92a-d9902b45a6b9 req-b16a3ea9-fb3b-4449-9a5f-9f843f0f4e72 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043822 Feb 12 21:13:28.569644 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1532/2982] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:29.099316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:29.100028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:29.106548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:29.107289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:29.108098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:29.108535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:29.284210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:29.292664 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9863f56f-5239-44b5-b6db-3561184b73d8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.198445 Feb 12 21:13:29.293332 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1533/2983] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:29 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:29.329559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:29.330292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:29.336371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:29.336828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:29.337830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:29.338418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:29.466634 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee5878c5-64a2-4b80-8224-76abccde0a49 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.962638 Feb 12 21:13:29.467942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1451/2984] 10.222.0.31 () {60 vars in 1169 bytes} [Sat Feb 12 21:13:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:29.480019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.218"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:29.486205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:29.490125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:29.491603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:29.492451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:29.493566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:29.494658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:29.499420 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-151430a9-0eca-4a29-9115-8b20fc051c89 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.173605 Feb 12 21:13:29.500006 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1534/2985] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:29 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:29.524920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Acquired lock "refresh_cache-576b4285-d489-4d23-8406-e71cbf2e0106" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:13:30.310940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:30.312174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:30.319849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:30.320120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:30.321157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:30.321645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:30.468230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:30.476830 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad837e04-b2a1-4313-884e-71f669f0185d tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.170505 Feb 12 21:13:30.477588 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1535/2986] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:30 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:30.517499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:30.518128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:30.524960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:30.525439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:30.527751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:30.528200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:30.678240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:30.687053 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bca9f934-44fc-4894-8393-852ca7697571 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.173719 Feb 12 21:13:30.696074 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1536/2987] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:30 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:30.824800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-150739dc-cc88-4025-a467-46da0c4671f5 req-d7d6870e-ecc7-49b3-a2e7-4b81606b4258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042df63a-9c4e-48d7-816b-872d5ec3a8b9", "name": "network-vif-plugged", "status": "completed", "tag": "561753eb-dbf7-4e5f-a226-0a1a83afc52f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:30.831735 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:30.831735 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:30.842194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-150739dc-cc88-4025-a467-46da0c4671f5 req-d7d6870e-ecc7-49b3-a2e7-4b81606b4258 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:30.843200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-150739dc-cc88-4025-a467-46da0c4671f5 req-d7d6870e-ecc7-49b3-a2e7-4b81606b4258 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:30.862255 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-150739dc-cc88-4025-a467-46da0c4671f5 req-d7d6870e-ecc7-49b3-a2e7-4b81606b4258 service nova] Creating event network-vif-plugged:561753eb-dbf7-4e5f-a226-0a1a83afc52f for instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 on nch1-master-1 Feb 12 21:13:30.868139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-150739dc-cc88-4025-a467-46da0c4671f5 req-d7d6870e-ecc7-49b3-a2e7-4b81606b4258 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048556 Feb 12 21:13:30.869179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1537/2988] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:31.086377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Building network info cache for instance {{(pid=141726) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:13:31.102973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2ad1284c-49ed-4d59-89a0-28e5aedb162f req-b3e79e6a-9b38-4f80-a969-7e15733cabd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:31.105551 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:31.105551 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:31.118282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2ad1284c-49ed-4d59-89a0-28e5aedb162f req-b3e79e6a-9b38-4f80-a969-7e15733cabd0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:31.118282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2ad1284c-49ed-4d59-89a0-28e5aedb162f req-b3e79e6a-9b38-4f80-a969-7e15733cabd0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:31.132966 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2ad1284c-49ed-4d59-89a0-28e5aedb162f req-b3e79e6a-9b38-4f80-a969-7e15733cabd0 service nova] Creating event network-changed:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:13:31.141669 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2ad1284c-49ed-4d59-89a0-28e5aedb162f req-b3e79e6a-9b38-4f80-a969-7e15733cabd0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045178 Feb 12 21:13:31.146833 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1538/2989] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:31.494074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:31.496076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:31.503290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:31.503750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:31.504535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:31.504972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:31.734730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:31.745348 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7cf9ef23-7ec9-4635-8f44-505e57b4a1fb tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.255324 Feb 12 21:13:31.762846 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1539/2990] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:31 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:31.767796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:31.768410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:31.774784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:31.775238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:31.776623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:31.777064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:31.960106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Updating instance_info_cache with network_info: [{"id": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36", "address": "fa:16:3e:48:22:2b", "network": {"id": "04053501-c602-45a2-b372-831dd8f55883", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-39409090-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "184a5eeefb1f41d2b34ac8b7b3dee122", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7aef0ce7-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:13:32.069231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:32.077889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a55f886-d14f-4e06-bb93-1a1bab9c4b6f tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1307 microversion: 2.1 time: 0.313645 Feb 12 21:13:32.078664 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1540/2991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:31 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:32.083444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Releasing lock "refresh_cache-576b4285-d489-4d23-8406-e71cbf2e0106" {{(pid=141726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:13:32.084679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ee15083-5018-420f-badc-afddf6c513f9 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action" status: 202 len: 0 microversion: 2.1 time: 2.609458 Feb 12 21:13:32.085875 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1452/2992] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:29 2022] POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action => generated 0 bytes in 2612 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:13:32.100514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Action: 'action', calling method: .version_select at 0x7fa905249af0>, body: {"removeFloatingIp": {"address": "172.35.2.218"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:32.307960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:32.314807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:32.315871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:32.316375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:32.316817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:32.607621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Acquired lock "refresh_cache-576b4285-d489-4d23-8406-e71cbf2e0106" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 12 21:13:32.769197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:32.770594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:32.778485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:32.778939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:32.779739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:32.780183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:32.923419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:32.942247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50da7a8f-0675-41b1-937a-26e08a294d69 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.176825 Feb 12 21:13:32.942876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1453/2993] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:32 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:33.095081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:33.096003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:33.102436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:33.102901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:33.103702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:33.105168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:33.317844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:33.326290 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0cff0a3a-892d-4d95-b4a1-339f2f191b63 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1485 microversion: 2.1 time: 0.234985 Feb 12 21:13:33.336932 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1454/2994] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:33 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1485 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:33.346098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-391980254"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:33.347904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:33.356152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:33.356893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:33.357775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:33.358361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:33.430813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Building network info cache for instance {{(pid=141727) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}} Feb 12 21:13:34.035023 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-49dbe8ca-8df0-43db-af61-d3c4bf697160 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "POST /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9/action" status: 202 len: 0 microversion: 2.1 time: 0.693755 Feb 12 21:13:34.040851 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1455/2995] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:33 2022] POST /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Feb 12 21:13:34.047237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2b4c2ae4-7910-448c-98a0-41c0411332fa req-890bd496-650c-44e0-96d2-3870ce48ef58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:34.050168 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:34.050168 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:34.065507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2b4c2ae4-7910-448c-98a0-41c0411332fa req-890bd496-650c-44e0-96d2-3870ce48ef58 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:34.066186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2b4c2ae4-7910-448c-98a0-41c0411332fa req-890bd496-650c-44e0-96d2-3870ce48ef58 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:34.089224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2b4c2ae4-7910-448c-98a0-41c0411332fa req-890bd496-650c-44e0-96d2-3870ce48ef58 service nova] Creating event network-changed:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:13:34.093998 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2b4c2ae4-7910-448c-98a0-41c0411332fa req-890bd496-650c-44e0-96d2-3870ce48ef58 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056434 Feb 12 21:13:34.095248 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1456/2996] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:34.100616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:34.101531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:34.115673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:34.116337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:34.117826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:34.118523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:34.222825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Updating instance_info_cache with network_info: [{"id": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36", "address": "fa:16:3e:48:22:2b", "network": {"id": "04053501-c602-45a2-b372-831dd8f55883", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-39409090-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "184a5eeefb1f41d2b34ac8b7b3dee122", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7aef0ce7-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=141727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:13:34.306006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Releasing lock "refresh_cache-576b4285-d489-4d23-8406-e71cbf2e0106" {{(pid=141727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 12 21:13:34.307886 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b30f92a-0604-4a3b-8263-393ed126e2ed tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action" status: 202 len: 0 microversion: 2.1 time: 2.210959 Feb 12 21:13:34.309412 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1541/2997] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:32 2022] POST /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106/action => generated 0 bytes in 2214 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 12 21:13:34.314473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18d5d34b-cdaa-4183-9714-2e3a74bde7f3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8feafb5e0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:34.395985 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-18d5d34b-cdaa-4183-9714-2e3a74bde7f3 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9" status: 200 len: 1413 microversion: 2.1 time: 0.083945 Feb 12 21:13:34.396515 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1542/2998] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:34 2022] GET /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:34.407093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cbaff94f-507a-4bae-920d-6c12a41e82a5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '.version_select at 0x7fa8fe898b80>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:34.661575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:34.670258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9dba2e69-a621-48f1-8128-082c9b443a84 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.573622 Feb 12 21:13:34.672122 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1457/2999] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:34 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:34.678789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aaeced55-cb5b-4dcb-8c88-e631a95ac197 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa90428e9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:34.744042 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aaeced55-cb5b-4dcb-8c88-e631a95ac197 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9" status: 200 len: 1413 microversion: 2.1 time: 0.070699 Feb 12 21:13:34.750834 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1458/3000] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:34 2022] GET /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:34.766180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-198360d9-cab4-4fc4-bfa0-cae12aadef3e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe6518b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:35.078606 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-198360d9-cab4-4fc4-bfa0-cae12aadef3e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9" status: 204 len: 0 microversion: 2.1 time: 0.319512 Feb 12 21:13:35.079309 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1459/3001] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:34 2022] DELETE /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:13:35.092910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0eb59c8a-e826-4031-8654-32c3036fa441 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe7e7820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:35.119142 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-0eb59c8a-e826-4031-8654-32c3036fa441 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Image not found. Feb 12 21:13:35.119916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0eb59c8a-e826-4031-8654-32c3036fa441 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:35.120765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0eb59c8a-e826-4031-8654-32c3036fa441 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9" status: 404 len: 62 microversion: 2.1 time: 0.032487 Feb 12 21:13:35.124582 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1460/3002] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:13:35 2022] GET /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:13:35.130373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:35.130995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:35.140990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:35.141481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:35.142310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:35.142748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:35.481006 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cbaff94f-507a-4bae-920d-6c12a41e82a5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "DELETE /compute/v2.1/os-floating-ips/85e5075a-48f6-41ca-85ae-1e5837a0d290" status: 202 len: 0 microversion: 2.1 time: 1.083220 Feb 12 21:13:35.481639 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1543/3003] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:13:34 2022] DELETE /compute/v2.1/os-floating-ips/85e5075a-48f6-41ca-85ae-1e5837a0d290 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:35.492039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89ce96b2-70ef-413e-be3f-be56d760cfcf tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '.version_select at 0x7fa8feada820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:35.546766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:35.561658 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-923507ef-7320-4c39-ac69-6540804bbf53 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1497 microversion: 2.1 time: 0.435528 Feb 12 21:13:35.564765 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1461/3004] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:35 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1497 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:35.689080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:35.691731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:35.699906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:35.700754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:35.704306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:35.705012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:35.897624 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89ce96b2-70ef-413e-be3f-be56d760cfcf tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/e6efcbea-2208-417f-b450-670a5d9db5b6" status: 202 len: 0 microversion: 2.1 time: 0.410307 Feb 12 21:13:35.898421 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1544/3005] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:13:35 2022] DELETE /compute/v2.1/os-security-groups/e6efcbea-2208-417f-b450-670a5d9db5b6 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:13:35.909396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:35.911368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:35.925932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:35.926777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:35.941874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:35.941874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:35.967589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:13:36.060738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:36.073979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3eaacf10-200d-4672-81f0-222861388e0c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1503 microversion: 2.1 time: 0.384260 Feb 12 21:13:36.085576 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1462/3006] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:35 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:36.097100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fcd13f9-de29-40a0-a872-022fc9be509b"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:36.099176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:36.106803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.107273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.108310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.108924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.140150 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Cannot 'attach_volume' instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 while it is in vm_state rescued Feb 12 21:13:36.140993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 409 to user: Cannot 'attach_volume' instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 while it is in vm_state rescued {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:36.142424 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bbad2bdd-3378-4330-af84-4794a8230c08 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052779 Feb 12 21:13:36.143639 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1463/3007] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:13:36 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:13:36.153436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:36.154224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:36.160495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.161223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.162200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.162797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.332937 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93de9aaf-467d-43ec-96f9-d5280af87cb5 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "DELETE /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 204 len: 0 microversion: 2.1 time: 0.428832 Feb 12 21:13:36.333858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1545/3008] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:35 2022] DELETE /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:13:36.343359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:36.344081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:36.351034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.351499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.352762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.353217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.486636 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-afb56b8a-65d5-4b24-a70d-45bf142ebfed tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 202 len: 0 microversion: 2.1 time: 0.338453 Feb 12 21:13:36.487666 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1464/3009] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:36 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:13:36.497103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:36.498189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:36.505017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.505988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.507042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.507673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.520167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:36.529781 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f4165a1-b660-4ab2-9df1-f7017e30fddb tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1507 microversion: 2.1 time: 0.191322 Feb 12 21:13:36.530384 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1546/3010] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:36 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:36.582954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:36.583559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:36.592327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.592949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.594311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:36.594515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:36.821391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:36.830422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e280574d-ebfa-476c-85b4-ba236e30745c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1511 microversion: 2.1 time: 0.338160 Feb 12 21:13:36.831641 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1465/3011] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:36 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:36.904591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:36.920661 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ae66898f-6e8f-449b-829d-9363e3d37280 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1503 microversion: 2.1 time: 0.341234 Feb 12 21:13:36.927487 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1547/3012] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:36 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:37.547475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:37.548097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:37.555022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:37.559752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:37.564546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:37.567024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:37.848128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:37.849320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:37.857140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:37.857619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:37.858412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:37.858847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:37.968788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:37.976736 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0081e64-125a-4f18-a07e-e2867714eb2d tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1507 microversion: 2.1 time: 0.433033 Feb 12 21:13:37.977318 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1466/3013] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:37 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:37.992335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:37.993244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:38.007248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:38.007945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:38.008933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:38.009940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:38.045045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:38.052795 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05744519-7190-4b37-aa79-ba86c7fc35b9 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1511 microversion: 2.1 time: 0.208316 Feb 12 21:13:38.053413 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1548/3014] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:37 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:38.396798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:38.411834 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-edddc948-734a-4c50-a0d7-d9d249a2bf1d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1503 microversion: 2.1 time: 0.424705 Feb 12 21:13:38.436895 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1467/3015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:37 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:38.827755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3079438e-c83f-47d1-8702-bb13c8120159 req-2d013621-5003-4c8f-92d4-120cb1c518fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042df63a-9c4e-48d7-816b-872d5ec3a8b9", "name": "network-vif-plugged", "status": "completed", "tag": "561753eb-dbf7-4e5f-a226-0a1a83afc52f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:38.829699 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:38.829699 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:38.841932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3079438e-c83f-47d1-8702-bb13c8120159 req-2d013621-5003-4c8f-92d4-120cb1c518fd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:38.842377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3079438e-c83f-47d1-8702-bb13c8120159 req-2d013621-5003-4c8f-92d4-120cb1c518fd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:38.860231 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3079438e-c83f-47d1-8702-bb13c8120159 req-2d013621-5003-4c8f-92d4-120cb1c518fd service nova] Creating event network-vif-plugged:561753eb-dbf7-4e5f-a226-0a1a83afc52f for instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 on nch1-master-1 Feb 12 21:13:38.872246 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3079438e-c83f-47d1-8702-bb13c8120159 req-2d013621-5003-4c8f-92d4-120cb1c518fd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047265 Feb 12 21:13:38.873127 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1549/3016] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:38.994947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:38.996027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:39.015445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.015445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.016289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.017460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.074619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:39.075360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:39.083157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.083855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.084856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.085302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.247167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:39.258075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6080dc48-e01d-47e8-855d-70c126382b21 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1511 microversion: 2.1 time: 0.189548 Feb 12 21:13:39.258675 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1550/3017] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:39 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:39.425335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:39.425933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:39.437305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.439083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.440176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.440790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.632087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:39.641897 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1549205c-1b7a-4815-891f-6ace784b5e03 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1485 microversion: 2.1 time: 0.219975 Feb 12 21:13:39.642501 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1551/3018] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:39 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1485 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:39.658494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:39.659004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:39.665240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.665742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.667215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:39.667835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:39.696143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:13:39.815892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:39.824443 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0b952746-4b74-4e40-8082-2612aa0e13ad tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1507 microversion: 2.1 time: 0.835382 Feb 12 21:13:39.825575 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1468/3019] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:38 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1507 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:40.047499 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8425241f-de8c-426b-a185-ffc5e05bb79c tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 204 len: 0 microversion: 2.1 time: 0.392410 Feb 12 21:13:40.048193 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1552/3020] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:39 2022] DELETE /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:13:40.059566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27b7db85-d0ff-472e-8fc6-cf897fd1f324 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa907f82040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:40.085864 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-27b7db85-d0ff-472e-8fc6-cf897fd1f324 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Image not found. Feb 12 21:13:40.086573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27b7db85-d0ff-472e-8fc6-cf897fd1f324 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:40.087448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27b7db85-d0ff-472e-8fc6-cf897fd1f324 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9" status: 404 len: 62 microversion: 2.1 time: 0.032929 Feb 12 21:13:40.088024 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1469/3021] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:40 2022] DELETE /compute/v2.1/images/90bbaf4b-81d9-4d92-ae40-61bf6a6194c9 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:13:40.097112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:40.097906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:40.104259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.104724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.105564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.106005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.133771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:13:40.191112 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Instance is already in deleting state, ignoring this request Feb 12 21:13:40.192164 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e2b1887-0225-4702-8d0d-faa2f9c31826 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 204 len: 0 microversion: 2.1 time: 0.099526 Feb 12 21:13:40.192761 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1553/3022] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:40 2022] DELETE /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:13:40.202599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:40.204057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:40.212163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.213085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.215154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.216173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.277113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:40.277899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:40.284145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.284604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.285464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.285906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.440496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:40.450682 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ce3a123-a0b0-4a97-ad41-4b05a01486bd tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1517 microversion: 2.1 time: 0.178122 Feb 12 21:13:40.451358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1554/3023] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:40 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:40.638918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ebd4b53d-ccee-457e-b516-de14ef7e91bc req-b1013c2b-2e4d-46dd-84b7-4dfb32a58e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576b4285-d489-4d23-8406-e71cbf2e0106", "name": "network-vif-deleted", "tag": "7aef0ce7-550d-4329-9dc1-3a0237bf7a36"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:40.641600 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:40.641600 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:40.651549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ebd4b53d-ccee-457e-b516-de14ef7e91bc req-b1013c2b-2e4d-46dd-84b7-4dfb32a58e65 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.652388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ebd4b53d-ccee-457e-b516-de14ef7e91bc req-b1013c2b-2e4d-46dd-84b7-4dfb32a58e65 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.665023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ebd4b53d-ccee-457e-b516-de14ef7e91bc req-b1013c2b-2e4d-46dd-84b7-4dfb32a58e65 service nova] Creating event network-vif-deleted:7aef0ce7-550d-4329-9dc1-3a0237bf7a36 for instance 576b4285-d489-4d23-8406-e71cbf2e0106 on nch2-master-1 Feb 12 21:13:40.671412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ebd4b53d-ccee-457e-b516-de14ef7e91bc req-b1013c2b-2e4d-46dd-84b7-4dfb32a58e65 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037027 Feb 12 21:13:40.676921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1555/3024] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:40.739926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:40.756978 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9f7154fa-7a3b-4fe9-acbc-355536194c5e tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1491 microversion: 2.1 time: 0.559693 Feb 12 21:13:40.757917 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1470/3025] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:40 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1491 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:40.841938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:40.842841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:40.855608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.856651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.857663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.862635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.895180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7ca0bd28-391a-4f2c-b4f4-32314943603e req-e3540306-4fd8-41b4-9a07-a2bc2cbad9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042df63a-9c4e-48d7-816b-872d5ec3a8b9", "name": "network-vif-unplugged", "status": "completed", "tag": "561753eb-dbf7-4e5f-a226-0a1a83afc52f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:40.897191 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:40.897191 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:40.906575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ca0bd28-391a-4f2c-b4f4-32314943603e req-e3540306-4fd8-41b4-9a07-a2bc2cbad9f7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:40.907253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ca0bd28-391a-4f2c-b4f4-32314943603e req-e3540306-4fd8-41b4-9a07-a2bc2cbad9f7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:40.921631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7ca0bd28-391a-4f2c-b4f4-32314943603e req-e3540306-4fd8-41b4-9a07-a2bc2cbad9f7 service nova] Creating event network-vif-unplugged:561753eb-dbf7-4e5f-a226-0a1a83afc52f for instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 on nch1-master-1 Feb 12 21:13:40.927952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7ca0bd28-391a-4f2c-b4f4-32314943603e req-e3540306-4fd8-41b4-9a07-a2bc2cbad9f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036946 Feb 12 21:13:40.929301 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1471/3026] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:40.961502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be38201410d4e21ae786b2345428332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184a5eeefb1f41d2b34ac8b7b3dee122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:40.970763 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-af06a3b4-fe6b-4dc1-ab1f-9b36affd360b tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 200 len: 1465 microversion: 2.1 time: 0.132799 Feb 12 21:13:40.971436 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1556/3027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:40 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 1465 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:41.779043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:41.782909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:41.823930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:41.835013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:41.836159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:41.841582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:41.999684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:42.002524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] [instance: 576b4285-d489-4d23-8406-e71cbf2e0106] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:42.024088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:42.026250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:42.033476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:42.036875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:42.062311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] HTTP exception thrown: Instance 576b4285-d489-4d23-8406-e71cbf2e0106 could not be found. Feb 12 21:13:42.063411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] Returning 404 to user: Instance 576b4285-d489-4d23-8406-e71cbf2e0106 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:42.064491 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27d27dd6-c298-4aa6-9639-22e2857d9db6 tempest-ServerRescueTestJSONUnderV235-784750773 tempest-ServerRescueTestJSONUnderV235-784750773-project] 10.222.0.31 "GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106" status: 404 len: 111 microversion: 2.1 time: 0.079252 Feb 12 21:13:42.070051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1557/3028] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:41 2022] GET /compute/v2.1/servers/576b4285-d489-4d23-8406-e71cbf2e0106 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:42.090337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:42.098635 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2dcf904-bd2e-4fb9-8712-5d31e0e40204 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1491 microversion: 2.1 time: 0.325301 Feb 12 21:13:42.099474 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1472/3029] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:41 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1491 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:43.064216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-32db73be-bc1b-4faa-9c45-249dc0a40b65 req-5edbc81c-0c2d-4b6e-9d2a-5cf467398547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042df63a-9c4e-48d7-816b-872d5ec3a8b9", "name": "network-vif-deleted", "tag": "561753eb-dbf7-4e5f-a226-0a1a83afc52f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:43.066654 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:43.066654 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:43.077926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-32db73be-bc1b-4faa-9c45-249dc0a40b65 req-5edbc81c-0c2d-4b6e-9d2a-5cf467398547 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.078728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-32db73be-bc1b-4faa-9c45-249dc0a40b65 req-5edbc81c-0c2d-4b6e-9d2a-5cf467398547 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:43.092910 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-32db73be-bc1b-4faa-9c45-249dc0a40b65 req-5edbc81c-0c2d-4b6e-9d2a-5cf467398547 service nova] Creating event network-vif-deleted:561753eb-dbf7-4e5f-a226-0a1a83afc52f for instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 on nch1-master-1 Feb 12 21:13:43.099006 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-32db73be-bc1b-4faa-9c45-249dc0a40b65 req-5edbc81c-0c2d-4b6e-9d2a-5cf467398547 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039240 Feb 12 21:13:43.100805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1558/3030] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:13:43.119183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:43.120140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:43.128584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.129103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:43.130091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.130646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:43.232115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:43.241091 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dcf16e08-15d6-47ee-b71c-f78a9a37c635 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1449 microversion: 2.1 time: 0.126947 Feb 12 21:13:43.241955 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1473/3031] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:43 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1449 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:43.351820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:43.352536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:43.362443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.363235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:43.364221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.364831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:43.575724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:43.584326 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-67590bba-3c8a-4826-88e0-2f2fa2d76581 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1517 microversion: 2.1 time: 0.236659 Feb 12 21:13:43.585277 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1559/3032] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:43 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:43.602431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f467ea62-0ab8-4471-b457-237b5ad7e6a5"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:43.604785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:43.612669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.613520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:43.614539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:43.615176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:44.259919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:44.261204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:44.281601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:44.281601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:44.281601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:44.281601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:44.325135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:44.325969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:44.328946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lazy-loading 'fault' on Instance uuid 042df63a-9c4e-48d7-816b-872d5ec3a8b9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:44.408037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cec3ccfc53b48bfa8bc879989b720b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c778564eef403aa9d4a76e4c1d3c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:44.422547 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ccc9d3c-b37a-42e1-9758-a6d5d7b90666 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 200 len: 1297 microversion: 2.1 time: 0.166846 Feb 12 21:13:44.423182 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1560/3033] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:44 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 1297 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:44.668051 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e71c4ab2-a356-49d2-bd5a-229594784db3 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067322 Feb 12 21:13:44.676508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1474/3034] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:13:43 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments => generated 194 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:45.442882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.447462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 042df63a-9c4e-48d7-816b-872d5ec3a8b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:45.456702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.457172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.464500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.471802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.520332 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 could not be found. Feb 12 21:13:45.521165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance 042df63a-9c4e-48d7-816b-872d5ec3a8b9 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.522828 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-302d6ba1-cfc1-4b31-a18d-c098db272e55 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9" status: 404 len: 111 microversion: 2.1 time: 0.085156 Feb 12 21:13:45.523456 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1561/3035] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:45 2022] GET /compute/v2.1/servers/042df63a-9c4e-48d7-816b-872d5ec3a8b9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:45.533663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25a6de20-626b-4b65-880e-2a62bb3846ca tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa9042fd310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.592529 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-25a6de20-626b-4b65-880e-2a62bb3846ca tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Image not found. Feb 12 21:13:45.593146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25a6de20-626b-4b65-880e-2a62bb3846ca tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.594014 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25a6de20-626b-4b65-880e-2a62bb3846ca tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21" status: 404 len: 62 microversion: 2.1 time: 0.065496 Feb 12 21:13:45.594571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1475/3036] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:45 2022] DELETE /compute/v2.1/images/7fea4187-4715-455c-b7e8-1d9fce38fc21 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:13:45.602818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-338355444", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "653e1d6e-6f54-4396-aeff-a80b2721c6aa"}, {"uuid": "6b04633d-ab8f-4a77-bc77-00abc06d98c2"}, {"uuid": "653e1d6e-6f54-4396-aeff-a80b2721c6aa"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:45.635289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.636162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:45.650603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.651385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.665952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.667723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.695706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] validate_networks() for [('653e1d6e-6f54-4396-aeff-a80b2721c6aa', None, None, None, None, None), ('6b04633d-ab8f-4a77-bc77-00abc06d98c2', None, None, None, None, None), ('653e1d6e-6f54-4396-aeff-a80b2721c6aa', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:13:45.740118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance 79709269-3992-4499-9554-9f8e806a6b1e could not be found. Feb 12 21:13:45.741379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance 79709269-3992-4499-9554-9f8e806a6b1e could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.742471 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8247c9f1-b18f-4f80-95b9-c0a9f0cff37d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 404 len: 111 microversion: 2.1 time: 0.128163 Feb 12 21:13:45.751296 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1476/3037] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:45 2022] DELETE /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:45.761318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.767193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 79709269-3992-4499-9554-9f8e806a6b1e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:45.777552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.778336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.779381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.780024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.812278 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance 79709269-3992-4499-9554-9f8e806a6b1e could not be found. Feb 12 21:13:45.814061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance 79709269-3992-4499-9554-9f8e806a6b1e could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.820267 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-efa9ac92-72c3-47ec-a692-ec2c18f08fb7 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e" status: 404 len: 111 microversion: 2.1 time: 0.067611 Feb 12 21:13:45.821181 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1477/3038] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:45 2022] GET /compute/v2.1/servers/79709269-3992-4499-9554-9f8e806a6b1e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:45.835441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0661e5bc-b5fc-4648-a3a8-f474f1ba2878 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe651e50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.876144 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-0661e5bc-b5fc-4648-a3a8-f474f1ba2878 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Image not found. Feb 12 21:13:45.876768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0661e5bc-b5fc-4648-a3a8-f474f1ba2878 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.878812 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0661e5bc-b5fc-4648-a3a8-f474f1ba2878 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3" status: 404 len: 62 microversion: 2.1 time: 0.052628 Feb 12 21:13:45.879654 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1478/3039] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:45 2022] DELETE /compute/v2.1/images/917f012f-54e5-4f74-8338-9650b963a4f3 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:13:45.890288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.891551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:45.901451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.903373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.904461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.905146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.930816 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 could not be found. Feb 12 21:13:45.931831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.933296 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67c5501b-1bba-4b22-912f-b1ad2896d82b tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 404 len: 111 microversion: 2.1 time: 0.049612 Feb 12 21:13:45.938181 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1479/3040] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:45 2022] DELETE /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:45.944365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:45.945310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:45.953856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.963992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.963992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:45.963992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:45.983489 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 could not be found. Feb 12 21:13:45.984507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance 9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:45.986035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92683415-f1c6-40f8-a842-575021ff4ed9 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970" status: 404 len: 111 microversion: 2.1 time: 0.045791 Feb 12 21:13:45.990325 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1480/3041] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:45 2022] GET /compute/v2.1/servers/9045d14a-f3fd-4ac7-b7c3-80e22e9b0970 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:45.996394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-427b9c49-4664-400f-b6d6-8c9b6212e5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '.version_select at 0x7fa8fe651820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:46.032852 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-427b9c49-4664-400f-b6d6-8c9b6212e5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Image not found. Feb 12 21:13:46.033682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-427b9c49-4664-400f-b6d6-8c9b6212e5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:46.034549 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-427b9c49-4664-400f-b6d6-8c9b6212e5a0 tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5" status: 404 len: 62 microversion: 2.1 time: 0.043016 Feb 12 21:13:46.039354 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1481/3042] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:45 2022] DELETE /compute/v2.1/images/fb92c0da-80bf-4adb-83b3-10e7bfe219e5 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:13:46.051080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:46.053466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:46.079414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:46.093039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:46.095521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:46.097284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:46.150550 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 could not be found. Feb 12 21:13:46.150550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:46.152545 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d8582d63-ad80-48ad-914e-afa49ec3b75d tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 404 len: 111 microversion: 2.1 time: 0.107449 Feb 12 21:13:46.153174 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1482/3043] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:13:46 2022] DELETE /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:46.176602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:46.186157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] [instance: e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:46.195146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:46.195603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:46.199323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:46.199778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:46.230184 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] HTTP exception thrown: Instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 could not be found. Feb 12 21:13:46.230776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] Returning 404 to user: Instance e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:13:46.231618 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-37d33c28-0899-43f1-bd26-4bed251c15eb tempest-ImagesTestJSON-1334420645 tempest-ImagesTestJSON-1334420645-project] 10.222.0.31 "GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6" status: 404 len: 111 microversion: 2.1 time: 0.063019 Feb 12 21:13:46.232182 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1483/3044] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:46 2022] GET /compute/v2.1/servers/e7cd9d98-c6e4-447a-ac2b-c8736dbb98a6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:13:47.545290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:13:47.546078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:13:47.546834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:13:47.548050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:13:47.548846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:13:47.565997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:47.566525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:47.567554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:47.568212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:47.601102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Getting quotas for project b438902509da463ba94a98d99ffd1444. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:13:47.607709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Getting quotas for user 36f49587ae5a49a8bbb9f02e5b857eb9 and project b438902509da463ba94a98d99ffd1444. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:13:47.621412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:13:47.623809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:13:47.732441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-702dcfb2-cbeb-4362-bad7-e881269f84de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133530 Feb 12 21:13:47.733135 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1562/3045] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:13:47.745103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dcac4cac-08fc-4a65-941e-02e7c4a5a590 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:47.750178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dcac4cac-08fc-4a65-941e-02e7c4a5a590 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:47.824514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dcac4cac-08fc-4a65-941e-02e7c4a5a590 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:47.831832 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dcac4cac-08fc-4a65-941e-02e7c4a5a590 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1212 microversion: 2.1 time: 0.092335 Feb 12 21:13:47.841896 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1484/3046] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:47 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:48.849314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee9a3b19-01e9-4b68-80ff-66f1d9f4bb99 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:48.850596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee9a3b19-01e9-4b68-80ff-66f1d9f4bb99 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:48.924857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee9a3b19-01e9-4b68-80ff-66f1d9f4bb99 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:48.944828 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee9a3b19-01e9-4b68-80ff-66f1d9f4bb99 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1212 microversion: 2.1 time: 0.090474 Feb 12 21:13:48.944828 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1563/3047] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:48 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:49.952584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:49.953915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:49.961838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:49.962382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:49.963304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:49.964030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:50.031818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:50.042978 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-53d5ff51-527b-4d2a-95c1-57fa17678842 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1208 microversion: 2.1 time: 0.093862 Feb 12 21:13:50.043738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1485/3048] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:49 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1208 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:50.235853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:50.237591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:50.247718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:50.248634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:50.261550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:50.261550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:50.285757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'flavor' on Instance uuid c4a76f8f-ed14-4d6c-9296-e0e3113005c5 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:50.610442 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7bca816a-d342-44be-8a75-9c149ef09847 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 200 len: 32 microversion: 2.1 time: 0.379241 Feb 12 21:13:50.613294 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1564/3049] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:13:50 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:13:50.621520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:50.622251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:50.630905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:50.631428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:50.632482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:50.632965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:51.061311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:51.062051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:51.080767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:51.084495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:51.085850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:51.086799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:51.091978 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-abf0a724-66c9-4de1-9ade-c92a19ba290b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.474641 Feb 12 21:13:51.093223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1486/3050] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:50 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:51.095158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:51.129231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:51.129844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:51.139556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:51.140250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:51.141064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:51.141537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:51.174799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lazy-loading 'flavor' on Instance uuid 6bbfee9f-78df-472d-8f1a-f8e602fda68d {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:13:51.212357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:51.221210 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f64a9ec2-a7f2-45df-9dbe-397ae413bdb8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1270 microversion: 2.1 time: 0.163956 Feb 12 21:13:51.225554 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1565/3051] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:51 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:51.934690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1207443717", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "46e8ba15-abd6-4b1e-957e-9d3052ac4ccd"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:51.991611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] validate_networks() for [('46e8ba15-abd6-4b1e-957e-9d3052ac4ccd', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:13:52.044542 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-65e8b6ba-282c-453e-a2da-c6af1a095e4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/action" status: 202 len: 0 microversion: 2.20 time: 0.919330 Feb 12 21:13:52.045246 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1487/3052] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:13:51 2022] POST /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/action => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:13:52.056086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:52.059039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:52.064142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.064864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.065734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.066369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.361950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:52.374465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:52.376628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:52.378245 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96a28d57-5f7d-40e4-80cc-8d93c6dadc99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.327688 Feb 12 21:13:52.391780 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1488/3053] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:52 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:13:52.397239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:52.398180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:52.406475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.407349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.408387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.409107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.494920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:13:52.495345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:13:52.495826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:13:52.496240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:13:52.496835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:13:52.506500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.507438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.508474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.508916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.527888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:13:52.533676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for user 6fb5c74958944d26a2e0297f8a470631 and project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:13:52.546432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:13:52.548771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:13:52.655950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:52.663231 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f76be598-65db-4e5e-920a-4a338efe6ef3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900923 Feb 12 21:13:52.665548 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e80143bd-c13f-4df8-acbb-dca356b516b8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.271010 Feb 12 21:13:52.665661 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1566/3054] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:13:52.665738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1489/3055] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:52 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:52.681958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:52.683153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:52.691197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.691569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.692378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:52.692823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:52.741742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1584407000", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "282c3200-9059-438c-a022-c732f83ca0af"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:52.815737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] validate_networks() for [('282c3200-9059-438c-a022-c732f83ca0af', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:13:52.889973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:52.897470 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f684f49-6ca3-4269-9751-98b56d9b452a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1312 microversion: 2.1 time: 0.231795 Feb 12 21:13:52.898045 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1567/3056] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:52 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:52.904400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ec1c95c-96a3-4edf-a9fb-99c8dfaf6828 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:52.905205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7ec1c95c-96a3-4edf-a9fb-99c8dfaf6828 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:52.957869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ec1c95c-96a3-4edf-a9fb-99c8dfaf6828 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:52.966983 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ec1c95c-96a3-4edf-a9fb-99c8dfaf6828 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1225 microversion: 2.1 time: 0.067174 Feb 12 21:13:52.967573 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1568/3057] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:52 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1225 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:53.329369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:13:53.329834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:13:53.330317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:13:53.330731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:13:53.331151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:13:53.340743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.341581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.342418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.342862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.361091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:13:53.366428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for user daa98fa6e3104489af8bd77f8217a07f and project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:13:53.379854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:13:53.382339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:13:53.398958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:53.399657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:53.406580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.407091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.410796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.410796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.498278 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-786528aa-225d-4704-8178-443bbb1c61af tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832389 Feb 12 21:13:53.504540 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1490/3058] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:13:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:13:53.510804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ced5e1ed-d4ca-4246-9f73-b2eb17cd0527 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:53.511783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ced5e1ed-d4ca-4246-9f73-b2eb17cd0527 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:53.577056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ced5e1ed-d4ca-4246-9f73-b2eb17cd0527 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:53.586280 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ced5e1ed-d4ca-4246-9f73-b2eb17cd0527 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1218 microversion: 2.1 time: 0.080302 Feb 12 21:13:53.587167 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1491/3059] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:53 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:53.605939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:53.615553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:53.617612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:53.618262 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3eba2284-c493-4b78-a50e-5ed294ec1631 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.223572 Feb 12 21:13:53.631042 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1569/3060] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:53 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:13:53.687438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:53.688104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:53.694720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.695184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.696003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.696710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.914419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:53.915040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:53.922295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.922751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:53.923556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:53.924005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:54.087007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.098763 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-23b6a76e-fbb5-4233-8a1d-3f0aa2a4658f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1333 microversion: 2.1 time: 0.187911 Feb 12 21:13:54.099740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1570/3061] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:53 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:54.104825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:54.105877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:54.112452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:54.116633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:54.116633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:54.116633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:54.183591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.192862 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b56f3165-7dc4-43eb-b5d7-637f57c88b92 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1229 microversion: 2.1 time: 0.091882 Feb 12 21:13:54.193492 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1571/3062] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:54 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:54.239170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.249800 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-da297dac-c40b-4b42-9d12-9afba6a2d723 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.567744 Feb 12 21:13:54.256936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1492/3063] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:53 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:54.604204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8df4b9d6-8512-4c35-a00c-3189c8eba95b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:54.604913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8df4b9d6-8512-4c35-a00c-3189c8eba95b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:54.639002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:54.639782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:54.646854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:54.647308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:54.648326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:54.648771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:54.664465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8df4b9d6-8512-4c35-a00c-3189c8eba95b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.671167 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8df4b9d6-8512-4c35-a00c-3189c8eba95b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1218 microversion: 2.1 time: 0.070925 Feb 12 21:13:54.671744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1572/3064] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:54 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:54.935161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.943211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.945059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:54.946261 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7bfd0f2-8dc6-4857-8085-747df2db51db tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.312138 Feb 12 21:13:54.946833 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1493/3065] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:54 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:13:55.116044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:55.116651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:55.125859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.126314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.127094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.127530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.211733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:55.212484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:55.220550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.221020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.221931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.222368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.295143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:55.303337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f738987-34da-4ad9-883a-6d099dd415e2 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.190908 Feb 12 21:13:55.304769 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1573/3066] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:55 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:55.310350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:55.310968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:55.329850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.331138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.332016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:55.332584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.333318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.344404 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6a455ab7-a789-4287-a911-78f0c218a896 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1277 microversion: 2.1 time: 0.136680 Feb 12 21:13:55.363968 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1494/3067] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:55 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:55.658836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:55.679432 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2bea26a-6341-4f27-bf64-c88697190772 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.373555 Feb 12 21:13:55.679661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ac352bbb-8218-46f4-800a-6056e71c4462 req-60068858-40f7-4a44-b837-08bb179ad0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "tag": "a9c88055-d6de-4f8c-900a-bbcede04a18d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:55.680765 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1574/3068] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:55 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:55.691297 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:55.691297 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:13:55.692934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:55.694667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:55.717652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ac352bbb-8218-46f4-800a-6056e71c4462 req-60068858-40f7-4a44-b837-08bb179ad0d6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.719500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ac352bbb-8218-46f4-800a-6056e71c4462 req-60068858-40f7-4a44-b837-08bb179ad0d6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.733775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ac352bbb-8218-46f4-800a-6056e71c4462 req-60068858-40f7-4a44-b837-08bb179ad0d6 service nova] Creating event network-changed:a9c88055-d6de-4f8c-900a-bbcede04a18d for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:13:55.736496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.738556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.739551 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ac352bbb-8218-46f4-800a-6056e71c4462 req-60068858-40f7-4a44-b837-08bb179ad0d6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065079 Feb 12 21:13:55.740845 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1495/3069] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:55.744030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.745469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.856812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:55.865926 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce66a452-d7f6-4242-b073-fd41bdcf7801 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1270 microversion: 2.1 time: 0.180531 Feb 12 21:13:55.871064 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1575/3070] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:55 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:55.966714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:55.967713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:55.974683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.975227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:55.976292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:55.976980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.237529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.253773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.258329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.262865 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d95584bb-a065-4924-823f-33fc2c4828fa tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.298445 Feb 12 21:13:56.262865 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1496/3071] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:55 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:13:56.321216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:56.321956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:56.328208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.328783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.329802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.330451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.362359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:56.363225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:56.370859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.371197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.372216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.372755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.514299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.525171 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-49704498-3b03-4812-95f5-93721bd4cd72 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1283 microversion: 2.1 time: 0.166385 Feb 12 21:13:56.530040 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1497/3072] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:56 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:56.530218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.540746 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-35d0b66c-a445-4298-b914-9e1f44e27c71 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.223195 Feb 12 21:13:56.547002 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1576/3073] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:56 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:56.706053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:56.707375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:56.717514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.717514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.717514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.717514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.886840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:56.887458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:56.893814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.894209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.895011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:56.895456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:56.956927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.968537 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d3a15f1b-a046-4d3a-bfc5-fc110a69e2cc tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.274955 Feb 12 21:13:56.969660 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1498/3074] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:56 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:56.971987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:56.984281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-45b3f14d-2d84-4419-aa39-a9f9a109b966 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1276 microversion: 2.1 time: 0.103950 Feb 12 21:13:56.997509 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1577/3075] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:56 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:57.279004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:57.279732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:57.286834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.287607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.288320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.288728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.544968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:57.545874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:57.553388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.554074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.555897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.557914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.665948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:57.676330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:57.678295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:57.679598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-47f8dfba-2c5d-4020-b933-0342ab516208 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.404694 Feb 12 21:13:57.680183 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1499/3076] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:57 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:13:57.696880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:57.697507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:57.706064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.706663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.707305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.707743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.756907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:57.768157 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-86f8941b-8a6a-4440-ad4a-889d7d602046 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.228158 Feb 12 21:13:57.768956 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1578/3077] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:57 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:57.774789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9b7e514b-db8e-4b60-a1a3-fd382e2f6102 req-f4cee6ab-b61a-40c1-ac38-3c3b5263befc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f33ecd6-e622-4f55-8516-0e0f250d53cd", "tag": "b3a5194c-7a2e-4123-85fd-17e70f26a53d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:57.777432 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:57.777432 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:57.785134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9b7e514b-db8e-4b60-a1a3-fd382e2f6102 req-f4cee6ab-b61a-40c1-ac38-3c3b5263befc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.785718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9b7e514b-db8e-4b60-a1a3-fd382e2f6102 req-f4cee6ab-b61a-40c1-ac38-3c3b5263befc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.799197 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9b7e514b-db8e-4b60-a1a3-fd382e2f6102 req-f4cee6ab-b61a-40c1-ac38-3c3b5263befc service nova] Creating event network-changed:b3a5194c-7a2e-4123-85fd-17e70f26a53d for instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd on nch1-master-1 Feb 12 21:13:57.804104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9b7e514b-db8e-4b60-a1a3-fd382e2f6102 req-f4cee6ab-b61a-40c1-ac38-3c3b5263befc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Feb 12 21:13:57.813553 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1579/3078] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:57.813553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0cd9f3d7-60b9-4952-82ee-5a2761be7ef3 req-bee14b3c-996e-49bc-a1c5-866c3a8c13ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "tag": "dc515e30-79ce-4fa8-9c6e-77b2203602e2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:13:57.813553 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:13:57.813553 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:13:57.820263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0cd9f3d7-60b9-4952-82ee-5a2761be7ef3 req-bee14b3c-996e-49bc-a1c5-866c3a8c13ef service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.821037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0cd9f3d7-60b9-4952-82ee-5a2761be7ef3 req-bee14b3c-996e-49bc-a1c5-866c3a8c13ef service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.833423 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0cd9f3d7-60b9-4952-82ee-5a2761be7ef3 req-bee14b3c-996e-49bc-a1c5-866c3a8c13ef service nova] Creating event network-changed:dc515e30-79ce-4fa8-9c6e-77b2203602e2 for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:13:57.839576 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0cd9f3d7-60b9-4952-82ee-5a2761be7ef3 req-bee14b3c-996e-49bc-a1c5-866c3a8c13ef service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Feb 12 21:13:57.841925 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1580/3079] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:13:57.987204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:57.987919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:57.995864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.996563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:57.997651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:57.998098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.070859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:58.092597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-353c8a92-cca1-4751-8428-69e1931b0294 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.410990 Feb 12 21:13:58.096970 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1500/3080] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:57 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:58.108079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:58.112790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:58.130672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:58.131440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.132912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:58.133540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.421958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:58.430620 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b853ae76-3321-47d2-b570-c3616079eee8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.448306 Feb 12 21:13:58.431364 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1581/3081] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:57 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:58.499340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:58.509401 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4498cfe9-8b77-4bf0-a533-9eb0fdc0c192 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.410844 Feb 12 21:13:58.510600 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1501/3082] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:58 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:58.698953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:58.708390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:58.715846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:58.716307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.717113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:58.717594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.785476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:58.786847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:58.799616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:58.800341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.801402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:58.802003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:58.980783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:58.989256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:58.990790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:58.992031 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c9d216ab-65ec-4d70-a9d2-14c793066476 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.297305 Feb 12 21:13:58.992590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1582/3083] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:13:58 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:13:59.111934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:59.112575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:59.118547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:59.119007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:59.119918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:59.120428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:59.152553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:59.160854 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9797385b-e517-4427-bcd2-95c7aea31788 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.378701 Feb 12 21:13:59.161703 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1502/3084] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:58 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:59.277510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:59.285667 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eaffd169-b2ec-4252-abf5-961e175dbd4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.177309 Feb 12 21:13:59.286174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1583/3085] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:59 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:13:59.448202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:59.448998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:59.456093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:59.456620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:59.457525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:59.458023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:59.528614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:13:59.529859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:13:59.536462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:59.536889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:59.537740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:13:59.538181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:13:59.687612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:59.695540 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ad50b4d-f20f-4ca1-ac1c-d73028ae1c69 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.172367 Feb 12 21:13:59.696319 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1584/3086] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:59 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:13:59.761855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:13:59.770252 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c59f2548-3104-4962-9388-35eaf5435807 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.325951 Feb 12 21:13:59.770953 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1503/3087] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:13:59 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:00.011971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:00.013228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:00.020426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.020967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.021761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.022349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.142614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-029c934b-e201-4270-bb63-972c1d7f0302 req-8b589d09-a66a-4124-ba1c-83d4ceaeba62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "tag": "cd382a11-c4eb-464b-be5f-5be4d5b113a3"}, {"name": "network-changed", "server_uuid": "8ca29232-9b41-4183-b84b-ce26da0aea7b", "tag": "535bef55-124d-44f2-9478-80c0a813b588"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:00.144304 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:00.144304 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:00.152239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-029c934b-e201-4270-bb63-972c1d7f0302 req-8b589d09-a66a-4124-ba1c-83d4ceaeba62 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.152679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-029c934b-e201-4270-bb63-972c1d7f0302 req-8b589d09-a66a-4124-ba1c-83d4ceaeba62 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.165183 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-029c934b-e201-4270-bb63-972c1d7f0302 req-8b589d09-a66a-4124-ba1c-83d4ceaeba62 service nova] Creating event network-changed:cd382a11-c4eb-464b-be5f-5be4d5b113a3 for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:00.165725 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-029c934b-e201-4270-bb63-972c1d7f0302 req-8b589d09-a66a-4124-ba1c-83d4ceaeba62 service nova] Creating event network-changed:535bef55-124d-44f2-9478-80c0a813b588 for instance 8ca29232-9b41-4183-b84b-ce26da0aea7b on nch1-master-1 Feb 12 21:14:00.171187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:00.176122 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-029c934b-e201-4270-bb63-972c1d7f0302 req-8b589d09-a66a-4124-ba1c-83d4ceaeba62 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037101 Feb 12 21:14:00.176920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1504/3088] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:00.179194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:00.181307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:00.183062 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b678f2aa-5f57-4aa2-9e04-3ca71be2a94b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.175495 Feb 12 21:14:00.183365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:00.183882 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1585/3089] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:00 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:00.184303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:00.190599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.191049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.191837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.192272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.302310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:00.302928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:00.310059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.310589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.311390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.311855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.463479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:00.471316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e74960f4-572c-430b-a96b-6c75342e549b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.172678 Feb 12 21:14:00.471909 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1586/3090] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:00 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:00.565013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:00.573409 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-472fe623-0b5f-4aea-961c-c51c87066ab4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.394478 Feb 12 21:14:00.574323 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1505/3091] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:00 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:00.711982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:00.712930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:00.719178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.719639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.720430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.720904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.788067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:00.788921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:00.797466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.798178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.799174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:00.799942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:00.874879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:00.882251 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb3da622-ee8a-4399-8e50-e0d97f011b11 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.173987 Feb 12 21:14:00.882826 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1587/3092] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:00 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:01.129023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:01.137969 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-deac9dfb-710d-426f-b427-73a8d9e04a54 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.353764 Feb 12 21:14:01.138561 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1506/3093] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:00 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:01.201642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:01.202331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:01.209133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.209614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.210409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.210851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.356438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:01.364996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:01.366532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:01.367696 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93075915-1498-475b-9104-e4560dbfa2f7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.170665 Feb 12 21:14:01.368256 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1588/3094] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:01 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:01.488132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:01.489502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:01.498114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.498747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.500160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.500657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.590681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:01.591308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:01.597366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.597847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.598647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.599089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.747325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:01.756272 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-74fabff3-c4a6-480b-b012-1d838506449c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.169666 Feb 12 21:14:01.756900 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1589/3095] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:01 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:01.768851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:01.776639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0af85742-e740-4070-9f72-1970b06377a1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.292423 Feb 12 21:14:01.777222 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1507/3096] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:01 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:01.899608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:01.900418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:01.906632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.907079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:01.907911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:01.908350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.050240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.058492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-af34586a-e5c5-4066-a5af-e69d1a205cb2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.162545 Feb 12 21:14:02.059061 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1590/3097] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:01 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:02.155412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:02.155953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:02.162064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.162519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.163326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.163760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.300703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.309415 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3e3f547-c418-4f3e-91b9-f09138ca69ea tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.157957 Feb 12 21:14:02.310000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1508/3098] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:02 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:02.387187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:02.387808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:02.394839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.395300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.396333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.396596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.531820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.539801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.541947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.543321 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c45e013c-81ba-4368-9bca-734508f78b43 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.160357 Feb 12 21:14:02.546984 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1591/3099] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:02 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:02.774281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:02.775042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:02.782495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.782955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.783785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.784221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.794888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:02.795664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:02.801850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.802802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.803275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:02.803821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:02.932331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.941280 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e8e1ac3-9b26-43e6-b99b-baed1bfa404e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.170646 Feb 12 21:14:02.942089 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1509/3100] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:02 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:02.970299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:02.978230 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72169a64-5e81-4484-88d7-836e98c14484 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.187634 Feb 12 21:14:02.979358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1592/3101] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:02 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:03.075218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:03.075766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:03.081885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.082341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.083130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.083576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.218976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:03.226379 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb814de8-8bdb-46c7-8464-19dbb1912893 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.155088 Feb 12 21:14:03.226945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1510/3102] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:03 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:03.326674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:03.327203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:03.333228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.333712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.334514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.334950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.473538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:03.482349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2d4c073f-e5ac-43a9-92d2-ae7cc3db14c5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.159477 Feb 12 21:14:03.483028 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1593/3103] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:03 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:03.562433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:03.563077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:03.569159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.569649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.570437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.570875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.703730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:03.711783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:03.713307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:03.714497 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cae49abf-bd86-4b10-99c3-e9f66fb46a30 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.155938 Feb 12 21:14:03.715115 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1511/3104] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:03 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:03.959102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:03.959631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:03.966640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.967085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.971798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:03.971798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:03.995837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:03.996617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:04.003940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.004392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.005182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.005650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.110425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.118039 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-669e271c-9a6d-4a97-9cac-bc80423596b5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.162715 Feb 12 21:14:04.118616 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1594/3105] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:03 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:04.162562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.170604 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36925a51-b4fd-432b-9aa2-0c4c205c5c4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.178546 Feb 12 21:14:04.171191 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1512/3106] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:03 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:04.243704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:04.244259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:04.250337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.250790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.251911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.252331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.386071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.394812 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-383e067b-9b9f-47ed-a3d6-f6ab203a4439 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.154945 Feb 12 21:14:04.395516 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1595/3107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:04 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:04.499125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:04.499664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:04.506010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.506454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.507241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.507678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.651270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.654947 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08bbda34-783c-4b43-b0b3-28063abdee90 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.159858 Feb 12 21:14:04.655530 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1513/3108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:04 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:04.732593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:04.733239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:04.739756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.740213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.743609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:04.743609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:04.886159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.894111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.895669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:04.896833 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16c637a3-cded-4ec4-8caf-a36effb54dfc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.168320 Feb 12 21:14:04.897429 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1596/3109] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:04 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:05.135688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:05.136304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:05.143500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.143952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.144914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.145383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.187123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:05.187733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:05.194002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.194469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.195382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.195828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.294629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:05.302032 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-198046af-1370-421a-915f-41289e747dcd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.170670 Feb 12 21:14:05.302615 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1514/3110] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:05 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:05.364214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:05.372214 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-489a9b57-66bf-4789-b2e5-50b668d51db5 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.188843 Feb 12 21:14:05.372934 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1597/3111] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:05 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:05.411983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:05.412608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:05.418918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.419379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.420180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.420633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.562864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:05.570383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1e4ee4aa-52d6-4e20-86f2-f7ce0ac6f1b2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.162264 Feb 12 21:14:05.570958 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1515/3112] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:05 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:05.672040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:05.672768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:05.679662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.680193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.680988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.681449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.824335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:05.832696 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-363f59a6-cae1-4ca8-8a60-b73e2b98d91e tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.164462 Feb 12 21:14:05.833612 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1598/3113] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:05 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:05.917263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:05.917912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:05.923876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.924321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:05.925104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:05.925586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.086816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:06.099471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:06.101096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:06.102375 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-592b9ab7-c02b-46ad-b35c-eeafada24a8b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.189864 Feb 12 21:14:06.102942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1516/3114] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:05 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:06.318960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:06.319954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:06.326326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.326777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.327554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.327985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.389252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:06.389911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:06.397126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.397613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.398416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.398858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.494284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:06.502135 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab50dd4b-fd06-421e-87f4-3d83a666fde7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.187194 Feb 12 21:14:06.502792 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1599/3115] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:06 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:06.582894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:06.589142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:06.589776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:06.596716 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe6c6d93-696a-4cb2-ac54-9f92559cb3f0 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.211751 Feb 12 21:14:06.597292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.597582 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1517/3116] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:06 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:06.597850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.598665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.599115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.757322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:06.766361 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-857aa75b-8b6d-4790-bb05-81957386397b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.181525 Feb 12 21:14:06.776308 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1600/3117] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:06 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:06.795370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-400660b5-27a5-46f8-9ca1-8a054e8711a9 req-91ff6efa-f1d4-4850-a1d4-f9a94b9968cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "name": "network-vif-plugged", "status": "completed", "tag": "cd382a11-c4eb-464b-be5f-5be4d5b113a3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:06.797495 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:06.797495 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:06.804531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-400660b5-27a5-46f8-9ca1-8a054e8711a9 req-91ff6efa-f1d4-4850-a1d4-f9a94b9968cd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.804977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-400660b5-27a5-46f8-9ca1-8a054e8711a9 req-91ff6efa-f1d4-4850-a1d4-f9a94b9968cd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.816907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-400660b5-27a5-46f8-9ca1-8a054e8711a9 req-91ff6efa-f1d4-4850-a1d4-f9a94b9968cd service nova] Creating event network-vif-plugged:cd382a11-c4eb-464b-be5f-5be4d5b113a3 for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:06.821937 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-400660b5-27a5-46f8-9ca1-8a054e8711a9 req-91ff6efa-f1d4-4850-a1d4-f9a94b9968cd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030906 Feb 12 21:14:06.822730 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1518/3118] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:06.860277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:06.860987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:06.867316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.867930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:06.868766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:06.869911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.024683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.033710 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-179a0e1a-968d-4640-a4ea-05b101a11f61 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.177197 Feb 12 21:14:07.034304 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1601/3119] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:06 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:07.121591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:07.122294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:07.129159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.129653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.130458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.130905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.284366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.293058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.294606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.295775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f73cffac-1098-4bd0-beba-dfed9f4cb9a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.178700 Feb 12 21:14:07.296353 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1519/3120] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:07 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:07.519569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:07.520224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:07.527120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.527578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.528362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.528803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.615160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:07.615773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:07.622841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.623295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.624209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.624648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.671931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.680188 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ccd38a3b-ec65-405f-a2e0-21df3bba3d79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.164343 Feb 12 21:14:07.680799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1602/3121] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:07 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:07.780287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.783499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:07.784223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:07.788183 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-419c7961-3e70-4eab-a9db-a5e901488585 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.176745 Feb 12 21:14:07.788958 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1520/3122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:07 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:07.790392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.790924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.792014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:07.792455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:07.926072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:07.935231 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9267b403-9a4d-4d19-b00d-b3b843cef0ba tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.155678 Feb 12 21:14:07.936160 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1603/3123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:07 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:08.051850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:08.052395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:08.059373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.059868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.060727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.061174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.196776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:08.205006 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-513fb195-aa56-4a5b-a164-e45d6a37f58c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.157319 Feb 12 21:14:08.205626 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1521/3124] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:08 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:08.314088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:08.314616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:08.320625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.321125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.321928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.322363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.460030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:08.468844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:08.470391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:08.471585 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e1ade17b-83b3-4fe6-8e45-07a129b8a47c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.161283 Feb 12 21:14:08.472156 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1604/3125] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:08 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:08.697108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:08.698402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:08.704972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.705458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.706250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.706792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.804220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:08.804845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:08.811852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.812299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.813092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.813556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.852894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:08.860520 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5b690f02-1482-4f4b-9c5b-7747df9ba193 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.167135 Feb 12 21:14:08.861449 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1522/3126] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:08 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:08.866011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f33ecd6-e622-4f55-8516-0e0f250d53cd", "name": "network-vif-plugged", "status": "completed", "tag": "b3a5194c-7a2e-4123-85fd-17e70f26a53d"}, {"server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "name": "network-vif-plugged", "status": "completed", "tag": "dc515e30-79ce-4fa8-9c6e-77b2203602e2"}, {"server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "name": "network-vif-plugged", "status": "completed", "tag": "a9c88055-d6de-4f8c-900a-bbcede04a18d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:08.868840 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:08.868840 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:08.875622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.876074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.890248 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] Creating event network-vif-plugged:b3a5194c-7a2e-4123-85fd-17e70f26a53d for instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd on nch1-master-1 Feb 12 21:14:08.890885 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] Creating event network-vif-plugged:dc515e30-79ce-4fa8-9c6e-77b2203602e2 for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:08.891411 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] Creating event network-vif-plugged:a9c88055-d6de-4f8c-900a-bbcede04a18d for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:08.900937 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c075f133-d62f-472a-bc46-375032b1a29c req-d11df84b-d57c-4db5-91bc-f1c5fc7fc536 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037734 Feb 12 21:14:08.901851 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1523/3127] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:08.954719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:08.955915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:08.967481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.970654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:08.970654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:08.970654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:09.013782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:09.022762 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e7656b3-04fe-46f8-ba20-5102523af110 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.221920 Feb 12 21:14:09.025850 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1605/3128] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:08 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:09.222068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:09.222691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:09.229877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:09.230340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:09.231172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:09.231706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:09.237780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:09.245827 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc240377-f832-4f82-a659-7697132795b7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.296751 Feb 12 21:14:09.246404 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1524/3129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:08 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:09.368146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:09.376861 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb78d107-3be2-4bf2-9511-af8f655ef143 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.158507 Feb 12 21:14:09.377464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1606/3130] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:09 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:09.490064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:09.490611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:09.497309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:09.497801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:09.498607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:09.499046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:09.634610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:09.642875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:09.644380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:09.645567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f937e49-0ad5-44ac-bbb4-e43514882477 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.159262 Feb 12 21:14:09.646125 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1525/3131] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:09 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:09.877896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:09.878511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:09.885770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:09.886227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:09.887017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:09.887497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.025006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.033113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be2efb20-616e-4d98-a073-8851b1fac4a6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1325 microversion: 2.1 time: 0.159029 Feb 12 21:14:10.033767 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1607/3132] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:09 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:10.042455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:10.043121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:10.050241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.050695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.051489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.051995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.203518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.211127 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21456bbc-da4a-4ddd-bc3c-e019df012a56 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1354 microversion: 2.1 time: 0.173493 Feb 12 21:14:10.211748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1526/3133] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:10 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:10.262523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:10.263147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:10.270461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.270915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.272398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.272398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.394259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:10.395174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:10.401964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.402647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.404554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.405013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.414043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.423034 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-972531a7-f36a-4210-9bc2-e80a49aa5b8f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.164589 Feb 12 21:14:10.423632 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1608/3134] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:10 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:10.545786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.554350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7092b15-7c7d-4f5f-ad0f-fad82f55cae8 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.164045 Feb 12 21:14:10.554933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1527/3135] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:10 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:10.663406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:10.664119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:10.671033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.671561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.672360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.672793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.812768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.820956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.823090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:10.824238 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44136c9e-4197-4199-82e8-ed76fec80aa7 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.164795 Feb 12 21:14:10.824811 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1609/3136] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:10 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:10.917498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-26ca6e7d-4446-49a5-9efb-a12c4d369405 req-a3f22ba8-61de-4d9f-bce4-07e83c62e0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca29232-9b41-4183-b84b-ce26da0aea7b", "name": "network-vif-plugged", "status": "completed", "tag": "535bef55-124d-44f2-9478-80c0a813b588"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:10.919021 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:10.919021 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:10.926060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-26ca6e7d-4446-49a5-9efb-a12c4d369405 req-a3f22ba8-61de-4d9f-bce4-07e83c62e0ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:10.926500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-26ca6e7d-4446-49a5-9efb-a12c4d369405 req-a3f22ba8-61de-4d9f-bce4-07e83c62e0ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:10.938451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-26ca6e7d-4446-49a5-9efb-a12c4d369405 req-a3f22ba8-61de-4d9f-bce4-07e83c62e0ae service nova] Creating event network-vif-plugged:535bef55-124d-44f2-9478-80c0a813b588 for instance 8ca29232-9b41-4183-b84b-ce26da0aea7b on nch1-master-1 Feb 12 21:14:10.943228 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-26ca6e7d-4446-49a5-9efb-a12c4d369405 req-a3f22ba8-61de-4d9f-bce4-07e83c62e0ae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029809 Feb 12 21:14:10.943877 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1528/3137] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:11.050664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.051289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.058775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.059226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.060016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.060454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.198291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.205742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c078b555-126f-43c4-b35c-02d75a15f658 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.158776 Feb 12 21:14:11.206312 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1610/3138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:11.223891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.224606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.227377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.228159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.231627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.232070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.232881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.233325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.234362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.234818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.235594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.236036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.376309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.385407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4aa1077a-2066-4327-8456-0d8841e54ae4 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.165368 Feb 12 21:14:11.385987 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1529/3139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:11.399989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.402844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2b1256ed-79fc-4f99-9570-f3c819cc6f79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1544580262", "metadata": {"": ""}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:11.404267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2b1256ed-79fc-4f99-9570-f3c819cc6f79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:11.405078 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2b1256ed-79fc-4f99-9570-f3c819cc6f79 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action" status: 400 len: 170 microversion: 2.1 time: 0.006867 Feb 12 21:14:11.405745 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1530/3140] 10.222.0.31 () {60 vars in 1278 bytes} [Sat Feb 12 21:14:11 2022] POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action => generated 170 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:14:11.408698 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7cd433b-7971-4051-8823-2e38e2ed7b5b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1805 microversion: 2.1 time: 0.184815 Feb 12 21:14:11.409459 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1611/3141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:11.415234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.415883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.423139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.423595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.424388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.424605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.424829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.425097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.431313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.431962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.432754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.433195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.460020 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcee6196-d5d3-4f6a-be82-3c31e457dfbe tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a/ips" status: 200 len: 219 microversion: 2.1 time: 0.038343 Feb 12 21:14:11.460565 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1612/3142] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a/ips => generated 219 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:11.465567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.466201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.472225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.472680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.473502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.473945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.564277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.573289 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c60ed41f-ea18-4be8-84fd-e6e0481d6105 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.160855 Feb 12 21:14:11.574116 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1531/3143] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:11.578630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.579206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.590181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.590644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.591560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.592069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.615790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.620559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:11.624135 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d83b09b9-25c0-40b3-b718-f9fad63200b6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1318 microversion: 2.1 time: 0.162685 Feb 12 21:14:11.624851 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1613/3144] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:11.633778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.634376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.641440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.641896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.642720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.643158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.784631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.793020 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c283a3cf-5615-48a2-ae48-3563738b0e2a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.162667 Feb 12 21:14:11.793631 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1614/3145] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:11.797858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.798451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.808891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.809344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.810145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.810581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.951427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:11.959229 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-94b01567-8c3b-42a9-ac32-cba431e97440 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.164628 Feb 12 21:14:11.959817 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1615/3146] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:11.964493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.965101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.971098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.971534 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-75cbda05-7e54-4c62-b7fd-a417c1aff5de tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "DELETE /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 204 len: 0 microversion: 2.1 time: 0.395707 Feb 12 21:14:11.975653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.975810 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1532/3147] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:11 2022] DELETE /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:11.975894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.975894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.977333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7577699-7e04-4a35-8521-4ce8f7ceef0b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1817533764", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:11.979513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7577699-7e04-4a35-8521-4ce8f7ceef0b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:11.980454 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7577699-7e04-4a35-8521-4ce8f7ceef0b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action" status: 400 len: 938 microversion: 2.1 time: 0.007252 Feb 12 21:14:11.981005 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1533/3148] 10.222.0.31 () {60 vars in 1278 bytes} [Sat Feb 12 21:14:11 2022] POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action => generated 938 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:14:11.985564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:11.986281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:11.997642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.998095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:11.998889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:11.999332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.111543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.120175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.121759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.122911 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70ddc810-bd19-4299-820d-d8e62deb84a3 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.162186 Feb 12 21:14:12.123472 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1616/3149] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:12.127944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:12.128547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:12.135292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.135662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.136628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.137047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.158202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.165656 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9261dbda-af7b-441b-9774-3fd78cce7305 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1811 microversion: 2.1 time: 0.183540 Feb 12 21:14:12.166471 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1534/3150] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:11 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:12.584686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.592383 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-815db006-4ace-4abd-b89e-08c1701f7998 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.467950 Feb 12 21:14:12.592965 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1617/3151] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:12 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:12.609910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:12.610548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:12.617846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.618296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.620183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.620627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.640176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:12.640891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:12.647104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.647786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.648578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.649019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.760931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.768566 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b577a1f3-9a59-4859-9c3a-8324388c260e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.162371 Feb 12 21:14:12.769145 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1535/3152] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:12 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:12.784838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ebafe62-bca8-4bcb-9227-76e69f071b48 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:12.786086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ebafe62-bca8-4bcb-9227-76e69f071b48 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:12.786892 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ebafe62-bca8-4bcb-9227-76e69f071b48 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action" status: 400 len: 619 microversion: 2.1 time: 0.005854 Feb 12 21:14:12.787430 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1536/3153] 10.222.0.31 () {60 vars in 1278 bytes} [Sat Feb 12 21:14:12 2022] POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:14:12.792507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.795713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:12.796334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:12.800275 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-197f7b18-7eb5-4203-b8b5-ad36c3406eb1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1509 microversion: 2.1 time: 0.163713 Feb 12 21:14:12.800849 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1618/3154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:12 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:12.803153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.803613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.812218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.812218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.812425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:12.812425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:12.817812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.818641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.819222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:12.819661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:12.979325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:12.987242 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2cf11a71-8052-4490-886d-d04b52c0c804 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.194923 Feb 12 21:14:12.988036 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1537/3155] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:12 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:12.998322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:13.003922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:13.004534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:13.007811 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1df11682-5133-4e30-bb51-c233aaf43223 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.201318 Feb 12 21:14:13.008618 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1619/3156] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:12 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:13.010971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.011423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.012212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.012650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.141578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:13.142224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:13.148763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.149254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.150584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.151047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.152798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:13.160472 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b096b6fe-e4e1-4719-a015-08ffc4c279e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.159976 Feb 12 21:14:13.161048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1538/3157] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:12 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:13.177204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1472914656"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:13.178278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:13.185062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.185560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.186360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.186798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.296191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:13.304222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:13.306031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:13.307823 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5cc4ce5-54ae-4cf8-b097-ba6c75bf6d93 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1743 microversion: 2.20 time: 0.170171 Feb 12 21:14:13.308468 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1620/3158] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:13 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:13.312864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:13.313583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:13.319784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.320326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.324278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.324278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.483282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:13.491110 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d419d22-f98e-4b7f-af4d-d909c0a44ea9 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1811 microversion: 2.1 time: 0.181607 Feb 12 21:14:13.491688 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1621/3159] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:13 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:13.755253 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe678d24-6650-42a2-a34a-aee908165a64 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action" status: 202 len: 0 microversion: 2.1 time: 0.581624 Feb 12 21:14:13.755950 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1539/3160] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:13 2022] POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Feb 12 21:14:13.766197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1851885498"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:13.767752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:13.773920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.777508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.777508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:13.777508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:13.810918 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Cannot 'createImage' instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd while it is in task_state image_snapshot_pending Feb 12 21:14:13.811794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 409 to user: Cannot 'createImage' instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd while it is in task_state image_snapshot_pending {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:13.812656 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-68d7399e-c6d7-47ae-aa56-a37e601ca7cd tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action" status: 409 len: 167 microversion: 2.1 time: 0.050064 Feb 12 21:14:13.813234 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1622/3161] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:13 2022] POST /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd/action => generated 167 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:14:13.822403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4351b41-62dc-4255-8e3f-c31f4f089ef1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '.version_select at 0x7fa8fe44c550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:14.027196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:14.027804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:14.037331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.038085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.038621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.039114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.079397 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4351b41-62dc-4255-8e3f-c31f4f089ef1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/images/dcfdc13d-16b6-4ac8-8f41-033918d8dc8e" status: 204 len: 0 microversion: 2.1 time: 0.260567 Feb 12 21:14:14.081924 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1540/3162] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:13 2022] DELETE /compute/v2.1/images/dcfdc13d-16b6-4ac8-8f41-033918d8dc8e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:14.093530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:14.099461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:14.146793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.146793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.146793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.146793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.267571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:14.279892 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ffe4f18-829d-461e-9608-0e51536a4148 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.257525 Feb 12 21:14:14.289864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1623/3163] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:14 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:14.296231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0a821f3e-7888-4dc9-b29d-24a33ba5128b req-a97899ac-cc02-4d45-acfd-a871bd760759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "name": "network-vif-deleted", "tag": "dc515e30-79ce-4fa8-9c6e-77b2203602e2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:14.298099 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:14.298099 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:14.307854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0a821f3e-7888-4dc9-b29d-24a33ba5128b req-a97899ac-cc02-4d45-acfd-a871bd760759 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.308783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0a821f3e-7888-4dc9-b29d-24a33ba5128b req-a97899ac-cc02-4d45-acfd-a871bd760759 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.327740 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0a821f3e-7888-4dc9-b29d-24a33ba5128b req-a97899ac-cc02-4d45-acfd-a871bd760759 service nova] Creating event network-vif-deleted:dc515e30-79ce-4fa8-9c6e-77b2203602e2 for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:14.336242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0a821f3e-7888-4dc9-b29d-24a33ba5128b req-a97899ac-cc02-4d45-acfd-a871bd760759 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053413 Feb 12 21:14:14.337210 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1624/3164] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:14.346094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:14.347158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:14.358257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.359378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.360400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.360848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.464675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:14.471167 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e3f31187-dc3a-4b43-a0b1-f0cc69bd246c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1534 microversion: 2.1 time: 0.385100 Feb 12 21:14:14.472239 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1541/3165] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:14 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1534 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:14.509339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:14.513335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:14.517014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.517507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.518465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:14.518915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:14.522317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:14.531411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:14.533651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:14.535138 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7daafd0b-654a-4fdb-8ad8-ec13873f7d03 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1743 microversion: 2.20 time: 0.196355 Feb 12 21:14:14.545503 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1625/3166] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:14 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:14.983604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:14.991584 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-44451693-a72d-48ee-9d14-da59a7606178 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1631 microversion: 2.1 time: 0.486303 Feb 12 21:14:14.992204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1542/3167] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:14 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1631 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:15.297684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:15.299025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:15.311200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.312315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.314136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.314790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.487967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:15.491947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:15.494751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:15.503494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.504053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.504180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ac7eb2d-efd6-4be2-8e95-c098d1299bc5 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1569 microversion: 2.1 time: 0.210570 Feb 12 21:14:15.504804 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1626/3168] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:15 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:15.504929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.505390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.555778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:15.557451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:15.566313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.567090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.568305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.568937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.713693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:15.720965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:15.723193 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-95d07dfe-80f8-45bf-a266-8add98d8857b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1540 microversion: 2.1 time: 0.238954 Feb 12 21:14:15.723782 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1543/3169] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:15 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1540 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:15.733519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:15.734197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:15.735605 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d37bad85-3071-4a75-83f2-e2cd003ab4de tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.184578 Feb 12 21:14:15.736353 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1627/3170] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:15 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:15.769906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8cb03f3-163b-4e9d-bbc6-451e75bc5c82"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:15.771169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:15.778491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.779082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:15.780058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:15.780976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.009470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:16.011069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:16.017906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.018473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.019364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.020097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.089775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:16.111551 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c32cef83-3ecc-48ae-8a83-6b1f236fcdfc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 200 len: 1568 microversion: 2.1 time: 0.105959 Feb 12 21:14:16.115151 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1628/3171] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:16 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 1568 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:16.359338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5002740f-f2bd-4fe2-9a25-6f676771e1ff req-8619fcab-749f-476e-92ef-2e4cfc96fe52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "name": "network-vif-deleted", "tag": "a9c88055-d6de-4f8c-900a-bbcede04a18d"}, {"server_uuid": "34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a", "name": "network-vif-deleted", "tag": "cd382a11-c4eb-464b-be5f-5be4d5b113a3"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:16.361006 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:16.361006 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:16.369503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5002740f-f2bd-4fe2-9a25-6f676771e1ff req-8619fcab-749f-476e-92ef-2e4cfc96fe52 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.370175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5002740f-f2bd-4fe2-9a25-6f676771e1ff req-8619fcab-749f-476e-92ef-2e4cfc96fe52 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.381180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5002740f-f2bd-4fe2-9a25-6f676771e1ff req-8619fcab-749f-476e-92ef-2e4cfc96fe52 service nova] Creating event network-vif-deleted:a9c88055-d6de-4f8c-900a-bbcede04a18d for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:16.381710 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5002740f-f2bd-4fe2-9a25-6f676771e1ff req-8619fcab-749f-476e-92ef-2e4cfc96fe52 service nova] Creating event network-vif-deleted:cd382a11-c4eb-464b-be5f-5be4d5b113a3 for instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a on nch2-master-1 Feb 12 21:14:16.387479 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5002740f-f2bd-4fe2-9a25-6f676771e1ff req-8619fcab-749f-476e-92ef-2e4cfc96fe52 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031826 Feb 12 21:14:16.388250 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1629/3172] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:16.523444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:16.524138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:16.531238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.535946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.535946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.535946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.700042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:16.711972 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ccfbfc0f-f486-4951-ae91-4dea2ca4b693 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1549 microversion: 2.1 time: 0.192748 Feb 12 21:14:16.714020 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1630/3173] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:16 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:16.729613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:16.730109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:16.741128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.744883 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d91ad4f-232f-48ec-8be3-a593c079b0f0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974892 Feb 12 21:14:16.747023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.747130 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1544/3174] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:14:15 2022] POST /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments => generated 194 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:16.747405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.747405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.757880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:16.758761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:16.787077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.789046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.791810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.792601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.903116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Cannot 'detach_volume' instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 while it is in vm_state rescued Feb 12 21:14:16.904184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 409 to user: Cannot 'detach_volume' instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 while it is in vm_state rescued {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:16.905860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2225ada1-fd08-4512-b59f-5d48af313bbf tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments/f467ea62-0ab8-4471-b457-237b5ad7e6a5" status: 409 len: 152 microversion: 2.1 time: 0.179615 Feb 12 21:14:16.907398 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1631/3175] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:14:16 2022] DELETE /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments/f467ea62-0ab8-4471-b457-237b5ad7e6a5 => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:14:16.926563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:16.928707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:16.941819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.946457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:16.947918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:16.950567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.145303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:17.156590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d6024c5d-a927-4028-b0f5-633cfa19e0de tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1540 microversion: 2.1 time: 0.412966 Feb 12 21:14:17.157059 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1545/3176] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:16 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1540 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:17.170303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:17.175154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:17.194168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.194627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.195435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.195877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.258116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:17.284534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:17.287943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:17.293567 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb648935-1fc4-49c3-aeca-6300d808e5fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.381277 Feb 12 21:14:17.296550 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1632/3177] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:16 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:17.310868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:17.313785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:17.321603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.322372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.327144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.328564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.343427 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] HTTP exception thrown: Instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a could not be found. Feb 12 21:14:17.344606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Returning 404 to user: Instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:17.345661 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-050b3703-f536-4723-a67d-a64ba737ec4b tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 404 len: 111 microversion: 2.1 time: 0.047819 Feb 12 21:14:17.349398 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1633/3178] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:17 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:14:17.360110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7fe77597-09b0-4652-974b-11f2c3b37436 req-a4916928-93e7-4b90-af14-b87229ea6ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "name": "network-vif-plugged", "status": "completed", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:17.364878 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:17.364878 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:17.378666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7fe77597-09b0-4652-974b-11f2c3b37436 req-a4916928-93e7-4b90-af14-b87229ea6ad2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.383739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7fe77597-09b0-4652-974b-11f2c3b37436 req-a4916928-93e7-4b90-af14-b87229ea6ad2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.407346 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7fe77597-09b0-4652-974b-11f2c3b37436 req-a4916928-93e7-4b90-af14-b87229ea6ad2 service nova] Creating event network-vif-plugged:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch1-master-1 Feb 12 21:14:17.424530 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7fe77597-09b0-4652-974b-11f2c3b37436 req-a4916928-93e7-4b90-af14-b87229ea6ad2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073514 Feb 12 21:14:17.425827 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1634/3179] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:17.481581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-587e8728-f955-4d30-b819-17cae065f8aa tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action" status: 202 len: 0 microversion: 2.1 time: 0.323153 Feb 12 21:14:17.482700 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1546/3180] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:17 2022] POST /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:14:17.491208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:17.492084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:17.504908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.505812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.512065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:17.512890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:17.738598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:17.761531 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c6aa96ab-cf1f-45d1-a711-47c49d0be099 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1557 microversion: 2.1 time: 0.262982 Feb 12 21:14:17.761531 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1635/3181] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:17 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:18.176167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:18.177077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:18.201080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.208893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.212079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.214321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.319756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:18.323808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:18.334643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.338246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.344839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.345813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.650033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:18.662697 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66333314-7d20-4808-b46c-8192457f740c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1522 microversion: 2.1 time: 0.491099 Feb 12 21:14:18.664025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1547/3182] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:18 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:18.685506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:18.687412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:18.702638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.703981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.706675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.708536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.767336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:18.935158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:18.946388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:18.949788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:18.955296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-09d10e89-a6cd-472b-bb70-18b8d6416ad9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.642883 Feb 12 21:14:18.965844 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1636/3183] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:18 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:18.978400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:18.979128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:18.991892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.992362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:18.993211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:18.994237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:19.176870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b249738-1653-43ea-9f42-7338ad4aef9d tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 204 len: 0 microversion: 2.1 time: 0.494894 Feb 12 21:14:19.177976 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1548/3184] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:18 2022] DELETE /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:14:19.188127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:19.190258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:19.201726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:19.203594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:19.204634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:19.205757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:19.372762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:19.387272 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d651e2d9-97c5-4396-9be6-59cd734bd44a tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1557 microversion: 2.1 time: 0.420139 Feb 12 21:14:19.389496 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1637/3185] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:18 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1557 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:19.453241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b482b480-2a20-4864-a548-1b72702aad21 req-ce419ae8-3376-4567-8150-78396ee4f760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f33ecd6-e622-4f55-8516-0e0f250d53cd", "name": "network-vif-plugged", "status": "completed", "tag": "b3a5194c-7a2e-4123-85fd-17e70f26a53d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:19.455027 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:19.455027 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:19.470157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b482b480-2a20-4864-a548-1b72702aad21 req-ce419ae8-3376-4567-8150-78396ee4f760 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:19.470600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b482b480-2a20-4864-a548-1b72702aad21 req-ce419ae8-3376-4567-8150-78396ee4f760 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:19.493094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b482b480-2a20-4864-a548-1b72702aad21 req-ce419ae8-3376-4567-8150-78396ee4f760 service nova] Creating event network-vif-plugged:b3a5194c-7a2e-4123-85fd-17e70f26a53d for instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd on nch1-master-1 Feb 12 21:14:19.501564 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b482b480-2a20-4864-a548-1b72702aad21 req-ce419ae8-3376-4567-8150-78396ee4f760 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059706 Feb 12 21:14:19.503018 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1638/3186] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:19.522100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:19.532057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f9c24ce-2ce4-4ed3-8ffb-97fb7d813547 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1528 microversion: 2.1 time: 0.349849 Feb 12 21:14:19.533547 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1549/3187] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:19 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1528 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:19.979337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:19.980153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:19.987190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:19.987750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:19.988936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:19.989599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:20.349193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:20.361264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:20.367421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:20.368610 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c409dc91-57a9-4971-9568-c45048a2e1e4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.393824 Feb 12 21:14:20.381445 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1639/3188] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:19 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:20.409108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:20.409777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:20.422410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:20.422877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:20.423721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:20.424182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:20.549636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:20.550246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:20.557773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:20.558217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:20.564020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:20.564689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:20.777938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:20.777938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad0e87cf-1aa1-4990-a202-48a3935d5461 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1557 microversion: 2.1 time: 0.269769 Feb 12 21:14:20.777938 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1550/3189] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:20 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1557 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:20.778771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:20.778771 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2688395-3d3b-41b2-9016-2a2a429106e5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1528 microversion: 2.1 time: 0.194382 Feb 12 21:14:20.778771 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1640/3190] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:20 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:21.390139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:21.390750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:21.398851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:21.399299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:21.403007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:21.403631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:21.704639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:21.705999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:21.716414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:21.717592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:21.718663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:21.719314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:21.734125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:21.745801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:21.763486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:21.767419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2d90574f-c6e5-4ca4-8843-a5f61479f1cd tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.381348 Feb 12 21:14:21.770874 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1551/3191] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:21 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:21.792477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:21.794068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:21.823025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:21.830988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:21.832130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:21.833897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:21.967275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:21.977794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f48a6e83-e5d1-46a7-8d48-599a89ef2dc6 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1557 microversion: 2.1 time: 0.288006 Feb 12 21:14:21.988579 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1641/3192] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:21 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1557 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:22.381081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:22.393205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b44ce007-9d10-4299-abbd-a286d651bd6b tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1528 microversion: 2.1 time: 0.621062 Feb 12 21:14:22.394006 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1552/3193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:21 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1528 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:22.489682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2070805476", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "282c3200-9059-438c-a022-c732f83ca0af"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:22.555528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] validate_networks() for [('282c3200-9059-438c-a022-c732f83ca0af', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:14:22.674766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d543509a-cd40-489e-a56d-1f97b29c09fb req-2cc736b2-c3e3-4452-92cb-607378a4587a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f33ecd6-e622-4f55-8516-0e0f250d53cd", "name": "network-vif-deleted", "tag": "b3a5194c-7a2e-4123-85fd-17e70f26a53d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:22.680517 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:22.680517 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:22.690915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d543509a-cd40-489e-a56d-1f97b29c09fb req-2cc736b2-c3e3-4452-92cb-607378a4587a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:22.691594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d543509a-cd40-489e-a56d-1f97b29c09fb req-2cc736b2-c3e3-4452-92cb-607378a4587a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:22.708684 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d543509a-cd40-489e-a56d-1f97b29c09fb req-2cc736b2-c3e3-4452-92cb-607378a4587a service nova] Creating event network-vif-deleted:b3a5194c-7a2e-4123-85fd-17e70f26a53d for instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd on nch1-master-1 Feb 12 21:14:22.715644 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d543509a-cd40-489e-a56d-1f97b29c09fb req-2cc736b2-c3e3-4452-92cb-607378a4587a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050152 Feb 12 21:14:22.721079 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1553/3194] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:22.788989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:22.791403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:22.804233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:22.805791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:22.807470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:22.808105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:22.987657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:23.001024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:23.002992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:23.004526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-05d6b4f5-51a4-47f2-a748-3c0efd97e77b tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.220792 Feb 12 21:14:23.005893 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1554/3195] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:22 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:23.018322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:23.025198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:23.029116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.029828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.031902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.032686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.213549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:23.222311 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb1e98a9-def0-471a-bc21-51b0475b4e04 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1563 microversion: 2.1 time: 0.211694 Feb 12 21:14:23.223171 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1555/3196] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:23 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1563 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:23.258859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:14:23.260664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:14:23.261171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:14:23.261974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:14:23.262611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:14:23.273435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.274096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.275866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.276515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.297283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:14:23.302661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for user daa98fa6e3104489af8bd77f8217a07f and project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:14:23.305323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:23.306791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:23.315646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.315646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.315646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.315646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.342067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:14:23.344477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:14:23.437492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'services' on Instance uuid c4a76f8f-ed14-4d6c-9296-e0e3113005c5 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:14:23.550062 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a38c290-ca7a-47ac-aad1-edb9df06e253 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064564 Feb 12 21:14:23.557282 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1642/3197] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:14:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:14:23.563358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:23.564256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:23.571038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.571703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.573307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.573955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.633953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.635569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.636186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lazy-loading 'fault' on Instance uuid 9f33ecd6-e622-4f55-8516-0e0f250d53cd {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:14:23.704240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:23.715148 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-890266da-a38c-4d95-b684-4c164eea972e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 200 len: 1315 microversion: 2.1 time: 0.154104 Feb 12 21:14:23.715148 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1643/3198] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:23 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:23.720702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b61cc61-e6e3-43a1-990d-dd57dd9fa212 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:23.721798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b61cc61-e6e3-43a1-990d-dd57dd9fa212 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:23.739086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-41b87e2d-2a81-4eb8-9bf9-85d74f56eb55 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments/f467ea62-0ab8-4471-b457-237b5ad7e6a5" status: 202 len: 0 microversion: 2.1 time: 0.437768 Feb 12 21:14:23.753441 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1556/3199] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:14:23 2022] DELETE /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments/f467ea62-0ab8-4471-b457-237b5ad7e6a5 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:14:23.768324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:23.769488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:23.786146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.788683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.796146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:23.797445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:23.881988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8b61cc61-e6e3-43a1-990d-dd57dd9fa212 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:23.883420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9379524b-4950-4761-bf56-c21089fa5313 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118704 Feb 12 21:14:23.884813 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1557/3200] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:14:23 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:23.891951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b61cc61-e6e3-43a1-990d-dd57dd9fa212 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1218 microversion: 2.1 time: 0.177253 Feb 12 21:14:23.893256 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1644/3201] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:23 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:24.031014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:24.032097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:24.047394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.048414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.052377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.052964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.405481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:24.422452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:24.427617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:24.443356 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13e9519e-ec39-4927-9a7a-3cdd0050ba06 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.418156 Feb 12 21:14:24.455691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1558/3202] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:24 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:24.732501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:24.733119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:24.745742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.760416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.764864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.765496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.803405 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd could not be found. Feb 12 21:14:24.807153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:24.807507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2d98ed1-2534-4b47-972d-61c8b5b4e173 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 404 len: 111 microversion: 2.1 time: 0.081124 Feb 12 21:14:24.817844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c6b43ea-d928-46ab-bfba-3fdb8337f900 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'create', calling method: .version_select at 0x7fa8fe0e9ee0>, body: {"keypair": {"name": "tempest-keypair-2050066560"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:24.822479 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1645/3203] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:24 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:14:24.846690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9c6b43ea-d928-46ab-bfba-3fdb8337f900 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:14:24.852622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9c6b43ea-d928-46ab-bfba-3fdb8337f900 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for user 6fb5c74958944d26a2e0297f8a470631 and project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:14:24.897036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:24.898306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:24.908519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.909044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.909959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.910569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.959597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6401f6a3-86cf-4e29-af42-730f4c0fea39 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066777 Feb 12 21:14:24.960101 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1646/3204] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:14:24 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:24.965915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:24.966532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:24.973091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.973671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:24.974385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:24.978072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:25.070853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:25.080992 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-39b88364-9391-44a9-b071-b9630e0839a1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1222 microversion: 2.1 time: 0.119843 Feb 12 21:14:25.081651 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1647/3205] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:24 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:25.293069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9c6b43ea-d928-46ab-bfba-3fdb8337f900 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:14:25.300126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9c6b43ea-d928-46ab-bfba-3fdb8337f900 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for user 6fb5c74958944d26a2e0297f8a470631 and project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:14:25.320713 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c6b43ea-d928-46ab-bfba-3fdb8337f900 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.506684 Feb 12 21:14:25.321401 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1559/3206] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:14:24 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:25.470774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:25.471651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:25.483870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:25.484706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:25.487089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:25.491349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:25.816423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2128084380", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7f4d62ea-7d15-483e-bc99-c740173135a1"}, {"uuid": "56382359-bde3-4e93-8298-855e64f470af"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:25.843212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:25.857902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:25.868074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:25.870185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f13413a-a4fe-40b9-8363-7fdfa5ab8079 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.403711 Feb 12 21:14:25.871893 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1648/3207] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:25 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:25.936132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] validate_networks() for [('7f4d62ea-7d15-483e-bc99-c740173135a1', None, None, None, None, None), ('56382359-bde3-4e93-8298-855e64f470af', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:14:25.972866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:25.973829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:25.984964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:25.985526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:25.986336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:25.986767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.042533 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd483921-3e6e-49d4-a130-3bda478edbf2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074042 Feb 12 21:14:26.043425 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1649/3208] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:14:25 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:14:26.098190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:26.098854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:26.115393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.115861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.116679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.117121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.282463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:26.294055 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a7c6465-0753-4bcd-b2b4-0adb4f929dc1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1214 microversion: 2.1 time: 0.199747 Feb 12 21:14:26.295193 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1650/3209] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:26 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:26.300104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:26.301496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:26.308914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.309656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.314554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.314554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.342902 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Cannot 'reboot' instance 29124640-751c-4a46-bc3d-dd666846f4a9 while it is in vm_state rescued Feb 12 21:14:26.345139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 409 to user: Cannot 'reboot' instance 29124640-751c-4a46-bc3d-dd666846f4a9 while it is in vm_state rescued {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:26.346546 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f73e4f67-bf87-4140-a30c-b3a33720098f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9/action" status: 409 len: 145 microversion: 2.1 time: 0.049881 Feb 12 21:14:26.347948 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1651/3210] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:26 2022] POST /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9/action => generated 145 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:14:26.360463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:26.362221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:26.370583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.371307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.372495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.373141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.421182 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Cannot 'rebuild' instance 29124640-751c-4a46-bc3d-dd666846f4a9 while it is in vm_state rescued Feb 12 21:14:26.422275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 409 to user: Cannot 'rebuild' instance 29124640-751c-4a46-bc3d-dd666846f4a9 while it is in vm_state rescued {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:26.432172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-10bb2ede-97a9-4b3d-bd09-2292462d4f3b tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "POST /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9/action" status: 409 len: 146 microversion: 2.1 time: 0.067614 Feb 12 21:14:26.432172 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1652/3211] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:26 2022] POST /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9/action => generated 146 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:14:26.901003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:26.902546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:26.924913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.929262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:26.933874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:26.934379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:27.003587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:14:27.004198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:14:27.004955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:14:27.005639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:14:27.006437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:14:27.047123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:27.048546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:27.049736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:27.054478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:27.143423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Getting quotas for project b438902509da463ba94a98d99ffd1444. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:14:27.161214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Getting quotas for user 36f49587ae5a49a8bbb9f02e5b857eb9 and project b438902509da463ba94a98d99ffd1444. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:14:27.203370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:14:27.227593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:14:27.499481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:27.515519 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2546774-b44e-4f88-a1ca-e069ad8eb991 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703607 Feb 12 21:14:27.517070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1560/3212] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:14:27.526997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:27.526997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:27.533486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:27.537338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:27.547033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:27.547492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:27.548307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:27.548748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:27.550196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3233efe-6437-491a-bc18-9a35b886831d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.655976 Feb 12 21:14:27.551389 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1653/3213] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:26 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:27.557416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9164ef99-dc7e-41db-a711-7300ac9528d1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:27.560662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9164ef99-dc7e-41db-a711-7300ac9528d1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:27.745063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:27.757368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7205864-617a-43fc-86d5-f271bdc172f4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1288 microversion: 2.1 time: 0.239965 Feb 12 21:14:27.762788 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1561/3214] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:27 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1288 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:27.834020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9164ef99-dc7e-41db-a711-7300ac9528d1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:27.869221 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9164ef99-dc7e-41db-a711-7300ac9528d1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1213 microversion: 2.1 time: 0.315534 Feb 12 21:14:27.879497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1654/3215] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:27 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1213 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:28.586567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:28.591359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:28.611865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:28.612619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:28.613674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:28.614909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:28.781637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:28.783333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:28.800852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:28.801659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:28.804113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:28.804931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:28.999591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:29.021007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:29.026157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:29.027883 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-619242a6-8af0-4ebf-b01b-6ac2fd364701 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.459691 Feb 12 21:14:29.031312 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1562/3216] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:28 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:29.039794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:29.048978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:29.062969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:29.063667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:29.064650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:29.065910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:29.222577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:29.232543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:29.247354 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9573602a-1480-44b4-a83a-f5e37e53a610 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1217 microversion: 2.1 time: 0.213694 Feb 12 21:14:29.252351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91b8b2dd-7bda-43e5-832b-1681e35c8ab4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.476357 Feb 12 21:14:29.252832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1563/3217] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:29 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:29.255674 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1655/3218] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:28 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:29.979454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-949060179", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:30.049965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:30.050796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:30.065766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.072972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] validate_networks() for [('46e8ba15-abd6-4b1e-957e-9d3052ac4ccd', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:14:30.076048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.076877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.077331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.319945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:30.348896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:30.356921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:30.362864 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a129e05a-2b97-42e0-a0db-e8cdb8b079ca tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.315132 Feb 12 21:14:30.363660 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1656/3219] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:30 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:30.375296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d94180aa-ec52-4092-84e3-a86c160e57d6 req-3534b6ce-0107-4963-a86b-ac64606eab27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae66924-5617-4e45-a05b-3792b2bf1c82", "tag": "dd227e33-f70a-4937-a239-d5f76f172b3e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:30.377811 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:30.377811 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:30.398032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d94180aa-ec52-4092-84e3-a86c160e57d6 req-3534b6ce-0107-4963-a86b-ac64606eab27 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.398520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d94180aa-ec52-4092-84e3-a86c160e57d6 req-3534b6ce-0107-4963-a86b-ac64606eab27 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.437797 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d94180aa-ec52-4092-84e3-a86c160e57d6 req-3534b6ce-0107-4963-a86b-ac64606eab27 service nova] Creating event network-changed:dd227e33-f70a-4937-a239-d5f76f172b3e for instance eae66924-5617-4e45-a05b-3792b2bf1c82 on nch2-master-1 Feb 12 21:14:30.446139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d94180aa-ec52-4092-84e3-a86c160e57d6 req-3534b6ce-0107-4963-a86b-ac64606eab27 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079478 Feb 12 21:14:30.448711 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1657/3220] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:30.455451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:30.456535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:30.467559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.468393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.469774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.470551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.576397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:30.587692 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac66497c-12d8-4fc2-9d93-ac3324b8510f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1265 microversion: 2.1 time: 0.135225 Feb 12 21:14:30.588875 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1658/3221] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:30 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:30.602011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:30.604224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:30.623033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.628608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.629774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.630420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.823035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:14:30.823571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:14:30.824228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:14:30.824802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:14:30.825414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:14:30.858254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.859252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.860826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:30.861243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:30.909698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:14:30.919534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for user 6fb5c74958944d26a2e0297f8a470631 and project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:14:31.012388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:14:31.019129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:14:31.323803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:31.331326 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0ff3ea2-e4c0-4a3f-86d9-bbead8670164 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.741260 Feb 12 21:14:31.331899 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1659/3222] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:30 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:31.385025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:31.385976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:31.392800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:31.395850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:31.395850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:31.395850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:31.541648 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fa37e26d-bbd6-4adf-af8c-6b38c8b34ed3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.566510 Feb 12 21:14:31.554107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1564/3223] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:14:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:14:31.568898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ffd9a0c-72fd-42d9-948c-378799cf578f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:31.570159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5ffd9a0c-72fd-42d9-948c-378799cf578f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:31.649509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5ffd9a0c-72fd-42d9-948c-378799cf578f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:31.661419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5ffd9a0c-72fd-42d9-948c-378799cf578f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1224 microversion: 2.1 time: 0.099950 Feb 12 21:14:31.661419 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1565/3224] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:31 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:31.670050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:31.670707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:31.695855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:31.695855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:31.695855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:31.695855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:31.721896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:31.737590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:31.739378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:31.740723 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ef4946e9-f8d6-4a98-bccb-4e6fd7a9bee9 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.360561 Feb 12 21:14:31.742615 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1660/3225] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:31 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:32.179114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:32.187120 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fa51e6e7-753a-41ef-bd0e-46c38d8a3dc4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1271 microversion: 2.1 time: 0.528414 Feb 12 21:14:32.203764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1566/3226] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:31 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1271 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:32.348171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:32.350748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:32.358014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:32.370765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:32.373969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:32.375918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:32.586836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:32.597618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0459263f-1060-4b14-b8fb-d71df83ec91d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.250920 Feb 12 21:14:32.598773 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1661/3227] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:32 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:32.674818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6ac8ef0-e632-4b06-9afd-b2127cc095d7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:32.676154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6ac8ef0-e632-4b06-9afd-b2127cc095d7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:32.742590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6ac8ef0-e632-4b06-9afd-b2127cc095d7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:32.750683 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6ac8ef0-e632-4b06-9afd-b2127cc095d7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1224 microversion: 2.1 time: 0.079493 Feb 12 21:14:32.751764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1567/3228] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:32 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:32.761809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:32.762702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:32.769572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:32.770024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:32.770811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:32.771250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:32.936141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:32.944867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:32.946407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:32.947572 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e5b87c0-7fb2-42c7-b054-400496594dd8 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1738 microversion: 2.20 time: 0.189990 Feb 12 21:14:32.958683 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1662/3229] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:32 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:33.210773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:33.211520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:33.222113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.222570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.223597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.224045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.363428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:33.371268 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4bf91c74-405d-4171-8c1f-c637470220dc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1313 microversion: 2.1 time: 0.164192 Feb 12 21:14:33.372422 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1568/3230] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:33 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:33.617299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:33.618165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:33.637645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.640724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.641774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.642281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.769984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:33.771889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:33.780581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.781094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.782782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.783401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.888940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:33.896731 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9196131-38bb-47dc-acb8-e47c731ae24e tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1276 microversion: 2.1 time: 0.130680 Feb 12 21:14:33.897316 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1569/3231] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:33 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:33.945277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:33.953930 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62f0939e-8f3f-4d20-ad83-945d92ee91ea tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.341669 Feb 12 21:14:33.954833 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1663/3232] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:33 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:33.967839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:33.968615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:33.975334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.975907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:33.976799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:33.977554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.192073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:34.201964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:34.203747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:34.205514 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bc106b0d-a146-412f-93b9-42557532dcbb tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1720 microversion: 2.20 time: 0.241826 Feb 12 21:14:34.206570 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1570/3233] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:33 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:34.388540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:34.389081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:34.399412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.400074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.410354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.410354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.674939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:34.676664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:34.686032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.686803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.688623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.689290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.759808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:34.763812 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8bfabdc3-cebb-4063-8219-b8b00694c149 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "POST /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7/action" status: 200 len: 24591 microversion: 2.42 time: 0.219282 Feb 12 21:14:34.765344 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1571/3234] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:14:34 2022] POST /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7/action => generated 24591 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:14:34.773434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e7cc6e9f-4285-46b1-9946-92718e807e3b req-66b8c70f-8352-4eeb-804f-4498bccb510b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252f22ce-8a26-45c9-8439-95e29bb12e93", "tag": "4d9371f5-ec27-4fa7-88c2-454dd8a7b5ce"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:34.775808 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:34.775808 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:34.777305 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d4b47a0-9e2e-4578-83ea-96a68e2e8d8f tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.393072 Feb 12 21:14:34.787903 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1664/3235] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:34 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:34.788804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e7cc6e9f-4285-46b1-9946-92718e807e3b req-66b8c70f-8352-4eeb-804f-4498bccb510b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.789516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e7cc6e9f-4285-46b1-9946-92718e807e3b req-66b8c70f-8352-4eeb-804f-4498bccb510b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.803450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:34.804074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:34.810452 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e7cc6e9f-4285-46b1-9946-92718e807e3b req-66b8c70f-8352-4eeb-804f-4498bccb510b service nova] Creating event network-changed:4d9371f5-ec27-4fa7-88c2-454dd8a7b5ce for instance 252f22ce-8a26-45c9-8439-95e29bb12e93 on nch2-master-1 Feb 12 21:14:34.818230 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e7cc6e9f-4285-46b1-9946-92718e807e3b req-66b8c70f-8352-4eeb-804f-4498bccb510b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051142 Feb 12 21:14:34.818974 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1572/3236] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:34.824848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.825344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.826440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.827206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.868890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:34.916491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:34.920251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:34.929839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.930515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:34.931399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:34.932006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.052663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.061451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccc88427-066e-4636-9d89-57d98beadf75 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1282 microversion: 2.1 time: 0.149578 Feb 12 21:14:35.063252 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1573/3237] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:34 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:35.068620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:35.069691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:35.091500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.091500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.092319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.092906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.222607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e108e37-8cf9-4066-816d-34eb2921cf16 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "DELETE /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 204 len: 0 microversion: 2.42 time: 0.433304 Feb 12 21:14:35.225124 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1665/3238] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:14:34 2022] DELETE /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:14:35.234730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:35.239564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:35.252846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.253753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.257638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.257638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.322209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.331485 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a49c00c8-145a-413e-aaf9-82bf8dc12d4b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.266298 Feb 12 21:14:35.332295 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1574/3239] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:35 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:35.337593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:35.338208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:35.349156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.349617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.350427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.350861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.560009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.577895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.577895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.577895 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5b9e5059-93e8-4b22-b415-fee90c70fbb8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2959 microversion: 2.42 time: 0.238943 Feb 12 21:14:35.577895 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1575/3240] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:35 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2959 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:35.613068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.624950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.626973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.628281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e8d66948-90c9-48b4-a748-167277c8f624 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1720 microversion: 2.20 time: 0.401268 Feb 12 21:14:35.629406 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1666/3241] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:35 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1720 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:35.807034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:35.808673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:35.815913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.816709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.817644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:35.818151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:35.986560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:35.993999 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff585f29-2e9c-4a4a-bb86-5aa7d9eead6a tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.196019 Feb 12 21:14:35.994575 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1576/3242] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:35 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:36.079963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:36.080893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:36.087754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.088205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.089941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.090377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.349112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:36.349754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:36.356938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.357666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.358622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.359241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.497566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:36.509666 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f6aa9d2b-6eb2-4ef7-ab3f-24959253bd49 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.432937 Feb 12 21:14:36.510713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:36.511482 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1667/3243] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:36 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:36.519011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4bbbd5eb-f88a-43e7-bb17-21ee0eac3a27 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.173429 Feb 12 21:14:36.519596 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1577/3244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:36 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:36.592898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:36.593652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:36.600273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.600822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.604465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.604465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.647732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:36.648349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:36.655567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.656020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.660378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.661016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.877393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:36.888212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:36.891194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:36.892869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f2fae083-c6bf-4096-987d-96979dbe4a99 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1723 microversion: 2.20 time: 0.249172 Feb 12 21:14:36.894144 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1578/3245] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:36 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:36.902660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8ef9c159-026f-4007-b50d-30b8aad2feaa req-0d711a7b-d522-4f05-a27f-f1117814a1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "252f22ce-8a26-45c9-8439-95e29bb12e93", "tag": "735421c7-998f-4aad-ae4f-0ba9e9eff209"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:36.905452 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:36.905452 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:36.915111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8ef9c159-026f-4007-b50d-30b8aad2feaa req-0d711a7b-d522-4f05-a27f-f1117814a1cc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.915909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8ef9c159-026f-4007-b50d-30b8aad2feaa req-0d711a7b-d522-4f05-a27f-f1117814a1cc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.950835 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8ef9c159-026f-4007-b50d-30b8aad2feaa req-0d711a7b-d522-4f05-a27f-f1117814a1cc service nova] Creating event network-changed:735421c7-998f-4aad-ae4f-0ba9e9eff209 for instance 252f22ce-8a26-45c9-8439-95e29bb12e93 on nch2-master-1 Feb 12 21:14:36.957000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8ef9c159-026f-4007-b50d-30b8aad2feaa req-0d711a7b-d522-4f05-a27f-f1117814a1cc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060970 Feb 12 21:14:36.958079 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1579/3246] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:36.965503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6e215f7-2439-4ab4-8721-553c6427717e"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:36.966844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:36.984392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:36.984886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.985546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.986886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:36.987430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:36.997387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:37.003262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:37.015625 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a3bcdc0-99f9-42c0-8de7-611fa6984420 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2959 microversion: 2.42 time: 0.422023 Feb 12 21:14:37.019807 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1668/3247] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:36 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2959 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:37.024795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0ed48ee6-0ce6-4234-9d92-88fa42e4b148 req-63e86e31-a3e1-4c75-a373-25d4808f4f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae66924-5617-4e45-a05b-3792b2bf1c82", "name": "network-vif-plugged", "status": "completed", "tag": "dd227e33-f70a-4937-a239-d5f76f172b3e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:37.032197 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:37.032197 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:37.040699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0ed48ee6-0ce6-4234-9d92-88fa42e4b148 req-63e86e31-a3e1-4c75-a373-25d4808f4f43 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:37.041150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0ed48ee6-0ce6-4234-9d92-88fa42e4b148 req-63e86e31-a3e1-4c75-a373-25d4808f4f43 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:37.061171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0ed48ee6-0ce6-4234-9d92-88fa42e4b148 req-63e86e31-a3e1-4c75-a373-25d4808f4f43 service nova] Creating event network-vif-plugged:dd227e33-f70a-4937-a239-d5f76f172b3e for instance eae66924-5617-4e45-a05b-3792b2bf1c82 on nch2-master-1 Feb 12 21:14:37.067385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0ed48ee6-0ce6-4234-9d92-88fa42e4b148 req-63e86e31-a3e1-4c75-a373-25d4808f4f43 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046199 Feb 12 21:14:37.071687 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1669/3248] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:37.078417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:37.079188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:37.093921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:37.099734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:37.107857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:37.107857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:37.745707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:37.758995 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-838a8db7-95d2-4ec0-8786-39a83a2e1dbc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.685955 Feb 12 21:14:37.759643 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1670/3249] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:37 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:37.765826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:37.766646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:37.774819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:37.775277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:37.776143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:37.777294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.066337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:38.074677 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f11c407-65a2-4707-8a2a-f6f88e951d29 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.312669 Feb 12 21:14:38.075264 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1671/3250] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:37 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:38.080503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:38.081922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:38.090139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.091245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.092234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.092982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.187676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c074a4d-6cc0-4b69-bd04-4bbf66384700 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.228183 Feb 12 21:14:38.188711 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1580/3251] 10.222.0.31 () {62 vars in 1363 bytes} [Sat Feb 12 21:14:36 2022] POST /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-volume_attachments => generated 188 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:14:38.203780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:38.203780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:38.218768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.219492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.220995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.221564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.451843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:38.460080 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d6fb108-e74b-4a07-a9a0-73c4edb7a8d0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1318 microversion: 2.1 time: 0.383563 Feb 12 21:14:38.460953 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1672/3252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:38 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:38.466902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:38.467482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:38.473941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.474590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.477293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.477293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.528571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:38.540343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:38.542829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:38.544362 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a0894dc-b92c-4c4a-8aaf-88f80b1de6c8 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2959 microversion: 2.42 time: 0.354640 Feb 12 21:14:38.545540 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1581/3253] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:38 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2959 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:38.775950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:38.776846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:38.784801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.785523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:38.786511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:38.787111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.051010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:39.059076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76c124c9-bd39-409c-bb9e-c264394485bc tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.286861 Feb 12 21:14:39.059676 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1582/3254] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:38 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:39.064174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-502ce526-1879-4f0e-88bc-ed939f09c0c9 req-7a83a3e0-3eb3-4824-913c-08aa390b472b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2990b1d-7527-44c6-9a61-380b654541b6", "tag": "560cbda4-8c83-4286-ad46-6863e830ae96"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:39.065879 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:39.065879 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:39.074570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-502ce526-1879-4f0e-88bc-ed939f09c0c9 req-7a83a3e0-3eb3-4824-913c-08aa390b472b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.075061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-502ce526-1879-4f0e-88bc-ed939f09c0c9 req-7a83a3e0-3eb3-4824-913c-08aa390b472b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.089301 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-502ce526-1879-4f0e-88bc-ed939f09c0c9 req-7a83a3e0-3eb3-4824-913c-08aa390b472b service nova] Creating event network-changed:560cbda4-8c83-4286-ad46-6863e830ae96 for instance d2990b1d-7527-44c6-9a61-380b654541b6 on nch1-master-1 Feb 12 21:14:39.097631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-502ce526-1879-4f0e-88bc-ed939f09c0c9 req-7a83a3e0-3eb3-4824-913c-08aa390b472b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034657 Feb 12 21:14:39.097631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1583/3255] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:39.111937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4ff2e798-005a-4343-a6a5-85e6c440e36a req-b584710c-82dc-45f9-b597-5b403ac3cd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "name": "network-vif-unplugged", "status": "completed", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:39.120849 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:39.120849 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:39.126773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4ff2e798-005a-4343-a6a5-85e6c440e36a req-b584710c-82dc-45f9-b597-5b403ac3cd07 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.127254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4ff2e798-005a-4343-a6a5-85e6c440e36a req-b584710c-82dc-45f9-b597-5b403ac3cd07 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.140248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f54b5bda-561d-496c-a9ac-9bcb89c6ccc5 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-volume_attachments/a6e215f7-2439-4ab4-8721-553c6427717e" status: 202 len: 0 microversion: 2.20 time: 0.677545 Feb 12 21:14:39.141037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1673/3256] 10.222.0.31 () {60 vars in 1456 bytes} [Sat Feb 12 21:14:38 2022] DELETE /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-volume_attachments/a6e215f7-2439-4ab4-8721-553c6427717e => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:39.156212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:39.157458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:39.165299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.166050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.166965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.server_external_events [req-4ff2e798-005a-4343-a6a5-85e6c440e36a req-b584710c-82dc-45f9-b597-5b403ac3cd07 service nova] Unable to find a host for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d. Dropping event network-vif-unplugged {{(pid=141726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 21:14:39.168569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.169225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.170942 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4ff2e798-005a-4343-a6a5-85e6c440e36a req-b584710c-82dc-45f9-b597-5b403ac3cd07 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073159 Feb 12 21:14:39.173710 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1584/3257] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 12 21:14:39.219781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:39.222634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:39.228942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.229651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.230656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.231104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.530175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f2a8fdba-4181-4fae-b75d-fc3276a24dac tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "POST /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/action" status: 202 len: 0 microversion: 2.20 time: 0.312106 Feb 12 21:14:39.531836 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1585/3258] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:14:39 2022] POST /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:14:39.539164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:39.540090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:39.549893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.551223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.556631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.556631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.736739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:39.748278 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe848e83-3113-4920-9ee2-0a1e230e40ef tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.606011 Feb 12 21:14:39.748940 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1674/3259] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:39 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:39.755286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:39.756425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:39.768383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.769079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.770414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.771621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.856404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:39.865636 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-83c5a353-7b33-41ed-b937-668af2e9289d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1508 microversion: 2.1 time: 0.332408 Feb 12 21:14:39.866255 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1586/3260] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:39 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:39.886528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:39.886528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:39.889463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.890078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:39.891029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:39.891622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.233613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.244248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.246823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.248320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-101ddc13-ef3d-4255-9700-d74056f8d3ec tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1671 microversion: 2.20 time: 0.498030 Feb 12 21:14:40.253414 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1675/3261] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:39 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1671 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:40.261124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8cb03f3-163b-4e9d-bbc6-451e75bc5c82"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:40.262524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:40.268925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.269808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.270705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.271435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.285992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.301950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.303518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.304775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85f16b29-f9b4-4d01-9e92-b5fd5e33d64f tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2959 microversion: 2.42 time: 0.434775 Feb 12 21:14:40.305436 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1587/3262] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:39 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2959 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:40.326449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:40.327084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:40.341834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.342298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.343139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.343590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.387879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] HTTP exception thrown: Invalid volume: volume e8cb03f3-163b-4e9d-bbc6-451e75bc5c82 is already attached to instances: 8ca29232-9b41-4183-b84b-ce26da0aea7b Feb 12 21:14:40.389322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Returning 400 to user: Invalid volume: volume e8cb03f3-163b-4e9d-bbc6-451e75bc5c82 is already attached to instances: 8ca29232-9b41-4183-b84b-ce26da0aea7b {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:40.396981 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7611076-fa9c-46d8-a6a7-d4ad4099b915 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139746 Feb 12 21:14:40.396981 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1676/3263] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:14:40 2022] POST /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:14:40.456950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:40.457492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:40.468629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.469087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.469924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.471078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.554885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'services' on Instance uuid 8ca29232-9b41-4183-b84b-ce26da0aea7b {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:14:40.651854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:40.673855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9cf125a2-da7f-4c95-9f3f-499aa57c883e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.352871 Feb 12 21:14:40.674514 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1588/3264] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:40 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:40.767853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:40.768720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:40.779221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.780654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.781774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.791468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.794377 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cbe2dc8-57f4-47e6-bcfa-597ea2a8a2ab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments/e8cb03f3-163b-4e9d-bbc6-451e75bc5c82" status: 202 len: 0 microversion: 2.1 time: 0.341890 Feb 12 21:14:40.796573 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1677/3265] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:14:40 2022] DELETE /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments/e8cb03f3-163b-4e9d-bbc6-451e75bc5c82 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:14:40.810484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:40.813705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:40.835309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.835309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.835309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:40.835309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:40.892445 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bdd9b25f-2762-4a54-a943-bdca542422c0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090842 Feb 12 21:14:40.893942 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1678/3266] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:14:40 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:14:41.082026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.091824 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a4261991-720c-4c1d-b01d-91ccba825cb8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.327974 Feb 12 21:14:41.093169 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1589/3267] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:40 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:41.271305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:41.272593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:41.286420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.287400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.289104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.290191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.330427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:41.332378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:41.355782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.356819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.358106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.358853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.614647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.630021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.633143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.633699 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ba207b9-48ac-4014-8d61-bf39ff4ec2d7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2917 microversion: 2.42 time: 0.311486 Feb 12 21:14:41.634436 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1590/3268] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:41 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2917 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:41.645165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.665588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.667195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.668623 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c0af74f9-6c6f-44c6-b426-cc03b42410c0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1673 microversion: 2.20 time: 0.404109 Feb 12 21:14:41.669556 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1679/3269] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:41 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1673 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:41.693107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:41.694328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:41.702262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.703659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.704670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.705818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.899266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:41.907487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:41.909600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:41.917304 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2c686af-1c32-4cc0-8603-eebf5d1c6bd4 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.225798 Feb 12 21:14:41.918237 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1591/3270] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:41 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:41.925553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.931279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.933590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:41.934210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:41.968871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-61d47190-2004-496c-b4f5-519df4ee8a93 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068245 Feb 12 21:14:41.969488 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1680/3271] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:14:41 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:42.109531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:42.110149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:42.117226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:42.117703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:42.118509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:42.118947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:42.300369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:42.313203 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40340ed7-45db-4eb1-865c-7d39f922cd07 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.207280 Feb 12 21:14:42.314239 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1592/3272] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:42 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:42.656065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:42.656676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:42.670027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:42.670485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:42.671325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:42.671769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:42.691414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:42.693193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:42.707925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:42.708805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:42.709815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:42.710991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.086986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.099152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.101700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.104075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2874f89a-587d-4d32-a9ad-37b80e70ffbe tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2917 microversion: 2.42 time: 0.451804 Feb 12 21:14:43.104944 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1681/3273] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:42 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2917 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:43.337486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:43.350490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.357764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:43.370852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.378441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.378924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.379796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.380267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.384756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.386919 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a3ebacb-a7ef-4477-87f4-e70f1aae22cc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.702450 Feb 12 21:14:43.398533 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1593/3274] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:42 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:14:43.433541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:43.435358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:43.448995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.449390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.450205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.450646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.515244 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da3ae7f3-4ac6-4440-952a-0568645bfbea tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "POST /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3/action" status: 200 len: 24543 microversion: 2.1 time: 0.394580 Feb 12 21:14:43.517876 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1682/3275] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:43 2022] POST /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3/action => generated 24543 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:14:43.533758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:43.536310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:43.551189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.551648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.557960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.557960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.632193 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1436d8d-f8d6-40cb-b8db-e68d4ad66e88 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112795 Feb 12 21:14:43.633422 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1683/3276] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:14:43 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:14:43.650140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-22fa3619-8261-4055-8e80-31e089de10ae req-522912c4-8ebb-439b-bdb1-6b8bcb80354e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252f22ce-8a26-45c9-8439-95e29bb12e93", "name": "network-vif-plugged", "status": "completed", "tag": "735421c7-998f-4aad-ae4f-0ba9e9eff209"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:43.663396 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:43.663396 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:43.689951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-22fa3619-8261-4055-8e80-31e089de10ae req-522912c4-8ebb-439b-bdb1-6b8bcb80354e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.691418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-22fa3619-8261-4055-8e80-31e089de10ae req-522912c4-8ebb-439b-bdb1-6b8bcb80354e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.743023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-22fa3619-8261-4055-8e80-31e089de10ae req-522912c4-8ebb-439b-bdb1-6b8bcb80354e service nova] Creating event network-vif-plugged:735421c7-998f-4aad-ae4f-0ba9e9eff209 for instance 252f22ce-8a26-45c9-8439-95e29bb12e93 on nch2-master-1 Feb 12 21:14:43.758896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-22fa3619-8261-4055-8e80-31e089de10ae req-522912c4-8ebb-439b-bdb1-6b8bcb80354e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123823 Feb 12 21:14:43.759911 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1684/3277] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:43.764216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:43.772579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:43.773946 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1f7a01c-9186-4c16-8355-89772a44c1e3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.359180 Feb 12 21:14:43.774786 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1594/3278] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:43 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:43.775678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:43.781013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:43.781868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:43.789816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.790538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.791737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.793281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.806990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.807743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.808561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:43.808993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:43.826158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:44.184671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:44.194177 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2192f18-70c5-40bb-850c-dadac883ea35 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.432551 Feb 12 21:14:44.195045 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1685/3279] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:43 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:44.200381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1524788697", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "282c3200-9059-438c-a022-c732f83ca0af"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:44.254820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] validate_networks() for [('282c3200-9059-438c-a022-c732f83ca0af', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:14:44.375833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-41ad1de9-02da-451b-9463-40fbd4384b8e tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "DELETE /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 204 len: 0 microversion: 2.1 time: 0.597890 Feb 12 21:14:44.381134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1595/3280] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:43 2022] DELETE /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:44.386506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:44.387576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:44.395852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.396353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:44.397119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.397568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:44.612941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:44.622728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:44.625270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:44.626827 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fe7d19f-72e1-4b92-929f-29eff0a59ee7 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2871 microversion: 2.42 time: 0.248813 Feb 12 21:14:44.627579 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1596/3281] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:44 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2871 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:44.632038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:44.632980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:44.645009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.645772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:44.647952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.648740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:44.854060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:44.862880 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5a41976-4b9e-49ac-aa61-4340604234ed tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1606 microversion: 2.1 time: 0.234013 Feb 12 21:14:44.863705 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1597/3282] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:44 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1606 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:44.868760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bdeb4a99-099d-4ca3-83ed-b41f3a56aeee req-f41aa8fd-556d-4682-a367-882559c6b94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-deleted", "tag": "4d209389-a95f-430a-95ec-f6d0b38d85a6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:44.871498 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:44.871498 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:44.880852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bdeb4a99-099d-4ca3-83ed-b41f3a56aeee req-f41aa8fd-556d-4682-a367-882559c6b94d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.881584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bdeb4a99-099d-4ca3-83ed-b41f3a56aeee req-f41aa8fd-556d-4682-a367-882559c6b94d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:44.897029 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bdeb4a99-099d-4ca3-83ed-b41f3a56aeee req-f41aa8fd-556d-4682-a367-882559c6b94d service nova] Creating event network-vif-deleted:4d209389-a95f-430a-95ec-f6d0b38d85a6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:44.902798 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bdeb4a99-099d-4ca3-83ed-b41f3a56aeee req-f41aa8fd-556d-4682-a367-882559c6b94d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Feb 12 21:14:44.903914 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1598/3283] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:44.909579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:44.910344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:44.918407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.919124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:44.920101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:44.920688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.097712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:45.107334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:45.109560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:45.110991 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-548f29c2-3ec8-4472-b3da-1b7f4b9d28d6 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.206008 Feb 12 21:14:45.122478 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1599/3284] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:44 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:45.130828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:45.130828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:45.139535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.140194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.141150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.141624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.401533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:45.413539 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd95f226-f042-4114-aee0-22c1a0e15e36 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.289483 Feb 12 21:14:45.415945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1600/3285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:45 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:45.422083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:45.423088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:45.432704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.433875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.435424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.436103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.728589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:45.736770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:14:45.737230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:14:45.737783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:14:45.738525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:14:45.738949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:14:45.751075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.751961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.753286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.753907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.761260 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cbe8f9d8-3657-4b83-a63f-cc1e8742e8b3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.338166 Feb 12 21:14:45.763385 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1601/3286] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:45 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:45.777764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:14:45.784659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for user daa98fa6e3104489af8bd77f8217a07f and project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:14:45.787856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:45.794405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:45.802143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.823839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.823839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:45.823839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:45.824541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:14:45.824541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:14:46.000748 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4110a051-144c-406e-b00f-5d34de4e8f06 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.804376 Feb 12 21:14:46.002947 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1686/3287] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:14:46.012754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-unplugged", "status": "completed", "tag": "d18f9305-c081-40ea-be43-4032e65318f6"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-unplugged", "status": "completed", "tag": "f256d627-df49-4516-b949-fc05f0dbf0bc"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-unplugged", "status": "completed", "tag": "c24391d7-58a5-450b-bfb5-2e331131b9e0"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-unplugged", "status": "completed", "tag": "19dd89b0-f04c-47e0-b086-a93ccf42ad36"}, {"server_uuid": "252f22ce-8a26-45c9-8439-95e29bb12e93", "name": "network-vif-plugged", "status": "completed", "tag": "4d9371f5-ec27-4fa7-88c2-454dd8a7b5ce"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:46.024030 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:46.024030 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:46.056711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.057165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.094647 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Creating event network-vif-unplugged:d18f9305-c081-40ea-be43-4032e65318f6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:46.095122 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Creating event network-vif-unplugged:f256d627-df49-4516-b949-fc05f0dbf0bc for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:46.095631 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Creating event network-vif-unplugged:c24391d7-58a5-450b-bfb5-2e331131b9e0 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:46.099154 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Creating event network-vif-unplugged:19dd89b0-f04c-47e0-b086-a93ccf42ad36 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:46.099762 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] Creating event network-vif-plugged:4d9371f5-ec27-4fa7-88c2-454dd8a7b5ce for instance 252f22ce-8a26-45c9-8439-95e29bb12e93 on nch2-master-1 Feb 12 21:14:46.120504 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-877cdc11-85e4-4ce2-ac7a-c7975c9ddda1 req-48a357fc-3112-4573-9610-21f22fea5f71 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.114732 Feb 12 21:14:46.125197 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1687/3288] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:46.133915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:46.134631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:46.142607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.143054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.157036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.157878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.303706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.318192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.320116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.329250 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1da6e93c-4f2a-445b-99da-d91717b671b2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2533 microversion: 2.42 time: 0.552748 Feb 12 21:14:46.332728 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1602/3289] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:45 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2533 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:46.337629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e27f39d4-3c1b-48dc-bea7-fba33451bbf6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:46.338474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e27f39d4-3c1b-48dc-bea7-fba33451bbf6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:46.431383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e27f39d4-3c1b-48dc-bea7-fba33451bbf6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.444844 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e27f39d4-3c1b-48dc-bea7-fba33451bbf6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1218 microversion: 2.1 time: 0.110754 Feb 12 21:14:46.445751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1603/3290] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:46 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:46.453208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:46.454784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:46.482476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.483044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.486115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.489963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.631742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.643899 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c2c29933-6c0e-4dd8-acfc-2e108dae2a5b tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1606 microversion: 2.1 time: 0.517403 Feb 12 21:14:46.656804 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1688/3291] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:46 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1606 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:46.661822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:46.664743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:46.669735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.670719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.671888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.672624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.704237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.712992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.715805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.717344 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-754f5c94-b176-4174-adf3-045cb0340f84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.270142 Feb 12 21:14:46.718097 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1604/3292] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:46 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:46.791430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:46.793567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:46.817330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.817830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.819801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:46.822108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:46.947996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:46.959074 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddeda77f-e079-41cd-be77-1db6393d80e8 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1334 microversion: 2.1 time: 0.300391 Feb 12 21:14:46.964685 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1689/3293] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:46 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1334 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:46.967476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0698dd7f-3088-4302-99c3-d687d3260ff6 req-293e9b46-1461-4731-a50e-a15ee4fecabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-deleted", "tag": "f256d627-df49-4516-b949-fc05f0dbf0bc"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:46.974877 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:46.974877 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:47.001727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0698dd7f-3088-4302-99c3-d687d3260ff6 req-293e9b46-1461-4731-a50e-a15ee4fecabd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.002945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0698dd7f-3088-4302-99c3-d687d3260ff6 req-293e9b46-1461-4731-a50e-a15ee4fecabd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.047448 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0698dd7f-3088-4302-99c3-d687d3260ff6 req-293e9b46-1461-4731-a50e-a15ee4fecabd service nova] Creating event network-changed:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch2-master-1 Feb 12 21:14:47.048059 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0698dd7f-3088-4302-99c3-d687d3260ff6 req-293e9b46-1461-4731-a50e-a15ee4fecabd service nova] Creating event network-vif-deleted:f256d627-df49-4516-b949-fc05f0dbf0bc for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:47.061646 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0698dd7f-3088-4302-99c3-d687d3260ff6 req-293e9b46-1461-4731-a50e-a15ee4fecabd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.100563 Feb 12 21:14:47.062823 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1690/3294] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:47.301120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:47.325017 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a445c0bb-d7f2-46a9-9bab-9995ef0a3f2f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.546471 Feb 12 21:14:47.326761 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1605/3295] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:46 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:47.352105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:47.353556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:47.361811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.361985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.364677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.368433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.462124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:47.462893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:47.475547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.477880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.480633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.482390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.688135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:47.737268 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5450426f-f269-427d-b71c-be613adde81c tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1222 microversion: 2.1 time: 0.278869 Feb 12 21:14:47.741871 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1606/3296] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:47 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1222 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:47.767300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-32d9d6bb-300f-4c54-b242-695b3e3bb7a0 req-03292ee9-f9a1-4a60-b825-a0e623cc2729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960de3e9-1389-4350-bc25-24153c9bcff3", "name": "network-vif-deleted", "tag": "48198fe1-46cc-4c9a-9c32-4aa850f6426a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:47.777787 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:47.777787 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:47.806403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-32d9d6bb-300f-4c54-b242-695b3e3bb7a0 req-03292ee9-f9a1-4a60-b825-a0e623cc2729 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.809676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-32d9d6bb-300f-4c54-b242-695b3e3bb7a0 req-03292ee9-f9a1-4a60-b825-a0e623cc2729 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.855446 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-32d9d6bb-300f-4c54-b242-695b3e3bb7a0 req-03292ee9-f9a1-4a60-b825-a0e623cc2729 service nova] Creating event network-vif-deleted:48198fe1-46cc-4c9a-9c32-4aa850f6426a for instance 960de3e9-1389-4350-bc25-24153c9bcff3 on nch1-master-1 Feb 12 21:14:47.867996 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-32d9d6bb-300f-4c54-b242-695b3e3bb7a0 req-03292ee9-f9a1-4a60-b825-a0e623cc2729 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124539 Feb 12 21:14:47.872308 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1607/3297] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:47.878585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:47.879536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:47.890680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.892306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:47.893309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:47.894189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.043610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.054919 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-676c3126-0ba9-45ec-bab4-c598becdc86c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1251 microversion: 2.1 time: 0.179953 Feb 12 21:14:48.057968 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1608/3298] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:47 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1251 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:48.064289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:48.064993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:48.088831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.089460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.090342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.090847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.141037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.167391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.176272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.176272 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc7f704e-a32a-4321-bdbd-e16d0864baf5 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2373 microversion: 2.42 time: 0.822726 Feb 12 21:14:48.181462 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1691/3299] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:47 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2373 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:48.220897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:48.221711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:48.238864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.241179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.247781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.249952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.750254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.761751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.766937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:48.777084 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fda8cace-189a-4d2e-bc32-dffdd92496da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.717211 Feb 12 21:14:48.782238 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1609/3300] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:48 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:48.789894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-587e74f9-fb85-40c3-a67e-649fb552c4e1 req-e375a721-2568-4f63-b0fb-b93dd6290825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2990b1d-7527-44c6-9a61-380b654541b6", "name": "network-vif-plugged", "status": "completed", "tag": "560cbda4-8c83-4286-ad46-6863e830ae96"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:48.806535 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:48.806535 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:48.831432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-587e74f9-fb85-40c3-a67e-649fb552c4e1 req-e375a721-2568-4f63-b0fb-b93dd6290825 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.832514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-587e74f9-fb85-40c3-a67e-649fb552c4e1 req-e375a721-2568-4f63-b0fb-b93dd6290825 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.863204 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-587e74f9-fb85-40c3-a67e-649fb552c4e1 req-e375a721-2568-4f63-b0fb-b93dd6290825 service nova] Creating event network-vif-plugged:560cbda4-8c83-4286-ad46-6863e830ae96 for instance d2990b1d-7527-44c6-9a61-380b654541b6 on nch1-master-1 Feb 12 21:14:48.873653 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-587e74f9-fb85-40c3-a67e-649fb552c4e1 req-e375a721-2568-4f63-b0fb-b93dd6290825 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089952 Feb 12 21:14:48.875177 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1610/3301] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:48.917865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:48.924256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:48.951379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.951379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.951379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:48.953247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:48.999588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:49.010028 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b338328d-9a0c-4b3e-b575-ff3db8bad889 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1669 microversion: 2.1 time: 0.825590 Feb 12 21:14:49.013659 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1692/3302] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:48 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1669 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:49.059041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:49.065862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:49.081215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.081215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.082613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.083404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.475357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:49.483627 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45e5a6e1-be56-424a-98ce-09b77cd4d0d8 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.604558 Feb 12 21:14:49.494469 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1611/3303] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:48 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:49.499589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:49.500504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:49.507534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.512509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.513622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.514342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.549643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:49.555107 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b679865-895a-4473-a774-bb64d588971d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93/ips" status: 200 len: 179 microversion: 2.1 time: 0.059247 Feb 12 21:14:49.561706 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1612/3304] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:14:49 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93/ips => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:49.564741 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff3edb97-68fb-4f0c-91e5-a626f84c2cae tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1278 microversion: 2.1 time: 0.549177 Feb 12 21:14:49.566560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:49.567240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:49.573335 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1693/3305] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:49 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1278 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:49.579035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ec5a6996-8b32-443a-9778-fb681b22989d req-2f3f02eb-cc34-43f7-9944-826dd5c44738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-deleted", "tag": "19dd89b0-f04c-47e0-b086-a93ccf42ad36"}, {"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-deleted", "tag": "d18f9305-c081-40ea-be43-4032e65318f6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:49.586935 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:49.586935 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:49.596607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.597272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.598326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.598925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.607647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ec5a6996-8b32-443a-9778-fb681b22989d req-2f3f02eb-cc34-43f7-9944-826dd5c44738 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.608100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ec5a6996-8b32-443a-9778-fb681b22989d req-2f3f02eb-cc34-43f7-9944-826dd5c44738 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.627871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ec5a6996-8b32-443a-9778-fb681b22989d req-2f3f02eb-cc34-43f7-9944-826dd5c44738 service nova] Creating event network-vif-deleted:19dd89b0-f04c-47e0-b086-a93ccf42ad36 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:49.628826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ec5a6996-8b32-443a-9778-fb681b22989d req-2f3f02eb-cc34-43f7-9944-826dd5c44738 service nova] Creating event network-vif-deleted:d18f9305-c081-40ea-be43-4032e65318f6 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:49.647397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ec5a6996-8b32-443a-9778-fb681b22989d req-2f3f02eb-cc34-43f7-9944-826dd5c44738 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072323 Feb 12 21:14:49.648244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1694/3306] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:49.654756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:49.655711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:49.667380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.669754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.694670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.694670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.694670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.694670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.709956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lazy-loading 'fault' on Instance uuid 960de3e9-1389-4350-bc25-24153c9bcff3 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:14:49.832754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d2b0036a1144a4a385b4c0fd4f9782', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a19875f98800434db2950efcf23ff3a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:49.845963 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-604272b3-dd84-4117-b0d7-eeef595aba15 tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 200 len: 1256 microversion: 2.1 time: 0.282914 Feb 12 21:14:49.853063 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1613/3307] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:49 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 1256 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:49.863225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:49.864575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:49.881391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.881863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.882673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:49.883117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:49.931753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:50.206583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:50.216170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:50.217891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:50.219122 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-512f9556-83cd-46cc-8426-99ba1c5d26c2 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 2327 microversion: 2.42 time: 0.569651 Feb 12 21:14:50.245852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1695/3308] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:49 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 2327 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:50.250633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:50.251338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:50.258515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.259223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.260030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.260936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.309276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:50.400126 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cb515902-1d54-4934-9301-fc145778dcc3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "DELETE /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 204 len: 0 microversion: 2.1 time: 0.545434 Feb 12 21:14:50.402490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1614/3309] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:49 2022] DELETE /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:50.406977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:50.407774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:50.426765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.429396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.429396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.429396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.732360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:50.742417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:50.744770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:50.768613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9d0b10d-8063-4059-93de-208f34de2dcc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.342877 Feb 12 21:14:50.780507 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1615/3310] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:50 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:50.780507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:50.780507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:50.784903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.785392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.786782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.787796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.896089 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7bbafae4-7279-4769-851d-8a31d6a326b0 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 204 len: 0 microversion: 2.1 time: 0.643562 Feb 12 21:14:50.898154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1696/3311] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:50 2022] DELETE /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:50.906543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:50.909857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:50.929967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.936779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:50.936779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:50.936779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.045624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.075308 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bffd7dc7-347e-423b-8d78-06caa890285d tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1675 microversion: 2.1 time: 0.294297 Feb 12 21:14:51.075308 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1616/3312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:50 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1675 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:51.081188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:51.082196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:51.089549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.090326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.091342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.092130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.356752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.370642 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6eb1c8b3-2445-4c4f-abb0-7ba50458d70f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.294324 Feb 12 21:14:51.371760 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1617/3313] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:51 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:51.385098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:51.389284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] [instance: 960de3e9-1389-4350-bc25-24153c9bcff3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:51.397993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.406654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.413410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.415978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da4cf299-d2e1-4806-9b0e-c99db2d100c3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1324 microversion: 2.1 time: 0.515949 Feb 12 21:14:51.417559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.419836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1697/3314] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:50 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1324 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:51.420566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.426331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:51.441878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:51.451672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.452769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.453907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.456191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.456915 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] HTTP exception thrown: Instance 960de3e9-1389-4350-bc25-24153c9bcff3 could not be found. Feb 12 21:14:51.457854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Returning 404 to user: Instance 960de3e9-1389-4350-bc25-24153c9bcff3 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:51.459396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d6cd1833-3100-41f8-8a47-75853b72461c tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3" status: 404 len: 111 microversion: 2.1 time: 0.082291 Feb 12 21:14:51.463268 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1618/3315] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:51 2022] GET /compute/v2.1/servers/960de3e9-1389-4350-bc25-24153c9bcff3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:14:51.467276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:51.467973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:51.476013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.476809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.477930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.478583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.566679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.586180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.588247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.590515 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98d11a4e-7da2-4078-8e4f-a5d99eec2470 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1604 microversion: 2.42 time: 0.129161 Feb 12 21:14:51.591317 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1619/3316] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:51 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:51.595933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90561735-3d00-4201-b43c-8d0474cc5deb tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] Calling method '.version_select at 0x7fa8fe0e1790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:51.682277 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90561735-3d00-4201-b43c-8d0474cc5deb tempest-ServersTestBootFromVolume-814782321 tempest-ServersTestBootFromVolume-814782321-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134015399" status: 202 len: 0 microversion: 2.1 time: 0.087862 Feb 12 21:14:51.682277 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1620/3317] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134015399 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:14:51.707216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5dd72891-b70e-4041-98bb-66cd76ad534e req-56399aea-db27-4ac7-a7db-05148595ed4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfec12ed-64c4-45af-a8a6-bc3e13a075b7", "name": "network-vif-deleted", "tag": "c24391d7-58a5-450b-bfb5-2e331131b9e0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:51.708737 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:51.708737 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:14:51.733153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5dd72891-b70e-4041-98bb-66cd76ad534e req-56399aea-db27-4ac7-a7db-05148595ed4d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.733739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5dd72891-b70e-4041-98bb-66cd76ad534e req-56399aea-db27-4ac7-a7db-05148595ed4d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.772869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5dd72891-b70e-4041-98bb-66cd76ad534e req-56399aea-db27-4ac7-a7db-05148595ed4d service nova] Creating event network-vif-deleted:c24391d7-58a5-450b-bfb5-2e331131b9e0 for instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 on nch1-master-1 Feb 12 21:14:51.784574 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5dd72891-b70e-4041-98bb-66cd76ad534e req-56399aea-db27-4ac7-a7db-05148595ed4d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081107 Feb 12 21:14:51.787990 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1621/3318] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:51.817547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:51.821207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:51.835487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.836018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.836832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:51.837282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:51.840281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:51.871175 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0d943d58-dae6-47ca-952c-bdea656dfd02 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1508 microversion: 2.1 time: 0.427768 Feb 12 21:14:51.872377 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1698/3319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:51 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1508 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:52.062738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.082474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.090759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:52.091258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:52.094262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.095706 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-79cdd16a-e966-480a-bda9-8e9df0247c4e tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.306360 Feb 12 21:14:52.109817 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1622/3320] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:51 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:52.123505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.138247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.142216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.144979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.389016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:52.391881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:52.396975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.397465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.398279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.398699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.551186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.568655 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a09b7798-a074-47c3-afd2-6241aaf736dd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1675 microversion: 2.1 time: 0.482171 Feb 12 21:14:52.569286 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1699/3321] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:52 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1675 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:52.583444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:52.585670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:52.604750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.606956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.608833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.609285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.719783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.730844 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc342129-a5b6-4dbd-8e7f-2d3130e66b8a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.346287 Feb 12 21:14:52.734859 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1623/3322] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:52 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:52.740814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:52.741569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:52.762209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.763469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.766540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.766540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.842815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.851062 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6116d8dd-5ef1-4134-a75f-6f2afccd4a3f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1521 microversion: 2.1 time: 0.275071 Feb 12 21:14:52.851667 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1700/3323] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:52 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:52.865292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.865775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.866252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lazy-loading 'fault' on Instance uuid cfec12ed-64c4-45af-a8a6-bc3e13a075b7 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:14:52.881943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:52.882615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:52.890178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.891592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.892640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.893288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.928286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.940082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.941816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85ec67db2e7425ba75e7a14eaf165e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992939bc41444299957b35468c7433c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:52.943035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-576be423-44f9-4241-8756-4e0738f50648 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 200 len: 1609 microversion: 2.42 time: 0.205864 Feb 12 21:14:52.951067 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1624/3324] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:52 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 1609 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:52.958073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:52.962262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:52.965248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.965695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:52.966517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:52.966958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:53.141641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:53.153260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d24e2e69-09cf-4c3a-9b79-9fe8603fe0df tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1521 microversion: 2.1 time: 0.275586 Feb 12 21:14:53.156011 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1701/3325] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:52 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:53.168756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:53.170442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:53.185115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:53.185920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:53.186901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:53.187529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:53.289699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:53.300190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40dc90f1-0b3c-4ce7-ac3b-36a8d46a8638 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1508 microversion: 2.1 time: 0.347702 Feb 12 21:14:53.314165 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1625/3326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:52 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:53.325166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1426971168"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:53.330146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:53.343418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:53.343868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:53.344667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:53.345289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:53.653825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:53.662112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:53.673389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:53.674641 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b8120e97-70cc-447c-9553-6210c83270e2 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.519096 Feb 12 21:14:53.675330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1702/3327] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:53 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:53.689563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:53.690171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:53.705702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:53.706175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:53.707496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:53.707671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.064411 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8236561-3e2a-44d7-85d2-f9dca22921e1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6/action" status: 202 len: 0 microversion: 2.1 time: 0.746336 Feb 12 21:14:54.074176 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1626/3328] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:14:53 2022] POST /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:14:54.080860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:54.082989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:54.094598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.095768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.096830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.098633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.490448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:54.499687 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03ee6acb-fee5-49e2-b084-a76ff03cf2bb tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1675 microversion: 2.1 time: 0.823449 Feb 12 21:14:54.506459 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1703/3329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:53 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1675 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:54.511839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-771dc5e8-e2cb-4782-994d-3637b200fae7 req-c69e0ade-90a3-4423-9dfa-b025df0c7794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98699803-4a38-4e99-96bc-3fee5a9a03ef", "tag": "2a51fe93-35ae-44b2-b89e-8ca15e049fcb"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:54.513876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:54.519059 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:54.519059 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:54.524251 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9fe957f5-f9dd-482b-b3b3-027317ecaca2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.447957 Feb 12 21:14:54.534989 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1627/3330] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:54 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:54.537757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-771dc5e8-e2cb-4782-994d-3637b200fae7 req-c69e0ade-90a3-4423-9dfa-b025df0c7794 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.538343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-771dc5e8-e2cb-4782-994d-3637b200fae7 req-c69e0ade-90a3-4423-9dfa-b025df0c7794 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.542260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:54.543173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:54.552057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.553037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.554292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.589548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.590540 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-771dc5e8-e2cb-4782-994d-3637b200fae7 req-c69e0ade-90a3-4423-9dfa-b025df0c7794 service nova] Creating event network-changed:2a51fe93-35ae-44b2-b89e-8ca15e049fcb for instance 98699803-4a38-4e99-96bc-3fee5a9a03ef on nch2-master-1 Feb 12 21:14:54.590540 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-771dc5e8-e2cb-4782-994d-3637b200fae7 req-c69e0ade-90a3-4423-9dfa-b025df0c7794 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058603 Feb 12 21:14:54.590540 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1704/3331] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:54.590540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac95bfc8-36e5-4c99-8e3a-938a13b3f51c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '.version_select at 0x7fa8fe0dcee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:54.590819 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] HTTP exception thrown: Instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 could not be found. Feb 12 21:14:54.590819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Returning 404 to user: Instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:54.590819 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43153296-8794-4cce-b06b-122a41919365 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 404 len: 111 microversion: 2.42 time: 0.041310 Feb 12 21:14:54.590819 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1628/3332] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:54 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:14:54.590819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:54.592526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:54.602995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.605398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:54.606609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:54.607967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:55.050762 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac95bfc8-36e5-4c99-8e3a-938a13b3f51c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/images/dc1ee9fe-10a7-498b-a219-99e95aae6681" status: 204 len: 0 microversion: 2.1 time: 0.481363 Feb 12 21:14:55.051348 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1705/3333] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:54 2022] DELETE /compute/v2.1/images/dc1ee9fe-10a7-498b-a219-99e95aae6681 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:55.056317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aed5e2d2-333c-476b-9db2-f4ab5a5a64c6 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '.version_select at 0x7fa8feaef280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:55.160941 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aed5e2d2-333c-476b-9db2-f4ab5a5a64c6 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136016200" status: 204 len: 0 microversion: 2.42 time: 0.108133 Feb 12 21:14:55.170821 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1706/3334] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:14:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136016200 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:14:55.178637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:55.181850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:55.210607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:55.217500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:55.223070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:55.224860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:55.420801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:55.443205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5436f2bb-12c2-451a-9dc8-548636598945 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1508 microversion: 2.1 time: 0.859057 Feb 12 21:14:55.447296 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1629/3335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:54 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1508 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:55.466721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8515ab6b-80a3-465e-a3ed-23cd0318e80a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '.version_select at 0x7fa8fde5a790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:55.499819 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8515ab6b-80a3-465e-a3ed-23cd0318e80a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Image not found. Feb 12 21:14:55.501429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8515ab6b-80a3-465e-a3ed-23cd0318e80a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:55.502489 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8515ab6b-80a3-465e-a3ed-23cd0318e80a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/images/dc1ee9fe-10a7-498b-a219-99e95aae6681" status: 404 len: 62 microversion: 2.1 time: 0.052407 Feb 12 21:14:55.506588 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1630/3336] 10.222.0.31 () {58 vars in 1232 bytes} [Sat Feb 12 21:14:55 2022] GET /compute/v2.1/images/dc1ee9fe-10a7-498b-a219-99e95aae6681 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:14:55.512296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:55.513142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:55.523188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:55.523872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:55.524601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:55.525232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:55.710745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:55.725117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:55.728842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:55.741682 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-12fcd945-8cd0-47db-bd22-aa29ce37662f tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.558946 Feb 12 21:14:55.741682 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1707/3337] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:55 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:55.741682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:55.741682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:55.763516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:55.764063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:55.764934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:55.765401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.268954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:56.282115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e73b173c-f313-4d64-a42c-a03a77580d17 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1539 microversion: 2.1 time: 0.773946 Feb 12 21:14:56.294421 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1631/3338] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:55 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1539 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:56.297666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:56.311636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:56.324514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:56.334893 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d755df77-9361-40e2-a336-51175b9a5be1 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1654 microversion: 2.1 time: 0.601902 Feb 12 21:14:56.341141 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1708/3339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:55 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1654 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:56.343642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.346048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.351038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.353806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-11e6b04b-66ff-401e-a413-4df4a75c3cbc req-f7a3e8be-3ff5-405f-af3d-fa19d3dc2283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252f22ce-8a26-45c9-8439-95e29bb12e93", "name": "network-vif-deleted", "tag": "4d9371f5-ec27-4fa7-88c2-454dd8a7b5ce"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:56.354631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.360095 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:56.360095 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:56.378550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-11e6b04b-66ff-401e-a413-4df4a75c3cbc req-f7a3e8be-3ff5-405f-af3d-fa19d3dc2283 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.379359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-11e6b04b-66ff-401e-a413-4df4a75c3cbc req-f7a3e8be-3ff5-405f-af3d-fa19d3dc2283 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.406837 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-11e6b04b-66ff-401e-a413-4df4a75c3cbc req-f7a3e8be-3ff5-405f-af3d-fa19d3dc2283 service nova] Creating event network-vif-deleted:4d9371f5-ec27-4fa7-88c2-454dd8a7b5ce for instance 252f22ce-8a26-45c9-8439-95e29bb12e93 on nch2-master-1 Feb 12 21:14:56.418978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-11e6b04b-66ff-401e-a413-4df4a75c3cbc req-f7a3e8be-3ff5-405f-af3d-fa19d3dc2283 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076396 Feb 12 21:14:56.426359 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1709/3340] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:56.462493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:56.464341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:56.476033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.476603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.477496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.477981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.537532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.538362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.539018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'fault' on Instance uuid 29124640-751c-4a46-bc3d-dd666846f4a9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:14:56.728111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:56.762152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d39423b1-36e2-412b-a6fb-d7f0b5247f2f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 200 len: 1311 microversion: 2.1 time: 0.303886 Feb 12 21:14:56.763334 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1710/3341] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:56 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:56.770895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ee9210e3-4cbb-4ab8-9c11-2529921d6506 req-9fdbe8ac-50e3-4622-88cc-530164a112ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29124640-751c-4a46-bc3d-dd666846f4a9", "name": "network-vif-deleted", "tag": "8717c413-817e-4ebb-805c-d6db55691f8e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:56.787613 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:56.787613 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:56.819101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ee9210e3-4cbb-4ab8-9c11-2529921d6506 req-9fdbe8ac-50e3-4622-88cc-530164a112ce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.827822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ee9210e3-4cbb-4ab8-9c11-2529921d6506 req-9fdbe8ac-50e3-4622-88cc-530164a112ce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.833492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ee9210e3-4cbb-4ab8-9c11-2529921d6506 req-9fdbe8ac-50e3-4622-88cc-530164a112ce service nova] Creating event network-vif-deleted:8717c413-817e-4ebb-805c-d6db55691f8e for instance 29124640-751c-4a46-bc3d-dd666846f4a9 on nch1-master-1 Feb 12 21:14:56.840044 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ee9210e3-4cbb-4ab8-9c11-2529921d6506 req-9fdbe8ac-50e3-4622-88cc-530164a112ce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075164 Feb 12 21:14:56.840906 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1711/3342] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:56.846909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:56.847753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:56.854796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.855702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:56.860583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:56.862230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.039057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:57.048224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-29e522a1-d472-4832-9bed-144b3767a266 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.762175 Feb 12 21:14:57.048807 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1632/3343] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:56 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:57.185197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:57.195373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:57.199629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:57.213775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0c6cf6c6-b1c5-4385-a17a-d3ed4167acf4 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.371369 Feb 12 21:14:57.214657 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1712/3344] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:56 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:57.300978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:57.301631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:57.311640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.312490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.313748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.314406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.357115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:57.358130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:57.366917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.367745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.371083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.372373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.612298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:57.620569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be992db8-c5fd-403e-a2a6-8de81d6d2449 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1496 microversion: 2.1 time: 0.267544 Feb 12 21:14:57.630969 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1713/3345] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:57 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:57.778696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:57.780162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: 29124640-751c-4a46-bc3d-dd666846f4a9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:57.793445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.796033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.796033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.796033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.835480 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Instance 29124640-751c-4a46-bc3d-dd666846f4a9 could not be found. Feb 12 21:14:57.839218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 404 to user: Instance 29124640-751c-4a46-bc3d-dd666846f4a9 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:14:57.845697 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fdf91b9f-ba99-4181-9f4b-c92694bdc311 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9" status: 404 len: 111 microversion: 2.1 time: 0.070660 Feb 12 21:14:57.849831 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1714/3346] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:57 2022] GET /compute/v2.1/servers/29124640-751c-4a46-bc3d-dd666846f4a9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:14:57.854839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:57.862121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:57.870184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.875644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.877227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:57.877227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:57.920082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:57.927405 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ca2b5121-dcf9-4a6d-8f7c-387717103967 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1539 microversion: 2.1 time: 0.630018 Feb 12 21:14:57.940430 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1633/3347] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:57 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1539 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:57.940638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:14:58.069325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:58.074883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:58.094174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:58.098432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:58.098432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:58.098432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:58.411360 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98625f23-adfa-4a8c-96ac-2a63e54ea803 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 204 len: 0 microversion: 2.1 time: 0.559608 Feb 12 21:14:58.416094 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1715/3348] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:57 2022] DELETE /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:14:58.420764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:58.421680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:58.445179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:58.446202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:58.447338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:58.448227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:58.662305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:58.674814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:58.676528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:58.677670 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-838e6eef-d398-4299-b7f6-df83a4106707 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.262332 Feb 12 21:14:58.678237 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1716/3349] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:58 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:14:58.683853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:58.684357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:58.691379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:58.691829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:58.692627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:58.693060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.200898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:59.214832 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38224a39-7cae-4665-a98e-945201f6c9e2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.533703 Feb 12 21:14:59.214832 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1717/3350] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:58 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:59.221267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:59.226255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:59.244444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.246057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.247033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.247587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.354102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:59.366493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:59.367025 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2795d9af-b844-4f2d-9aca-f1cc5a76e988 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1298 microversion: 2.1 time: 0.148734 Feb 12 21:14:59.377973 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b1a2896-f946-430c-b956-68a43ada4ac9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 1.315318 Feb 12 21:14:59.389161 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1718/3351] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:59 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:59.389502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1634/3352] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:58 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:14:59.389605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d6e172c4-820a-44ec-a270-51a54c4ed831 req-ffcd1a5f-a1a8-451c-b22e-eb7477758e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "252f22ce-8a26-45c9-8439-95e29bb12e93", "name": "network-vif-deleted", "tag": "735421c7-998f-4aad-ae4f-0ba9e9eff209"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:14:59.389605 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:14:59.389605 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:14:59.395070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:59.396765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:59.409718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d6e172c4-820a-44ec-a270-51a54c4ed831 req-ffcd1a5f-a1a8-451c-b22e-eb7477758e05 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.415894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d6e172c4-820a-44ec-a270-51a54c4ed831 req-ffcd1a5f-a1a8-451c-b22e-eb7477758e05 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.416223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.416223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.416223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.416223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.425030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d6e172c4-820a-44ec-a270-51a54c4ed831 req-ffcd1a5f-a1a8-451c-b22e-eb7477758e05 service nova] Creating event network-vif-deleted:735421c7-998f-4aad-ae4f-0ba9e9eff209 for instance 252f22ce-8a26-45c9-8439-95e29bb12e93 on nch2-master-1 Feb 12 21:14:59.430352 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d6e172c4-820a-44ec-a270-51a54c4ed831 req-ffcd1a5f-a1a8-451c-b22e-eb7477758e05 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050399 Feb 12 21:14:59.432755 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1719/3353] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:14:59.712227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:59.712947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:59.719387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:14:59.737252 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c6d7bd3-8637-42ca-b7ae-989ca135363c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1521 microversion: 2.1 time: 0.356367 Feb 12 21:14:59.740289 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1635/3354] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:14:59 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:14:59.752783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.754465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.757010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.757010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.762750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:14:59.769265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:14:59.784271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.784815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.786959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:14:59.788702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:14:59.848310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:15:00.157606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.168129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.171546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.172767 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4531de58-b3f3-4782-b63b-28c9ce9ce375 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.475586 Feb 12 21:15:00.173657 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1720/3355] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:14:59 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:00.186323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-cce7aef7-6eaa-423a-bad6-67de9c17c93e req-3e0e15da-4d1e-42cb-ac13-5c6134606881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2990b1d-7527-44c6-9a61-380b654541b6", "name": "network-vif-plugged", "status": "completed", "tag": "560cbda4-8c83-4286-ad46-6863e830ae96"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:00.187943 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:00.187943 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:00.205772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cce7aef7-6eaa-423a-bad6-67de9c17c93e req-3e0e15da-4d1e-42cb-ac13-5c6134606881 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.206469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cce7aef7-6eaa-423a-bad6-67de9c17c93e req-3e0e15da-4d1e-42cb-ac13-5c6134606881 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.226228 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-cce7aef7-6eaa-423a-bad6-67de9c17c93e req-3e0e15da-4d1e-42cb-ac13-5c6134606881 service nova] Creating event network-vif-plugged:560cbda4-8c83-4286-ad46-6863e830ae96 for instance d2990b1d-7527-44c6-9a61-380b654541b6 on nch1-master-1 Feb 12 21:15:00.245737 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-cce7aef7-6eaa-423a-bad6-67de9c17c93e req-3e0e15da-4d1e-42cb-ac13-5c6134606881 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069435 Feb 12 21:15:00.254148 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1721/3356] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:00.261948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:00.262678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:00.278034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.278516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.279318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.279757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.364804 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50b8e103-0c44-4411-aa48-d1651a848271 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 204 len: 0 microversion: 2.1 time: 0.608271 Feb 12 21:15:00.367382 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1636/3357] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:14:59 2022] DELETE /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:15:00.377034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:00.379088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:00.384966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.386634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.387888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.388541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.508661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.517091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-14f07be8-43af-4679-b6ea-95d533cd6d16 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.260631 Feb 12 21:15:00.517712 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1722/3358] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:00 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:00.522723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:00.523781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:00.531770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.533836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.533836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.533836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.568170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.568170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.568170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lazy-loading 'fault' on Instance uuid 252f22ce-8a26-45c9-8439-95e29bb12e93 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:00.602047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.610325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1507154a-2d34-429a-9e55-42f133e3aecb tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1527 microversion: 2.1 time: 0.237793 Feb 12 21:15:00.611094 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1637/3359] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:00 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1527 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:00.615492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:00.616140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:00.623288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.624057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.625306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:00.625977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:00.646974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f49587ae5a49a8bbb9f02e5b857eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b438902509da463ba94a98d99ffd1444', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.659519 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff5dad8a-1f96-49e0-a223-fee2dbb0e95c tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 200 len: 1303 microversion: 2.1 time: 0.140748 Feb 12 21:15:00.660115 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1723/3360] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:00 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:00.942013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:00.942306 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0cd0b4bb-48c7-492c-9da6-43ed52977a85 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.329811 Feb 12 21:15:00.942961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1638/3361] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:00 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:01.196872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:01.197716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:01.205909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.207962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.207962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.207962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.513968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:01.535938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:01.538198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:01.552813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.560108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:01.561117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.561797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:01.561906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.561988 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5f18047-dee8-45d7-aca0-3bf3f9140d01 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.367377 Feb 12 21:15:01.569085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.581728 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1724/3362] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:01 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:01.627673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:01.628559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:01.645659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.647142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.647849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.648513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.864841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:01.875300 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f8eb593b-93fe-4088-9764-8c67dc4cab4c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1527 microversion: 2.1 time: 0.251511 Feb 12 21:15:01.876493 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1725/3363] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:01 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1527 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:01.881314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:01.882124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:01.888683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:01.897510 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce96a6e8-c966-461a-a926-5be01a8bc99f tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.366638 Feb 12 21:15:01.898692 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1639/3364] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:01 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:01.906995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.911289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.911289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.911289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.929693 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] HTTP exception thrown: Instance 252f22ce-8a26-45c9-8439-95e29bb12e93 could not be found. Feb 12 21:15:01.936447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Returning 404 to user: Instance 252f22ce-8a26-45c9-8439-95e29bb12e93 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:01.936447 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a97f8a7e-009a-4782-a4d1-48ab388d8e5e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 404 len: 111 microversion: 2.1 time: 0.053458 Feb 12 21:15:01.936447 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1726/3365] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:01 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:01.965141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:01.966226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:01.973200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.975694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:01.975694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:01.976227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:02.197268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:02.212503 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8cf6688e-a897-4cb0-9710-4c1e3bf805f2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.253091 Feb 12 21:15:02.217861 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1640/3366] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:01 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:02.597769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:02.604298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:02.607986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:02.608767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:02.609864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:02.610575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:02.899574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:02.901311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:02.923992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:02.924567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:02.930326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:02.931439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.099548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:03.120752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:03.122331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:03.123773 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d11bcc5c-9191-4808-b3c4-a5a9fd376988 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.539121 Feb 12 21:15:03.136108 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1727/3367] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:02 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:03.141818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:03.142669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:03.149556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:03.150269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.151693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:03.152394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.290673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:03.301443 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5bd9e85f-ccbb-4964-8821-823c75569357 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1527 microversion: 2.1 time: 0.408123 Feb 12 21:15:03.302559 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1641/3368] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:02 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1527 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:03.309002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:03.313405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:03.317321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:03.318019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.318824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:03.319427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.515011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:03.519678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:03.523910 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e29d2de9-924b-4f99-9645-d2e736591917 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.219195 Feb 12 21:15:03.533901 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0125cc3-4f00-4196-b332-275398fa5dab tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.390722 Feb 12 21:15:03.535508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1642/3369] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:03 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:03.538891 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1728/3370] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:03 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:03.542852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6e752376-15ad-472f-a5c7-be74c4ede7fb req-73d9162b-2c9c-4389-b402-7d417658777e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98699803-4a38-4e99-96bc-3fee5a9a03ef", "name": "network-vif-plugged", "status": "completed", "tag": "2a51fe93-35ae-44b2-b89e-8ca15e049fcb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:03.544723 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:03.544723 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:03.553627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e752376-15ad-472f-a5c7-be74c4ede7fb req-73d9162b-2c9c-4389-b402-7d417658777e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:03.554075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e752376-15ad-472f-a5c7-be74c4ede7fb req-73d9162b-2c9c-4389-b402-7d417658777e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.565831 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6e752376-15ad-472f-a5c7-be74c4ede7fb req-73d9162b-2c9c-4389-b402-7d417658777e service nova] Creating event network-vif-plugged:2a51fe93-35ae-44b2-b89e-8ca15e049fcb for instance 98699803-4a38-4e99-96bc-3fee5a9a03ef on nch2-master-1 Feb 12 21:15:03.573342 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6e752376-15ad-472f-a5c7-be74c4ede7fb req-73d9162b-2c9c-4389-b402-7d417658777e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034533 Feb 12 21:15:03.575245 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1643/3371] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:03.661584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-db4fae29-b352-47ee-9795-55bf1c192279 req-561b7cb0-cad7-4291-8c98-a12736573224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2990b1d-7527-44c6-9a61-380b654541b6", "name": "network-vif-deleted", "tag": "560cbda4-8c83-4286-ad46-6863e830ae96"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:03.664614 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:03.664614 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:03.684213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-db4fae29-b352-47ee-9795-55bf1c192279 req-561b7cb0-cad7-4291-8c98-a12736573224 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:03.685030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-db4fae29-b352-47ee-9795-55bf1c192279 req-561b7cb0-cad7-4291-8c98-a12736573224 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:03.700287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-db4fae29-b352-47ee-9795-55bf1c192279 req-561b7cb0-cad7-4291-8c98-a12736573224 service nova] Creating event network-vif-deleted:560cbda4-8c83-4286-ad46-6863e830ae96 for instance d2990b1d-7527-44c6-9a61-380b654541b6 on nch1-master-1 Feb 12 21:15:03.706176 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-db4fae29-b352-47ee-9795-55bf1c192279 req-561b7cb0-cad7-4291-8c98-a12736573224 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059073 Feb 12 21:15:03.711235 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1729/3372] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:04.143648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:04.145086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:04.153316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.154073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.155128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.155673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.420407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lazy-loading 'fault' on Instance uuid d2990b1d-7527-44c6-9a61-380b654541b6 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:04.423963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:04.433300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:04.435348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:04.436613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed879dea-fe3f-42ff-be2a-3b93dc5e9027 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.297343 Feb 12 21:15:04.437222 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1644/3373] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:04 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:15:04.450694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:04.451408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:04.464316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.465129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.466468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.467399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.486071 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] HTTP exception thrown: Instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 could not be found. Feb 12 21:15:04.486988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Returning 404 to user: Instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:04.488056 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13cafe6e-fa55-403e-9d5f-d9df5d472183 tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "DELETE /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 404 len: 111 microversion: 2.42 time: 0.049548 Feb 12 21:15:04.488730 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1645/3374] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:15:04 2022] DELETE /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:04.497498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:04.498556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] [instance: cfec12ed-64c4-45af-a8a6-bc3e13a075b7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:04.506454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.507045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.507962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.508479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.530119 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] HTTP exception thrown: Instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 could not be found. Feb 12 21:15:04.530977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] Returning 404 to user: Instance cfec12ed-64c4-45af-a8a6-bc3e13a075b7 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:04.532038 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5da0f16-319e-4607-ab7b-1aa9fb5f3eda tempest-TaggedBootDevicesTest_v242-633755402 tempest-TaggedBootDevicesTest_v242-633755402-project] 10.222.0.31 "GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7" status: 404 len: 111 microversion: 2.42 time: 0.038903 Feb 12 21:15:04.533274 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1646/3375] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:04 2022] GET /compute/v2.1/servers/cfec12ed-64c4-45af-a8a6-bc3e13a075b7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:15:04.547450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:04.548092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:04.555237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.555893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.556777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.557903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.736861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:04.757294 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d9cdfdd-0860-4dba-bd3b-ac0e240da08e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1318 microversion: 2.1 time: 0.203290 Feb 12 21:15:04.757294 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1647/3376] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:04 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:04.757294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:04.757294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:04.761903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.762646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.763676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:04.764331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:04.815535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:04.832107 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a825c70-2ce8-4f58-92e8-b25f0eda3508 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 200 len: 1314 microversion: 2.1 time: 0.512268 Feb 12 21:15:04.843766 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1730/3377] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:04 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:04.937098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:04.946833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-efbc26d5-388f-41a6-b486-3f95ec598f7c tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1523 microversion: 2.1 time: 0.197821 Feb 12 21:15:04.958389 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1648/3378] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:04 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:05.455655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.456418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.463631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.465766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.466821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.467270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.589851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-148b0fd4-0bfb-4d82-880e-16bbad9d71b9 req-a2818c36-5308-4e94-88a0-86bc26126df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "name": "network-vif-plugged", "status": "completed", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:05.591878 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:05.591878 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:05.599984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-148b0fd4-0bfb-4d82-880e-16bbad9d71b9 req-a2818c36-5308-4e94-88a0-86bc26126df5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.600577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-148b0fd4-0bfb-4d82-880e-16bbad9d71b9 req-a2818c36-5308-4e94-88a0-86bc26126df5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.613115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-148b0fd4-0bfb-4d82-880e-16bbad9d71b9 req-a2818c36-5308-4e94-88a0-86bc26126df5 service nova] Creating event network-vif-plugged:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch2-master-1 Feb 12 21:15:05.622247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-148b0fd4-0bfb-4d82-880e-16bbad9d71b9 req-a2818c36-5308-4e94-88a0-86bc26126df5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036306 Feb 12 21:15:05.623176 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1649/3379] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:05.688762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.689378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.699572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:05.702346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.703039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.705578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.706049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.709764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:05.711824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:05.713770 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-986bde32-2ca7-428d-b8a4-18fa06e6bb9c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.261889 Feb 12 21:15:05.721072 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1731/3380] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:05 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:05.726537 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] HTTP exception thrown: Instance 252f22ce-8a26-45c9-8439-95e29bb12e93 could not be found. Feb 12 21:15:05.726537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Returning 404 to user: Instance 252f22ce-8a26-45c9-8439-95e29bb12e93 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:05.726943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-479f80fd-892f-49d4-9826-5dd08c99e87e tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "DELETE /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 404 len: 111 microversion: 2.1 time: 0.043575 Feb 12 21:15:05.727488 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1650/3381] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:05 2022] DELETE /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:05.730646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4dce94c8-8f31-4f80-a5e1-d5fd8bf504bb req-8eda0add-7ede-42ce-9c32-6ef7605bdfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4a76f8f-ed14-4d6c-9296-e0e3113005c5", "name": "network-vif-deleted", "tag": "5f4e3cbc-9227-49a5-bcc1-1d8f6884d82a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:05.733510 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:05.733510 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:05.738964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.739773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 252f22ce-8a26-45c9-8439-95e29bb12e93] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.740938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4dce94c8-8f31-4f80-a5e1-d5fd8bf504bb req-8eda0add-7ede-42ce-9c32-6ef7605bdfb2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.741525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4dce94c8-8f31-4f80-a5e1-d5fd8bf504bb req-8eda0add-7ede-42ce-9c32-6ef7605bdfb2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.754349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4dce94c8-8f31-4f80-a5e1-d5fd8bf504bb req-8eda0add-7ede-42ce-9c32-6ef7605bdfb2 service nova] Creating event network-vif-deleted:5f4e3cbc-9227-49a5-bcc1-1d8f6884d82a for instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 on nch1-master-1 Feb 12 21:15:05.755922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.755922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.756355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.757100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.762114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4dce94c8-8f31-4f80-a5e1-d5fd8bf504bb req-8eda0add-7ede-42ce-9c32-6ef7605bdfb2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039085 Feb 12 21:15:05.763179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1732/3382] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:05.773736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.774604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.782667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.783890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.784920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.785813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.794362 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] HTTP exception thrown: Instance 252f22ce-8a26-45c9-8439-95e29bb12e93 could not be found. Feb 12 21:15:05.796272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Returning 404 to user: Instance 252f22ce-8a26-45c9-8439-95e29bb12e93 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:05.797138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-949e4bf4-a81d-4c65-a2f1-a88b70e7b5f3 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93" status: 404 len: 111 microversion: 2.1 time: 0.062556 Feb 12 21:15:05.797736 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1651/3383] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:05 2022] GET /compute/v2.1/servers/252f22ce-8a26-45c9-8439-95e29bb12e93 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:05.806957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.807841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.814492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.814985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.815775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.816276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.830412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] HTTP exception thrown: Instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a could not be found. Feb 12 21:15:05.831256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Returning 404 to user: Instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:05.832104 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4a453ff-d9be-42ba-bcb3-1607ec14bccd tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "DELETE /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 404 len: 111 microversion: 2.1 time: 0.029805 Feb 12 21:15:05.832904 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1652/3384] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:05 2022] DELETE /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:05.842226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.842833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] [instance: 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.849819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.850271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.851800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.852599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.871247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] HTTP exception thrown: Instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a could not be found. Feb 12 21:15:05.872211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] Returning 404 to user: Instance 34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:05.874040 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b93dbd5-a012-4fc0-92e0-24f5125c0542 tempest-ServersTestMultiNic-1705446443 tempest-ServersTestMultiNic-1705446443-project] 10.222.0.31 "GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a" status: 404 len: 111 microversion: 2.1 time: 0.037081 Feb 12 21:15:05.874784 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1653/3385] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:05 2022] GET /compute/v2.1/servers/34548d90-c5a2-4ca1-a6a5-ef0e0c37a81a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:05.887801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.890111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.902463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.903424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.904531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.905397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.923738 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance d2990b1d-7527-44c6-9a61-380b654541b6 could not be found. Feb 12 21:15:05.924460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance d2990b1d-7527-44c6-9a61-380b654541b6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:05.926075 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45f6faae-c9d5-47a8-92a5-e60281647fa5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 404 len: 111 microversion: 2.1 time: 0.049054 Feb 12 21:15:05.927053 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1654/3386] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:05 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:05.971159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:05.974746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:05.975551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:05.987493 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da842251-7a12-463d-8e37-59441cc6695b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1508 microversion: 2.1 time: 0.218112 Feb 12 21:15:05.990469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.998560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.998560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:05.998560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:05.998885 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1733/3387] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:05 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:06.050532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:06.053159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:06.053753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lazy-loading 'fault' on Instance uuid c4a76f8f-ed14-4d6c-9296-e0e3113005c5 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:06.111386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-792473556", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:06.165459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75cf4e88d6e4dcc82408554aa0cb6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9fbd43632c4530b8d993cde9cd2106', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:06.178082 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60458523-7f47-4758-8d17-ce78b29d2373 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 200 len: 1312 microversion: 2.1 time: 0.216847 Feb 12 21:15:06.180249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] validate_networks() for [('46e8ba15-abd6-4b1e-957e-9d3052ac4ccd', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:15:06.189847 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1655/3388] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:05 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:06.662877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:15:06.664866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:15:06.664866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:15:06.664866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:15:06.664866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:15:06.675459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:06.676025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:06.676879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:06.677326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:06.710920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:06.718003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Getting quotas for user 6fb5c74958944d26a2e0297f8a470631 and project 0da6753f4d6946489d582ef43d0da4f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:06.733615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:15:06.735195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:06.735986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:06.747994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:06.748886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:06.754011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:06.754804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:06.755366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:15:06.921552 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a4f477d-366b-4369-bb56-a34aa33afb78 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.815399 Feb 12 21:15:06.924265 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1734/3389] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:15:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:15:06.934662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-490d64e5-0519-4bf8-a1b4-89716f4de68a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:06.935623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-490d64e5-0519-4bf8-a1b4-89716f4de68a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:07.013798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:07.026567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-490d64e5-0519-4bf8-a1b4-89716f4de68a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:07.038006 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-490d64e5-0519-4bf8-a1b4-89716f4de68a tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1224 microversion: 2.1 time: 0.107713 Feb 12 21:15:07.038604 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1735/3390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:06 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:07.040590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:07.047425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:07.050337 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2b9fb44-9782-4433-a978-63460f4277fc tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.318624 Feb 12 21:15:07.051402 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1656/3391] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:06 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:15:07.205391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:07.206203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] [instance: c4a76f8f-ed14-4d6c-9296-e0e3113005c5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:07.216535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:07.216992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:07.217948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:07.218792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:07.243214 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] HTTP exception thrown: Instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 could not be found. Feb 12 21:15:07.243214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] Returning 404 to user: Instance c4a76f8f-ed14-4d6c-9296-e0e3113005c5 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:07.243214 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77a18449-f8e7-4eec-8935-6125c6d7aee2 tempest-ServerRescueNegativeTestJSON-1489443139 tempest-ServerRescueNegativeTestJSON-1489443139-project] 10.222.0.31 "GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5" status: 404 len: 111 microversion: 2.1 time: 0.037798 Feb 12 21:15:07.243214 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1736/3392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:07 2022] GET /compute/v2.1/servers/c4a76f8f-ed14-4d6c-9296-e0e3113005c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:08.058672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:08.060035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:08.071809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:08.073341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:08.074533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:08.075202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:08.078874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:08.079506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:08.101207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:08.103239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:08.106433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:08.107556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:08.303197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:08.319670 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5cecff25-183d-4e6d-b7be-05b34b0a11a7 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1228 microversion: 2.1 time: 0.266767 Feb 12 21:15:08.334364 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1657/3393] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:08 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1228 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:08.455628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:08.471038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:08.480071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:08.482675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6c64024-e3d2-4b34-a61a-3ac0d0074dda tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1729 microversion: 2.20 time: 0.412391 Feb 12 21:15:08.498051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1737/3394] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:08 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1729 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:09.343511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:09.344989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:09.354935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:09.356121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:09.357146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:09.358547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:09.504609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:09.505645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:09.532636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:09.533381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:09.537054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:09.537054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:09.553404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:09.575939 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43236b4c-2016-4cf5-8477-3da053e89f37 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1276 microversion: 2.1 time: 0.239734 Feb 12 21:15:09.588768 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1658/3395] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:09 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:10.004239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d348faed-78ec-43fc-8464-e57b63f9a261"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:10.008003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:10.012929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:10.013705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:10.014689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:10.015461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:10.136267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:10.153929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:10.155949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:10.158085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5de2c2d1-d20b-41d0-9e54-90ed2fd0722d tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1716 microversion: 2.20 time: 0.657872 Feb 12 21:15:10.159383 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1738/3396] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:09 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1716 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:15:10.593403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:10.594664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:10.604214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:10.605168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:10.606231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:10.606960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:10.844014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:10.854431 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e318068-6c60-4da8-b3bc-adf18b770850 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1282 microversion: 2.1 time: 0.264352 Feb 12 21:15:10.855586 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1739/3397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:10 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:11.040980 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77668828-c7ef-4d5b-b15c-fdc204310e87 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.041017 Feb 12 21:15:11.041958 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1659/3398] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:15:09 2022] POST /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:11.878573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:11.879950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:11.890107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:11.890107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:11.890107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:11.890107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:12.037905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:12.054253 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-94e78034-c5ff-4491-b21e-a7e54d18ae99 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1282 microversion: 2.1 time: 0.179377 Feb 12 21:15:12.055287 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1740/3399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:11 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:13.085716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:13.087178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:13.096794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:13.097546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:13.098860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:13.099463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:13.295995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:13.305146 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c635d5a-83e1-44e6-8a44-f34baf1de4bc tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.235932 Feb 12 21:15:13.306033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1660/3400] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:13 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:14.334554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:14.335715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:14.349631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:14.349631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:14.349631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:14.349631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:14.657683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ba363d53-25ab-4627-b3f2-337a96d5db4a req-e50bc66c-ce16-4e79-8d54-04b9ace27853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ef5583-485a-4948-bfe8-4efa6b08acef", "tag": "d91a8af2-494a-4edb-b217-b53420b63976"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:14.660215 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:14.660215 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:14.670348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ba363d53-25ab-4627-b3f2-337a96d5db4a req-e50bc66c-ce16-4e79-8d54-04b9ace27853 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:14.671118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ba363d53-25ab-4627-b3f2-337a96d5db4a req-e50bc66c-ce16-4e79-8d54-04b9ace27853 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:14.685292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ba363d53-25ab-4627-b3f2-337a96d5db4a req-e50bc66c-ce16-4e79-8d54-04b9ace27853 service nova] Creating event network-changed:d91a8af2-494a-4edb-b217-b53420b63976 for instance d5ef5583-485a-4948-bfe8-4efa6b08acef on nch1-master-1 Feb 12 21:15:14.695024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ba363d53-25ab-4627-b3f2-337a96d5db4a req-e50bc66c-ce16-4e79-8d54-04b9ace27853 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041141 Feb 12 21:15:14.698048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1661/3401] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:14.757532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:14.767013 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-87f5e2c9-7627-49ed-9f00-3b26bc89b559 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.435669 Feb 12 21:15:14.780709 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1741/3402] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:14 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:15.496900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d348faed-78ec-43fc-8464-e57b63f9a261"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:15.498558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:15.505604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:15.506371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:15.507279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:15.507820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:15.649409 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] HTTP exception thrown: Invalid volume: volume d348faed-78ec-43fc-8464-e57b63f9a261 is already attached to instances: 98699803-4a38-4e99-96bc-3fee5a9a03ef Feb 12 21:15:15.651114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Returning 400 to user: Invalid volume: volume d348faed-78ec-43fc-8464-e57b63f9a261 is already attached to instances: 98699803-4a38-4e99-96bc-3fee5a9a03ef {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:15.653776 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-95d9ceb8-8326-4c5d-8498-17920059a2e8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159520 Feb 12 21:15:15.654717 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1662/3403] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:15:15 2022] POST /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:15.737254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:15.737254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:15.742741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:15.743522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:15.745521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:15.746048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:15.785713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:15.786385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:15.798815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:15.799514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:15.805927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:15.806746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:15.897024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'services' on Instance uuid 98699803-4a38-4e99-96bc-3fee5a9a03ef {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:16.112496 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fde8bfff-a148-4eba-a832-dad7fc507f0a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments/d348faed-78ec-43fc-8464-e57b63f9a261" status: 202 len: 0 microversion: 2.1 time: 0.383785 Feb 12 21:15:16.114090 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1742/3404] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:15:15 2022] DELETE /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments/d348faed-78ec-43fc-8464-e57b63f9a261 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:16.158763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:16.176120 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c28f7323-0015-4b24-8b86-106f96ea50c6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.391882 Feb 12 21:15:16.181134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1663/3405] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:15 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:16.187350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:16.188278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:16.196264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:16.199617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:16.202307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:16.202307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:16.251575 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0684629-ce97-4392-bbed-c2223a0ea567 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068514 Feb 12 21:15:16.253133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1664/3406] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:15:16 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:16.319877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-803914978", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:16.373864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:15:17.006618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:15:17.007128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:15:17.007711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:15:17.008213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:15:17.008810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:15:17.020525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:17.021379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:17.022357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:17.023048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:17.049877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:17.056020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:17.085991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:15:17.095595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:15:17.198560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:17.199830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:17.207804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:17.208258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:17.209055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:17.209525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:17.243196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb623704-5f89-4674-b3ea-b6f2c0c59aaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123884 Feb 12 21:15:17.243849 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1743/3407] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:15:17.254438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bfc61197-99b2-4a06-bf08-9027e3b75742 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:17.255281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bfc61197-99b2-4a06-bf08-9027e3b75742 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:17.323984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bfc61197-99b2-4a06-bf08-9027e3b75742 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:17.332909 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bfc61197-99b2-4a06-bf08-9027e3b75742 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1214 microversion: 2.1 time: 0.081733 Feb 12 21:15:17.339916 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1744/3408] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:17 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:17.346552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:17.347746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:17.357793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:17.362335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:17.362335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:17.362335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:17.416777 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8fb93c78-4253-49c0-b968-03d8a0db3841 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074809 Feb 12 21:15:17.417680 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1745/3409] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:15:17 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:15:17.591706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:17.600689 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d16e4f6e-7442-479a-a819-f0f8b9e429f6 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.406193 Feb 12 21:15:17.602787 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1665/3410] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:17 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:17.707281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1882727607", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "282c3200-9059-438c-a022-c732f83ca0af"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:17.780798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] validate_networks() for [('282c3200-9059-438c-a022-c732f83ca0af', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:15:18.281871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:15:18.282595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:15:18.282753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:15:18.283157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:15:18.283562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:15:18.293631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:18.294301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:18.296943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:18.296943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:18.313672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:18.319194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Getting quotas for user daa98fa6e3104489af8bd77f8217a07f and project f3339620b21d4394a171733276444b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:18.332422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:15:18.335010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:15:18.344313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-620afb2a-e0be-4edb-b6b1-e8c340ab4111 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Action: 'create', calling method: .version_select at 0x7fa8fe2b5280>, body: {"keypair": {"name": "tempest-keypair-475145375"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:18.363435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-620afb2a-e0be-4edb-b6b1-e8c340ab4111 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Getting quotas for project f5577c08c6bb4cc0bec1ad0fe18260ca. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:18.369682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-620afb2a-e0be-4edb-b6b1-e8c340ab4111 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Getting quotas for user f722c48df9c9480a924039b1cfe3b2d0 and project f5577c08c6bb4cc0bec1ad0fe18260ca. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:18.481823 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3d091b1-c8d4-43f0-9633-ae4aab433e36 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778938 Feb 12 21:15:18.484412 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1746/3411] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:15:18.491176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:18.492639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:18.508710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:18.510493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:18.517263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:18.517263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:18.635234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:18.644399 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f9781483-d2a4-439a-8c3a-dfe5114016ec tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1218 microversion: 2.1 time: 0.156922 Feb 12 21:15:18.645244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1747/3412] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:18 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:18.650766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a429f7bd-3e77-4658-8735-bd617b56fab1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:18.651652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a429f7bd-3e77-4658-8735-bd617b56fab1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:18.713269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-620afb2a-e0be-4edb-b6b1-e8c340ab4111 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Getting quotas for project f5577c08c6bb4cc0bec1ad0fe18260ca. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:18.716548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a429f7bd-3e77-4658-8735-bd617b56fab1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:18.724361 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a429f7bd-3e77-4658-8735-bd617b56fab1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1218 microversion: 2.1 time: 0.078048 Feb 12 21:15:18.726326 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1748/3413] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:18 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:18.728200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-620afb2a-e0be-4edb-b6b1-e8c340ab4111 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Getting quotas for user f722c48df9c9480a924039b1cfe3b2d0 and project f5577c08c6bb4cc0bec1ad0fe18260ca. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:18.732240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:18.733080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:18.743283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:18.744066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:18.745160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:18.745642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:18.762495 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-620afb2a-e0be-4edb-b6b1-e8c340ab4111 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.575565 Feb 12 21:15:18.763727 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1666/3414] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:15:18 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:18.940513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:18.948941 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8144df6e-ebd5-4aaa-961d-3452f8f74a56 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.221123 Feb 12 21:15:18.949562 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1749/3415] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:18 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:19.660992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:19.661650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:19.669322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:19.669812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:19.670616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:19.671062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:19.743392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:19.744058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:19.752450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:19.753435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:19.754715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:19.755490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:19.774553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:19.785838 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c54da625-252b-48e1-ba48-b803860e4fbc tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1266 microversion: 2.1 time: 0.128472 Feb 12 21:15:19.789437 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1667/3416] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:19 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:19.844140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:19.852831 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77e8fa5c-8af8-4ff2-a5f0-39be7ff1639f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1222 microversion: 2.1 time: 0.113348 Feb 12 21:15:19.853494 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1750/3417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:19 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:19.968961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:19.970149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:19.982454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:19.982927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:19.984719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:19.985242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:20.309677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:20.320687 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-514c6af7-4e54-4190-80cc-ce4c9f465e15 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.358296 Feb 12 21:15:20.330911 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1668/3418] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:19 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:20.807382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:20.808187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:20.826018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:20.826932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:20.830044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:20.830859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:20.870882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:20.871619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:20.880851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:20.886538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:20.887651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:20.890431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:20.937825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:20.947801 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00135e2f-b6fb-4e82-b6be-bb6bbceddb86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1272 microversion: 2.1 time: 0.144062 Feb 12 21:15:20.949644 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1751/3419] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:20 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:20.987294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:20.999811 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0044a325-6382-4076-89ba-a78a7cb1298f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1270 microversion: 2.1 time: 0.133788 Feb 12 21:15:21.000452 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1669/3420] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:20 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:21.341895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:21.342681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:21.355451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:21.355911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:21.356736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:21.357175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:21.851533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:21.876379 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cdf9f325-eb9a-42c9-83d2-e4e44b5e88ea tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.532713 Feb 12 21:15:21.877412 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1752/3421] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:21 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:21.970470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:21.971808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:21.981989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:21.982773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:21.983797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:21.984450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:22.016972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:22.017612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:22.026635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:22.027407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:22.028542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:22.028993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:22.143846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:22.156065 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5a463c8-e122-4ffe-b5c1-f2b9224313a2 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1276 microversion: 2.1 time: 0.142446 Feb 12 21:15:22.156912 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1753/3422] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:22 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:22.321015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:22.328050 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6dbd41f8-2ee3-4f30-a707-1356700341cd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.363809 Feb 12 21:15:22.339217 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1670/3423] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:21 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:22.585269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "99333fdc-3f05-4177-b985-b1e7bb8c19b1"}], "security_groups": [{"name": "tempest-securitygroup--1889867002"}], "key_name": "tempest-keypair-475145375", "user_data": "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:22.597892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f26752e2-e1d1-4605-b1b0-5e06ca78928b req-2cc06ae1-f20d-4326-9595-f88cf1a3fdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37517a7b-4ae7-408a-86d8-c16203fef034", "tag": "f6cae20d-5b6a-430a-a211-222509cb5db2"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:22.600612 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:22.600612 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:22.617020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f26752e2-e1d1-4605-b1b0-5e06ca78928b req-2cc06ae1-f20d-4326-9595-f88cf1a3fdf0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:22.617456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f26752e2-e1d1-4605-b1b0-5e06ca78928b req-2cc06ae1-f20d-4326-9595-f88cf1a3fdf0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:22.646009 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f26752e2-e1d1-4605-b1b0-5e06ca78928b req-2cc06ae1-f20d-4326-9595-f88cf1a3fdf0 service nova] Creating event network-changed:f6cae20d-5b6a-430a-a211-222509cb5db2 for instance 37517a7b-4ae7-408a-86d8-c16203fef034 on nch2-master-1 Feb 12 21:15:22.661644 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f26752e2-e1d1-4605-b1b0-5e06ca78928b req-2cc06ae1-f20d-4326-9595-f88cf1a3fdf0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066447 Feb 12 21:15:22.663814 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1671/3424] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:22.768215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] validate_networks() for [('99333fdc-3f05-4177-b985-b1e7bb8c19b1', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:15:22.897540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:22.898560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:22.918155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:22.919035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:22.919907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:22.920364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:23.257093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:23.269657 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d3a8a3e7-c3a8-48f6-a6c4-cb95e9b86419 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.378483 Feb 12 21:15:23.289416 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1672/3425] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:22 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:23.302537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:23.303196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:23.326141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:23.328090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:23.331702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:23.333720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:23.807261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:23.815984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe8e2920-0baf-4893-91fb-3931a7fb5ae5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.526052 Feb 12 21:15:23.816654 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1673/3426] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:23 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:23.831993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:23.832722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:23.840719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:23.841279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:23.842268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:23.842783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.055325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:15:24.057226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:15:24.058897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:15:24.059341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:15:24.063608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:15:24.071777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.072577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.073776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.074349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.091157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:24.098888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Getting quotas for project f5577c08c6bb4cc0bec1ad0fe18260ca. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:24.102839 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-564398ab-cb3a-453c-91ce-44901f50b5f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.274403 Feb 12 21:15:24.105615 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1674/3427] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:23 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:24.114493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Getting quotas for user f722c48df9c9480a924039b1cfe3b2d0 and project f5577c08c6bb4cc0bec1ad0fe18260ca. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:24.122244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-fa0338a7-4827-43e5-a35c-491297c2ea06 req-91e719eb-553c-4067-9673-080ea3f875c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ef5583-485a-4948-bfe8-4efa6b08acef", "name": "network-vif-plugged", "status": "completed", "tag": "d91a8af2-494a-4edb-b217-b53420b63976"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:24.123597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:15:24.123988 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:24.123988 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:24.126269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:15:24.132043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fa0338a7-4827-43e5-a35c-491297c2ea06 req-91e719eb-553c-4067-9673-080ea3f875c8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.132642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fa0338a7-4827-43e5-a35c-491297c2ea06 req-91e719eb-553c-4067-9673-080ea3f875c8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.145929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-fa0338a7-4827-43e5-a35c-491297c2ea06 req-91e719eb-553c-4067-9673-080ea3f875c8 service nova] Creating event network-vif-plugged:d91a8af2-494a-4edb-b217-b53420b63976 for instance d5ef5583-485a-4948-bfe8-4efa6b08acef on nch1-master-1 Feb 12 21:15:24.152664 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-fa0338a7-4827-43e5-a35c-491297c2ea06 req-91e719eb-553c-4067-9673-080ea3f875c8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036375 Feb 12 21:15:24.154445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1675/3428] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:24.253276 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1dd07161-b755-4e81-a2b9-a2336b50817a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.672374 Feb 12 21:15:24.254269 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1754/3429] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:15:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:15:24.264825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d87f8389-fcec-40c4-824e-a5c3207b9426 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:24.266481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d87f8389-fcec-40c4-824e-a5c3207b9426 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:24.293908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:24.294737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:24.300855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.301558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.302567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.306227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.335859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d87f8389-fcec-40c4-824e-a5c3207b9426 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:24.346191 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d87f8389-fcec-40c4-824e-a5c3207b9426 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1225 microversion: 2.1 time: 0.083806 Feb 12 21:15:24.346276 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1676/3430] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:24 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:24.610695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:24.621218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5bf927d4-e1d1-4f91-b43d-67349419dea3 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.332549 Feb 12 21:15:24.621841 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1755/3431] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:24 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:24.834062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:24.834680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:24.841519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.841971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.842811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.843259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.936562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-31a2a9a5-5aaf-43c0-8d3e-c5fa35c8c49d req-e26e4ab4-d460-461d-bb78-1e8920ac9fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d91404c-a99f-42d1-9b08-8fcd8f700a71", "tag": "db82307b-d41e-4a9f-8142-3bf9bdf0c157"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:24.938472 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:24.938472 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:24.945910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-31a2a9a5-5aaf-43c0-8d3e-c5fa35c8c49d req-e26e4ab4-d460-461d-bb78-1e8920ac9fba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:24.948072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-31a2a9a5-5aaf-43c0-8d3e-c5fa35c8c49d req-e26e4ab4-d460-461d-bb78-1e8920ac9fba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:24.959791 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-31a2a9a5-5aaf-43c0-8d3e-c5fa35c8c49d req-e26e4ab4-d460-461d-bb78-1e8920ac9fba service nova] Creating event network-changed:db82307b-d41e-4a9f-8142-3bf9bdf0c157 for instance 1d91404c-a99f-42d1-9b08-8fcd8f700a71 on nch2-master-1 Feb 12 21:15:24.965686 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-31a2a9a5-5aaf-43c0-8d3e-c5fa35c8c49d req-e26e4ab4-d460-461d-bb78-1e8920ac9fba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032695 Feb 12 21:15:24.966583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1756/3432] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:24.992879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:25.001672 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4e91bd6f-ddc5-4033-814b-3aa4abd3cee3 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.171347 Feb 12 21:15:25.002606 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1677/3433] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:24 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:25.122597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:25.123328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:25.129426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:25.129878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:25.130656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:25.131092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:25.348438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:25.356979 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da21e184-bd64-4b53-9965-874814aaf2ef tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.237879 Feb 12 21:15:25.357534 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1757/3434] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:25 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:25.372067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef03d476-d15a-42a5-9101-50351839b7de tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:25.372847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ef03d476-d15a-42a5-9101-50351839b7de tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:25.441538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ef03d476-d15a-42a5-9101-50351839b7de tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:25.449325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef03d476-d15a-42a5-9101-50351839b7de tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1225 microversion: 2.1 time: 0.082603 Feb 12 21:15:25.450340 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1678/3435] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:25 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:25.638352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:25.639177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:25.648076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:25.648768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:25.649742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:25.651398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:25.865643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:25.873887 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0943d40-b95b-445f-a073-5b5bcf4ec879 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1324 microversion: 2.1 time: 0.240141 Feb 12 21:15:25.874465 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1758/3436] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:25 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:26.019962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:26.020802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:26.030894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.031552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.032355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.032795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.176196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:26.185484 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8f0a87d-29ff-4ec2-a671-8276ae4dc0d4 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.170038 Feb 12 21:15:26.199087 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1679/3437] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:26 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:26.372352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:26.373194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:26.379327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.379790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.380580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.383122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.466651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:26.467626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:26.473794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.478949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.478949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.478949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.527331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:26.535137 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5c92db0-c0b3-4d28-bfb3-ff029ba4f657 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.166991 Feb 12 21:15:26.540193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:26.542126 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1759/3438] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:26 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:26.548708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7eebc6db-31c1-42e5-86c0-b35e4a7f75df tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1277 microversion: 2.1 time: 0.086080 Feb 12 21:15:26.549274 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1680/3439] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:26 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:26.893161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:26.893843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:26.901791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.902258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:26.903082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:26.903517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.195841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:27.210391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:27.216436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:27.225785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.226716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.227738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.228478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.235037 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de09301c-43a2-4972-a1c5-31678546332c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1522 microversion: 2.1 time: 0.346059 Feb 12 21:15:27.238680 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1760/3440] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:26 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:27.258875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:27.261230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:27.274450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.275856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.277631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.280990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.318904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:15:27.422875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:27.428077 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c6f445b-03e6-4e8f-aa72-ff7399b8166d tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.225471 Feb 12 21:15:27.428758 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1681/3441] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:27 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:27.553423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:27.554046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:27.562572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.564243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.565249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.565812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.741552 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f6f9e8b-80f2-4173-8d1c-0a01d610914f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 204 len: 0 microversion: 2.1 time: 0.487557 Feb 12 21:15:27.742152 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1761/3442] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:27 2022] DELETE /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:15:27.747902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:27.750514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:27.752825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:27.764951 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-161c50a1-b7d4-4b3f-8a18-829c72d69ef5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.215615 Feb 12 21:15:27.766039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.766240 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1682/3443] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:27 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:27.766513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.767445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.768031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.778869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:27.779698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:27.787770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.788224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.789438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:27.790051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:27.892581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:27.903561 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f420479-c5af-4188-a3a5-12ffaa08a624 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1283 microversion: 2.1 time: 0.160214 Feb 12 21:15:27.904324 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1762/3444] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:27 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:27.958640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:27.967551 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3900233c-87be-430b-b4d7-38974379a866 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1528 microversion: 2.1 time: 0.200002 Feb 12 21:15:27.968132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1683/3445] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:27 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1528 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:28.446609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:28.446609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:28.457967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.458442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:28.459270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.459724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:28.710774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:28.718424 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e907e1f1-7a93-4c7a-8158-440f13bbf5ef tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.276954 Feb 12 21:15:28.719017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1763/3446] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:28 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:28.782088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:28.782839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:28.789820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.790283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:28.791299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.791813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:28.924190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:28.924807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:28.940155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.941041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:28.942043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.943225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:28.957312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:28.974624 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67914a84-f3c1-4961-a7ea-8a6d72f85f3d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.196073 Feb 12 21:15:28.975564 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1684/3447] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:28 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:28.988850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:28.989527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:28.998626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:28.999089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:29.004879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:29.005704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:29.271989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:29.290151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-32b2e751-abd7-43ac-aa7c-8ca99bf3b2f2 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1528 microversion: 2.1 time: 0.309714 Feb 12 21:15:29.292340 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1685/3448] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:28 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1528 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:29.302432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:29.311299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c84fc7d-b19c-43ad-91b1-bf34125cba7b tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.391280 Feb 12 21:15:29.312199 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1764/3449] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:28 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:29.378147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c5807f9b-3b61-4ff0-a006-2deb6b308365 req-37e9f21d-fcc7-49c5-9515-3612e94c6b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37517a7b-4ae7-408a-86d8-c16203fef034", "name": "network-vif-plugged", "status": "completed", "tag": "f6cae20d-5b6a-430a-a211-222509cb5db2"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:29.379740 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:29.379740 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:29.392576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c5807f9b-3b61-4ff0-a006-2deb6b308365 req-37e9f21d-fcc7-49c5-9515-3612e94c6b78 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:29.393544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c5807f9b-3b61-4ff0-a006-2deb6b308365 req-37e9f21d-fcc7-49c5-9515-3612e94c6b78 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:29.433246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bcf3512c-47cf-4257-b270-03d64f06a2b7 req-e5cd408f-65d5-4c12-8afb-2fa51bd07b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed342e0-10ca-4835-ad0d-cf55a6aabc75", "tag": "89a1b42b-d5fd-47e5-a706-9448ba078c8e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:29.435296 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:29.435296 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:29.443434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bcf3512c-47cf-4257-b270-03d64f06a2b7 req-e5cd408f-65d5-4c12-8afb-2fa51bd07b9c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:29.444288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bcf3512c-47cf-4257-b270-03d64f06a2b7 req-e5cd408f-65d5-4c12-8afb-2fa51bd07b9c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:29.502710 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bcf3512c-47cf-4257-b270-03d64f06a2b7 req-e5cd408f-65d5-4c12-8afb-2fa51bd07b9c service nova] Creating event network-changed:89a1b42b-d5fd-47e5-a706-9448ba078c8e for instance aed342e0-10ca-4835-ad0d-cf55a6aabc75 on nch1-master-1 Feb 12 21:15:29.521529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bcf3512c-47cf-4257-b270-03d64f06a2b7 req-e5cd408f-65d5-4c12-8afb-2fa51bd07b9c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088426 Feb 12 21:15:29.521698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c5807f9b-3b61-4ff0-a006-2deb6b308365 req-37e9f21d-fcc7-49c5-9515-3612e94c6b78 service nova] Creating event network-vif-plugged:f6cae20d-5b6a-430a-a211-222509cb5db2 for instance 37517a7b-4ae7-408a-86d8-c16203fef034 on nch2-master-1 Feb 12 21:15:29.532908 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1765/3450] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:29.567876 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c5807f9b-3b61-4ff0-a006-2deb6b308365 req-37e9f21d-fcc7-49c5-9515-3612e94c6b78 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192286 Feb 12 21:15:29.571850 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1686/3451] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:29.738540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:29.740964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:29.759371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:29.762435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:29.764412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:29.765315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:29.994727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:29.996520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:30.010643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.010643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.010643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.010643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.080600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:30.089133 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b98c93fa-0663-4bd8-8c61-c02dfa1464ed tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.357394 Feb 12 21:15:30.089764 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1766/3452] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:29 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:30.122104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-49411a0f-a259-4bb3-9814-14432526e2b7 req-b3358446-1d32-4d10-a209-879cc39222ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ef5583-485a-4948-bfe8-4efa6b08acef", "name": "network-vif-deleted", "tag": "d91a8af2-494a-4edb-b217-b53420b63976"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:30.124206 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:30.124206 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:30.132867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-49411a0f-a259-4bb3-9814-14432526e2b7 req-b3358446-1d32-4d10-a209-879cc39222ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.133319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-49411a0f-a259-4bb3-9814-14432526e2b7 req-b3358446-1d32-4d10-a209-879cc39222ae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.151597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-49411a0f-a259-4bb3-9814-14432526e2b7 req-b3358446-1d32-4d10-a209-879cc39222ae service nova] Creating event network-vif-deleted:d91a8af2-494a-4edb-b217-b53420b63976 for instance d5ef5583-485a-4948-bfe8-4efa6b08acef on nch1-master-1 Feb 12 21:15:30.159217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-49411a0f-a259-4bb3-9814-14432526e2b7 req-b3358446-1d32-4d10-a209-879cc39222ae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041565 Feb 12 21:15:30.160321 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1767/3453] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:30.248656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:30.256403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b089a25-ed39-4853-9a5f-53d553a93cb3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.267383 Feb 12 21:15:30.256992 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1687/3454] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:29 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:30.311607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:30.313157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:30.325006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.326511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.327758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.328364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.328671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:30.329293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:30.362160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.363034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.363451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:30.370961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:30.401676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fb5c74958944d26a2e0297f8a470631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da6753f4d6946489d582ef43d0da4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:30.408780 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25b0562c-4007-46e5-a63c-e8a42d90059f tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 200 len: 1309 microversion: 2.1 time: 0.103064 Feb 12 21:15:30.409553 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1768/3455] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:30 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:30.631275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:30.640686 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5fb2bd5a-a197-4137-b62e-1beacfd84120 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.315690 Feb 12 21:15:30.641327 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1688/3456] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:30 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:31.105535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.106135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:31.113069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.113569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.114737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.115177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.263775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:31.272866 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d91d1ed5-99a8-4818-b818-ddca847b4010 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.170786 Feb 12 21:15:31.273292 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1769/3457] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:31 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:31.279531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.280918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:31.289023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.289930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.291198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.292371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.426065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.426793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d5ef5583-485a-4948-bfe8-4efa6b08acef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:31.432969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.433543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.434402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.434907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.451304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:31.452619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance d5ef5583-485a-4948-bfe8-4efa6b08acef could not be found. Feb 12 21:15:31.453879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance d5ef5583-485a-4948-bfe8-4efa6b08acef could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:31.454893 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-996ce796-6c77-4cdc-9780-1244fc2aa038 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef" status: 404 len: 111 microversion: 2.1 time: 0.032629 Feb 12 21:15:31.455639 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1770/3458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:31 2022] GET /compute/v2.1/servers/d5ef5583-485a-4948-bfe8-4efa6b08acef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:31.459770 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad33f432-9558-4066-86e6-5dc9d5e20210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1314 microversion: 2.1 time: 0.184536 Feb 12 21:15:31.467948 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1689/3459] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:31 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:31.468080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ffb52ab-9332-472d-9382-92b3c01e510c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '.version_select at 0x7fa8fdfb2af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.485281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1ffb52ab-9332-472d-9382-92b3c01e510c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Image not found. Feb 12 21:15:31.485906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ffb52ab-9332-472d-9382-92b3c01e510c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Image not found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:31.486781 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ffb52ab-9332-472d-9382-92b3c01e510c tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/images/dc1ee9fe-10a7-498b-a219-99e95aae6681" status: 404 len: 62 microversion: 2.1 time: 0.026793 Feb 12 21:15:31.487312 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1771/3460] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:31 2022] DELETE /compute/v2.1/images/dc1ee9fe-10a7-498b-a219-99e95aae6681 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:15:31.499867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.500375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:31.506483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.506941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.507737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.508182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.522436 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance d2990b1d-7527-44c6-9a61-380b654541b6 could not be found. Feb 12 21:15:31.523034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance d2990b1d-7527-44c6-9a61-380b654541b6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:31.523860 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9728eaa0-d6f4-45fe-a74c-8e59fa3df0c5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 404 len: 111 microversion: 2.1 time: 0.027848 Feb 12 21:15:31.524398 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1690/3461] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:31 2022] DELETE /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:31.532768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.533401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: d2990b1d-7527-44c6-9a61-380b654541b6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:31.540296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.541221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.542156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.542591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.555633 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance d2990b1d-7527-44c6-9a61-380b654541b6 could not be found. Feb 12 21:15:31.556217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance d2990b1d-7527-44c6-9a61-380b654541b6 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:31.557689 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-918f8c1f-3c2b-4ca2-b5b0-30e9ae14d167 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6" status: 404 len: 111 microversion: 2.1 time: 0.028815 Feb 12 21:15:31.558223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1772/3462] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:31 2022] GET /compute/v2.1/servers/d2990b1d-7527-44c6-9a61-380b654541b6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:31.572745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59c9ae9d-87a9-4e9f-981a-0c65964d1fe5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '.version_select at 0x7fa8fdfb4820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.595429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-edc5b238-987f-46e1-b78f-3fe335f5159d req-f8567ec1-07d5-46ad-b6b0-9f1a7047cefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d91404c-a99f-42d1-9b08-8fcd8f700a71", "name": "network-vif-plugged", "status": "completed", "tag": "db82307b-d41e-4a9f-8142-3bf9bdf0c157"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:31.597033 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:31.597033 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:31.605603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-edc5b238-987f-46e1-b78f-3fe335f5159d req-f8567ec1-07d5-46ad-b6b0-9f1a7047cefd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.606061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-edc5b238-987f-46e1-b78f-3fe335f5159d req-f8567ec1-07d5-46ad-b6b0-9f1a7047cefd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.617234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-edc5b238-987f-46e1-b78f-3fe335f5159d req-f8567ec1-07d5-46ad-b6b0-9f1a7047cefd service nova] Creating event network-vif-plugged:db82307b-d41e-4a9f-8142-3bf9bdf0c157 for instance 1d91404c-a99f-42d1-9b08-8fcd8f700a71 on nch2-master-1 Feb 12 21:15:31.622781 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-edc5b238-987f-46e1-b78f-3fe335f5159d req-f8567ec1-07d5-46ad-b6b0-9f1a7047cefd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 Feb 12 21:15:31.623423 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1773/3463] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:31.658443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:31.663876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:31.665574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.666276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.667238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:31.667675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:31.684943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59c9ae9d-87a9-4e9f-981a-0c65964d1fe5 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050066560" status: 202 len: 0 microversion: 2.1 time: 0.116343 Feb 12 21:15:31.686611 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1691/3464] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050066560 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:31.877637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:31.886528 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3afd39a-10c7-4fa1-bfcc-706dc9a008f1 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.232046 Feb 12 21:15:31.887363 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1774/3465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:31 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:32.293964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.294668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:32.301472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.301873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.302658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.303098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.483004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.483777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:32.489440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:32.491099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.491569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.492556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.493153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.498536 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-326f0794-1222-4959-b225-fa7f491d5072 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1318 microversion: 2.1 time: 0.210188 Feb 12 21:15:32.499125 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1692/3466] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:32 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:32.660617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a180b571-075d-483e-9f6c-7d8d581ce054 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '.version_select at 0x7fa8fe7c7430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.684313 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a180b571-075d-483e-9f6c-7d8d581ce054 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Image not found. Feb 12 21:15:32.685027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a180b571-075d-483e-9f6c-7d8d581ce054 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Image not found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:32.686010 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a180b571-075d-483e-9f6c-7d8d581ce054 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/images/dcfdc13d-16b6-4ac8-8f41-033918d8dc8e" status: 404 len: 62 microversion: 2.1 time: 0.029163 Feb 12 21:15:32.687410 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1693/3467] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:32 2022] DELETE /compute/v2.1/images/dcfdc13d-16b6-4ac8-8f41-033918d8dc8e => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 12 21:15:32.695152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.697062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:32.703813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.704486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.705398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.705920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.720488 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd could not be found. Feb 12 21:15:32.725654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:32.727520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:32.729096 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-58068011-0ebb-40b7-9624-fc7c931ab707 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 404 len: 111 microversion: 2.1 time: 0.036868 Feb 12 21:15:32.729717 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1694/3468] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:32 2022] DELETE /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:32.737456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.737975 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f5e2f010-ec9f-4d7a-a1db-083a763406d3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1500 microversion: 2.1 time: 0.258897 Feb 12 21:15:32.757430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] [instance: 9f33ecd6-e622-4f55-8516-0e0f250d53cd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:32.757771 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1775/3469] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:32 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1500 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:32.757866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.757866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.757866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.757866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.758199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.758199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:32.760395 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] HTTP exception thrown: Instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd could not be found. Feb 12 21:15:32.761288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] Returning 404 to user: Instance 9f33ecd6-e622-4f55-8516-0e0f250d53cd could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:32.762109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cfdac795-8e25-4d47-92b4-f424a084f9d1 tempest-ImagesOneServerNegativeTestJSON-1886999803 tempest-ImagesOneServerNegativeTestJSON-1886999803-project] 10.222.0.31 "GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd" status: 404 len: 111 microversion: 2.1 time: 0.028453 Feb 12 21:15:32.762666 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1695/3470] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:32 2022] GET /compute/v2.1/servers/9f33ecd6-e622-4f55-8516-0e0f250d53cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:32.771769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.771769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.771769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.771769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.806580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:15:32.905659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:32.906560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:32.923801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.924536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:32.925556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:32.926195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:33.131775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:33.136302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c1f17e5-a735-4845-b97e-395713c1e601 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 204 len: 0 microversion: 2.1 time: 0.382018 Feb 12 21:15:33.137258 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1776/3471] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:32 2022] DELETE /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:15:33.144568 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92e4bc7c-4c6a-47c9-abeb-9f6a74bdf59a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.244299 Feb 12 21:15:33.148020 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1696/3472] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:32 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:33.148257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:33.148257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:33.162156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:33.162693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:33.163494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:33.164142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:33.488031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:33.500793 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b716fac3-454c-4bb3-92c5-d08222742504 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1506 microversion: 2.1 time: 0.358808 Feb 12 21:15:33.501713 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1777/3473] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:33 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:33.519369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:33.519984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:33.528856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:33.529349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:33.530210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:33.530671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:33.682712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:33.692128 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2dc0b1d9-9359-4de4-8075-553e02b7a644 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1509 microversion: 2.1 time: 0.178398 Feb 12 21:15:33.703147 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1697/3474] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:33 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:34.163492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:34.164108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:34.170911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:34.171373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:34.172162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:34.172775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:34.339013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:34.348051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7aca1d8e-b45f-4de5-91c3-fc423121a274 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.188056 Feb 12 21:15:34.349183 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1778/3475] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:34 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:34.518959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:34.519590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:34.527548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:34.528007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:34.528804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:34.529267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:34.672736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:34.680091 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03c5ff3c-b9fe-45a3-bb4e-ce69f4577bee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1506 microversion: 2.1 time: 0.164980 Feb 12 21:15:34.680654 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1698/3476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:34 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:35.310097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6867c371-72d1-49d7-9248-b6d22c351b3d req-fa9736d6-3e87-4d09-883a-1899ade4a7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37517a7b-4ae7-408a-86d8-c16203fef034", "name": "network-vif-deleted", "tag": "f6cae20d-5b6a-430a-a211-222509cb5db2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:35.312304 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:35.312304 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:35.325321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6867c371-72d1-49d7-9248-b6d22c351b3d req-fa9736d6-3e87-4d09-883a-1899ade4a7af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.326036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6867c371-72d1-49d7-9248-b6d22c351b3d req-fa9736d6-3e87-4d09-883a-1899ade4a7af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.341774 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6867c371-72d1-49d7-9248-b6d22c351b3d req-fa9736d6-3e87-4d09-883a-1899ade4a7af service nova] Creating event network-vif-deleted:f6cae20d-5b6a-430a-a211-222509cb5db2 for instance 37517a7b-4ae7-408a-86d8-c16203fef034 on nch2-master-1 Feb 12 21:15:35.347433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6867c371-72d1-49d7-9248-b6d22c351b3d req-fa9736d6-3e87-4d09-883a-1899ade4a7af service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043034 Feb 12 21:15:35.348471 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1779/3477] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:35.365867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:35.366919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:35.376420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.377188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.381223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.381223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.449339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a2f2abf8-2801-4a36-b45d-c342593e5e94 req-ef6255da-879d-40a7-b692-d1b2e9e17314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed342e0-10ca-4835-ad0d-cf55a6aabc75", "name": "network-vif-plugged", "status": "completed", "tag": "89a1b42b-d5fd-47e5-a706-9448ba078c8e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:35.451272 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:35.451272 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:35.459018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a2f2abf8-2801-4a36-b45d-c342593e5e94 req-ef6255da-879d-40a7-b692-d1b2e9e17314 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.459469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a2f2abf8-2801-4a36-b45d-c342593e5e94 req-ef6255da-879d-40a7-b692-d1b2e9e17314 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.476003 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a2f2abf8-2801-4a36-b45d-c342593e5e94 req-ef6255da-879d-40a7-b692-d1b2e9e17314 service nova] Creating event network-vif-plugged:89a1b42b-d5fd-47e5-a706-9448ba078c8e for instance aed342e0-10ca-4835-ad0d-cf55a6aabc75 on nch1-master-1 Feb 12 21:15:35.479987 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a2f2abf8-2801-4a36-b45d-c342593e5e94 req-ef6255da-879d-40a7-b692-d1b2e9e17314 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044814 Feb 12 21:15:35.480590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1780/3478] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:35.542849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:35.551661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78ce8b0d-6b7a-4f7e-981b-ce8ea3fe4188 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.189481 Feb 12 21:15:35.552260 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1699/3479] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:35 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:35.698272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:35.702544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:35.705593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.706109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.707078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.710179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.740724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:35.741180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:35.741663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lazy-loading 'fault' on Instance uuid 37517a7b-4ae7-408a-86d8-c16203fef034 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:35.790821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:35.798991 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-772f9768-590d-4b31-ae42-1a017354164b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 200 len: 1304 microversion: 2.1 time: 0.105394 Feb 12 21:15:35.799613 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1781/3480] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:35 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:36.570233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:36.570856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:36.578585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:36.579075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:36.579868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:36.580310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:36.738217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:36.747692 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-116403b1-24e2-40e9-8822-8afda0e91fbe tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1351 microversion: 2.1 time: 0.181266 Feb 12 21:15:36.751485 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1700/3481] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:36 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 37517a7b-4ae7-408a-86d8-c16203fef034 could not be found. Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 37517a7b-4ae7-408a-86d8-c16203fef034 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b112fa27-f4a5-452f-921e-3049dabdbf84 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 404 len: 111 microversion: 2.1 time: 0.032696 Feb 12 21:15:36.978839 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1782/3482] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:36 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:15:36.981542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-875123579", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:37.015860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:15:37.527279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:15:37.527711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:15:37.528190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:15:37.528776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:15:37.529380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:15:37.539934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:37.541737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:37.542856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:37.543297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:37.581050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:37.591628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:37.605935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:15:37.608565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:15:37.750459 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b122ce80-8fd0-4444-9978-b4a47af00280 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792995 Feb 12 21:15:37.754218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1701/3483] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:15:37.765041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:37.766127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:37.777566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:37.779590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:37.782296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:37.783290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:37.846794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b212493-0ffa-4c4b-87ee-f7206a7c5f61 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdecfd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1067786404", "description": "tempest-description-1422560554"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:38.340604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b212493-0ffa-4c4b-87ee-f7206a7c5f61 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.717592 Feb 12 21:15:38.342346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1783/3484] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:15:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:38.347584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e50a0296-e438-485f-8301-94ca13cdf6a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:38.348307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e50a0296-e438-485f-8301-94ca13cdf6a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:38.378373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:38.386992 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28815345-e14a-45c5-a685-6293518572d2 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1540 microversion: 2.1 time: 0.626652 Feb 12 21:15:38.387664 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1702/3485] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:37 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1540 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:38.399993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9a8793e2-a7a8-4583-805c-d259246547e6 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fd8e8d30>, body: {"security_group_rule": {"parent_group_id": "085b1cdd-534f-4941-b875-6d141ef4b2e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:38.412536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e50a0296-e438-485f-8301-94ca13cdf6a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:38.419488 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e50a0296-e438-485f-8301-94ca13cdf6a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1214 microversion: 2.1 time: 0.075408 Feb 12 21:15:38.420205 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1784/3486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:38 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:38.427329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:38.428184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:38.435099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:38.435686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:38.436738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:38.437417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:38.846585 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9a8793e2-a7a8-4583-805c-d259246547e6 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.457579 Feb 12 21:15:38.847197 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1703/3487] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:38 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:38.858310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9322f75-4d89-4ed3-8cfc-53d3c41270a4 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fe024f70>, body: {"security_group_rule": {"parent_group_id": "085b1cdd-534f-4941-b875-6d141ef4b2e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:38.907786 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dee3171f-bb02-444c-8660-493c783b0b17 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.486103 Feb 12 21:15:38.908706 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1785/3488] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:15:38 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75/os-interface => generated 284 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:38.930624 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c9322f75-4d89-4ed3-8cfc-53d3c41270a4 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: This rule already exists in group 085b1cdd-534f-4941-b875-6d141ef4b2e6 Feb 12 21:15:38.933349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9322f75-4d89-4ed3-8cfc-53d3c41270a4 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 400 to user: This rule already exists in group 085b1cdd-534f-4941-b875-6d141ef4b2e6 {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:38.938049 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9322f75-4d89-4ed3-8cfc-53d3c41270a4 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.081783 Feb 12 21:15:38.939848 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1704/3489] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:38.953234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-132b0976-a73b-4b43-90c4-a4f53be4776e tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fe167940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:39.182529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:39.183559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:39.189958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.190410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.191193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.191628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.242938 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-351e5efb-9c94-4f42-b87a-e94e5fbceb22 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "POST /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030/action" status: 200 len: 24585 microversion: 2.32 time: 0.332634 Feb 12 21:15:39.243665 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1786/3490] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:15:38 2022] POST /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030/action => generated 24585 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:39.256213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:39.256461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:39.265272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.269374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.269374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.269374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.305171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:15:39.310502 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-132b0976-a73b-4b43-90c4-a4f53be4776e tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-group-rules/6345076a-3ea0-4bcf-847c-1526b228c6e5" status: 202 len: 0 microversion: 2.1 time: 0.365747 Feb 12 21:15:39.311226 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1705/3491] 10.222.0.31 () {58 vars in 1286 bytes} [Sat Feb 12 21:15:38 2022] DELETE /compute/v2.1/os-security-group-rules/6345076a-3ea0-4bcf-847c-1526b228c6e5 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:39.321785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5bc413e-6a9c-46df-abaf-1bf3be009061 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdfb4820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-403111373", "description": "tempest-description-1746980768"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:39.641078 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0393537b-a418-4062-893d-f25933d3cb56 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "DELETE /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 204 len: 0 microversion: 2.32 time: 0.388909 Feb 12 21:15:39.644661 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1787/3492] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:15:39 2022] DELETE /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:15:39.650545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:39.651678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:39.658597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.659053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.659947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.660362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.733935 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5bc413e-6a9c-46df-abaf-1bf3be009061 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.416864 Feb 12 21:15:39.735996 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1706/3493] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:15:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:39.739501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a5cc769-00c9-4456-9c95-a53bbc50a390"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:39.740957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:39.756297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.756757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.757689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.758069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.770760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:39.781677 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8543444c-f1fb-4abe-898a-d88bad416589 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1210 microversion: 2.1 time: 0.135567 Feb 12 21:15:39.782785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1788/3494] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:39 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:39.788422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:39.789551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:39.797740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.798195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:39.798991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:39.799687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:40.277921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:40.288623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:40.290223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:40.306016 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ecfc43b-fbe6-4ba1-ac9e-8dacaac61a52 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2955 microversion: 2.32 time: 0.513234 Feb 12 21:15:40.308478 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1789/3495] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:39 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2955 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:40.328276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0bd86435-7be3-41ea-bf9c-eac8f73711e9 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fded3ee0>, body: {"security_group_rule": {"parent_group_id": "b0146cfe-42a2-4304-86ec-40af08c26b45", "ip_protocol": "tcp", "from_port": 1355200324, "to_port": 22}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:40.512973 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0bd86435-7be3-41ea-bf9c-eac8f73711e9 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Invalid port range 1355200324:22. Former value cannot be greater than the later Feb 12 21:15:40.513720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0bd86435-7be3-41ea-bf9c-eac8f73711e9 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 400 to user: Invalid port range 1355200324:22. Former value cannot be greater than the later {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:40.514422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0bd86435-7be3-41ea-bf9c-eac8f73711e9 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.190435 Feb 12 21:15:40.514997 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1790/3496] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:40 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:40.524917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab029ae8-a7e3-47b7-afc4-b78a3e2b5930 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdecfee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1122591199", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:40.527463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-ab029ae8-a7e3-47b7-afc4-b78a3e2b5930 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Security group id should be uuid Feb 12 21:15:40.528043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab029ae8-a7e3-47b7-afc4-b78a3e2b5930 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 400 to user: Security group id should be uuid {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:40.528849 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab029ae8-a7e3-47b7-afc4-b78a3e2b5930 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.007649 Feb 12 21:15:40.532449 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1791/3497] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:40 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Feb 12 21:15:40.550070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8112c33-7a8d-4921-8563-49e0419ebee6 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdf31940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-925759214", "description": "tempest-description-1216755791"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:40.674791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7645ea0-f2ed-4f23-9f69-a0b9ee422a12 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "POST /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938700 Feb 12 21:15:40.676084 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1707/3498] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:15:39 2022] POST /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:40.799967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:40.800677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:40.810286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:40.810742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:40.814184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:40.814878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:40.974717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:40.984855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7294de3-0a9a-4491-ad7c-c1f5132bc7d4 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1284 microversion: 2.1 time: 0.188826 Feb 12 21:15:40.987633 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1708/3499] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:40 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:41.001168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2a3a17ba-c434-498c-9b14-026bb5e07104 req-709d0310-04f6-491f-a297-ecab37e130b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed342e0-10ca-4835-ad0d-cf55a6aabc75", "tag": "89a1b42b-d5fd-47e5-a706-9448ba078c8e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:41.003120 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:41.003120 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:41.016891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2a3a17ba-c434-498c-9b14-026bb5e07104 req-709d0310-04f6-491f-a297-ecab37e130b9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:41.017348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2a3a17ba-c434-498c-9b14-026bb5e07104 req-709d0310-04f6-491f-a297-ecab37e130b9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:41.047526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2a3a17ba-c434-498c-9b14-026bb5e07104 req-709d0310-04f6-491f-a297-ecab37e130b9 service nova] Creating event network-changed:89a1b42b-d5fd-47e5-a706-9448ba078c8e for instance aed342e0-10ca-4835-ad0d-cf55a6aabc75 on nch1-master-1 Feb 12 21:15:41.064076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2a3a17ba-c434-498c-9b14-026bb5e07104 req-709d0310-04f6-491f-a297-ecab37e130b9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068368 Feb 12 21:15:41.064076 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1709/3500] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:41.326744 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8112c33-7a8d-4921-8563-49e0419ebee6 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.783998 Feb 12 21:15:41.328287 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1792/3501] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:15:40 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:41.328889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:41.329918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:41.341245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3002a947-920c-4074-ad87-90182c591a9e tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdecf700>, body: {"security_group_rule": {"parent_group_id": "7e0e8ab9-d666-46ac-b3a5-d90ddb1cbf03", "ip_protocol": "tempest-999-986700493", "from_port": 22, "to_port": 22}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:41.345866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:41.348114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:41.349051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:41.350957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:41.447375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3002a947-920c-4074-ad87-90182c591a9e tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Invalid IP protocol tempest-999-986700493. Feb 12 21:15:41.448220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3002a947-920c-4074-ad87-90182c591a9e tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 400 to user: Invalid IP protocol tempest-999-986700493. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:41.448745 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3002a947-920c-4074-ad87-90182c591a9e tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.113216 Feb 12 21:15:41.449331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1793/3502] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:41 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Feb 12 21:15:41.458969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5555aa2-70de-4f86-a15a-5cc573ac29d0 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdf0e670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-305935296", "description": "tempest-description-44899204"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:41.817974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:41.838001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:41.844827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:41.848970 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13de3b4a-3530-40df-b1ea-fd7a89e2a7b5 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2955 microversion: 2.32 time: 0.522875 Feb 12 21:15:41.852214 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1710/3503] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:41 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2955 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:42.008429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:42.009287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:42.025613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:42.028229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:42.029665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:42.032825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:42.477348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:42.486235 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-895ef59b-f663-4c07-b09a-40d33d95167e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.481961 Feb 12 21:15:42.487061 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1711/3504] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:42 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:42.628943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5555aa2-70de-4f86-a15a-5cc573ac29d0 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.174142 Feb 12 21:15:42.630154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1794/3505] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:15:41 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:42.645037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00ecf60b-75d8-4760-afca-ab187903fb71 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fd6fe940>, body: {"security_group_rule": {"parent_group_id": "36f78c19-82ee-4af5-a288-3659ec380f76", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:42.724760 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-00ecf60b-75d8-4760-afca-ab187903fb71 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Feb 12 21:15:42.725584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00ecf60b-75d8-4760-afca-ab187903fb71 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:42.726576 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00ecf60b-75d8-4760-afca-ab187903fb71 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.087875 Feb 12 21:15:42.735396 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1712/3506] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:42 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:42.737330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e488cbc-7e99-4a91-9cba-95319579219d tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdf39550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1063562327", "description": "tempest-description-857799480"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:42.871080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:42.871616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:42.886841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:42.887441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:42.889634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:42.889634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.517957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:43.528045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:43.535935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:43.540246 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e488cbc-7e99-4a91-9cba-95319579219d tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.806589 Feb 12 21:15:43.541889 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-226c74b3-051e-476d-b22f-097ad94902b6 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2955 microversion: 2.32 time: 0.674799 Feb 12 21:15:43.542728 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1795/3507] 10.222.0.31 () {60 vars in 1179 bytes} [Sat Feb 12 21:15:42 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:43.548576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:43.550561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:43.558678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:43.560035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.561113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:43.561930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.565404 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1713/3508] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:42 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2955 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:15:43.570908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:43.576348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:43.590983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:43.592590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.595287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:43.595887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.604302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df78185e-073f-4102-8804-6b984612b0da tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060038 Feb 12 21:15:43.605522 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1796/3509] 10.222.0.31 () {60 vars in 1342 bytes} [Sat Feb 12 21:15:43 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:43.616437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b24808f-5614-4716-a9c3-ddafe819af25 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa8fdecf670>, body: {"security_group_rule": {"parent_group_id": "2cf0923e-81a7-4509-949a-35175ef452c9", "ip_protocol": "tcp", "from_port": 22, "to_port": 714932687}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:43.704383 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7b24808f-5614-4716-a9c3-ddafe819af25 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Invalid port range 22:714932687. Valid TCP ports should be between 1-65535 Feb 12 21:15:43.705043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b24808f-5614-4716-a9c3-ddafe819af25 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 400 to user: Invalid port range 22:714932687. Valid TCP ports should be between 1-65535 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:43.705825 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b24808f-5614-4716-a9c3-ddafe819af25 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.099094 Feb 12 21:15:43.711039 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1797/3510] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:43 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:43.711813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:43.712562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:43.727300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:43.732796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.734667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:43.735668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:43.786375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:15:44.037814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:44.053513 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25c743e7-8ccc-4efa-8f05-54ecbfe3486e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.486786 Feb 12 21:15:44.054272 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1714/3511] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:43 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:44.075590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc7691ed-7ce3-48cb-90ef-23f000d328fb tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Action: 'create', calling method: .version_select at 0x7fa907f5e790>, body: {"security_group_rule": {"parent_group_id": "a2e1a4df-387b-4be7-9c95-48fd85d88975", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:44.156084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-cc7691ed-7ce3-48cb-90ef-23f000d328fb tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2e1a4df-387b-4be7-9c95-48fd85d88975 does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:15:44.156777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-cc7691ed-7ce3-48cb-90ef-23f000d328fb tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Neutron security group a2e1a4df-387b-4be7-9c95-48fd85d88975 not found {{(pid=141726) get /opt/stack/nova/nova/network/security_group_api.py:313}} Feb 12 21:15:44.157726 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cc7691ed-7ce3-48cb-90ef-23f000d328fb tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Security group a2e1a4df-387b-4be7-9c95-48fd85d88975 does not exist Feb 12 21:15:44.157726 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-de6c65e4-a85c-4f69-9c97-714fa2b40bd7'] Feb 12 21:15:44.159667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc7691ed-7ce3-48cb-90ef-23f000d328fb tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 404 to user: Security group a2e1a4df-387b-4be7-9c95-48fd85d88975 does not exist Feb 12 21:15:44.159667 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-de6c65e4-a85c-4f69-9c97-714fa2b40bd7'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:44.160930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc7691ed-7ce3-48cb-90ef-23f000d328fb tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.104054 Feb 12 21:15:44.166834 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1715/3512] 10.222.0.31 () {60 vars in 1194 bytes} [Sat Feb 12 21:15:44 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:44.184994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5d16cbb6-6452-4be4-b349-39c4aa33daa8 req-cd794840-cff9-42b0-b998-4baa3378eb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ae9bb06-a90d-4b9b-914d-6304f6312070", "tag": "b855968a-96a6-49b5-ab4f-9065636385f9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:44.184994 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:44.184994 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:44.189698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5d16cbb6-6452-4be4-b349-39c4aa33daa8 req-cd794840-cff9-42b0-b998-4baa3378eb5b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:44.191261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5d16cbb6-6452-4be4-b349-39c4aa33daa8 req-cd794840-cff9-42b0-b998-4baa3378eb5b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:44.210521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5d16cbb6-6452-4be4-b349-39c4aa33daa8 req-cd794840-cff9-42b0-b998-4baa3378eb5b service nova] Creating event network-changed:b855968a-96a6-49b5-ab4f-9065636385f9 for instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 on nch1-master-1 Feb 12 21:15:44.220248 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5d16cbb6-6452-4be4-b349-39c4aa33daa8 req-cd794840-cff9-42b0-b998-4baa3378eb5b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049438 Feb 12 21:15:44.222026 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1716/3513] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:44.228794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3421de4b-c364-4301-b38c-92214de08890 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 204 len: 0 microversion: 2.20 time: 0.519459 Feb 12 21:15:44.229957 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1798/3514] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:15:43 2022] DELETE /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:15:44.249208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:44.252410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:44.262220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3bd1b4c8-e397-4f3b-8909-a26d04d07602 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fd8e8040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:44.268724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:44.270572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:44.273538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:44.275537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:44.545475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG neutronclient.v2_0.client [None req-3bd1b4c8-e397-4f3b-8909-a26d04d07602 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f77cfbc4-8c2e-4b71-91a2-10d522b5667a does not exist", "detail": ""}} {{(pid=141726) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Feb 12 21:15:44.546027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.security_group_api [None req-3bd1b4c8-e397-4f3b-8909-a26d04d07602 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Neutron security group rule f77cfbc4-8c2e-4b71-91a2-10d522b5667a not found {{(pid=141726) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Feb 12 21:15:44.546915 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3bd1b4c8-e397-4f3b-8909-a26d04d07602 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] HTTP exception thrown: Security group rule f77cfbc4-8c2e-4b71-91a2-10d522b5667a does not exist Feb 12 21:15:44.546915 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-e2ef78c5-bb82-4a8b-ae88-10707a94d579'] Feb 12 21:15:44.547735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3bd1b4c8-e397-4f3b-8909-a26d04d07602 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Returning 404 to user: Security group rule f77cfbc4-8c2e-4b71-91a2-10d522b5667a does not exist Feb 12 21:15:44.547735 ncdv-master-1 devstack@n-api.service[141726]: Neutron server returns request_ids: ['req-e2ef78c5-bb82-4a8b-ae88-10707a94d579'] {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:44.548628 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3bd1b4c8-e397-4f3b-8909-a26d04d07602 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-group-rules/f77cfbc4-8c2e-4b71-91a2-10d522b5667a" status: 404 len: 199 microversion: 2.1 time: 0.298851 Feb 12 21:15:44.549195 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1717/3515] 10.222.0.31 () {58 vars in 1286 bytes} [Sat Feb 12 21:15:44 2022] DELETE /compute/v2.1/os-security-group-rules/f77cfbc4-8c2e-4b71-91a2-10d522b5667a => generated 199 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:44.558051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4012800-f766-4e10-a2f3-c88ba759a3d3 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fd888e50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:44.979653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:44.991860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:44.995316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:44.996192 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4012800-f766-4e10-a2f3-c88ba759a3d3 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/2cf0923e-81a7-4509-949a-35175ef452c9" status: 202 len: 0 microversion: 2.1 time: 0.441777 Feb 12 21:15:44.997445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1718/3516] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:15:44 2022] DELETE /compute/v2.1/os-security-groups/2cf0923e-81a7-4509-949a-35175ef452c9 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:15:44.997679 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea70db77-5dbd-45c7-b1fb-c08f61e7663c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.756714 Feb 12 21:15:45.009404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:45.009404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:45.011574 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1799/3517] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:44 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:45.015939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:45.016476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:45.024250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:45.024392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b2b52b7a-5d9a-42e8-9787-6632b922cf2a tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fdecf160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:45.024513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:45.660545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:45.671366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:45.674174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:45.675739 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce83c5ec-6223-4eb1-9315-b4bf00960862 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2934 microversion: 2.32 time: 0.676137 Feb 12 21:15:45.676726 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1719/3518] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:44 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2934 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:45.681826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:45.682854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:45.689226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:45.689794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:45.690663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:45.691130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:45.979311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b2b52b7a-5d9a-42e8-9787-6632b922cf2a tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/36f78c19-82ee-4af5-a288-3659ec380f76" status: 202 len: 0 microversion: 2.1 time: 0.966062 Feb 12 21:15:45.980206 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1800/3519] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:15:45 2022] DELETE /compute/v2.1/os-security-groups/36f78c19-82ee-4af5-a288-3659ec380f76 => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:45.986152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bb40472b-4ce1-4917-9645-67e9c61e35e7 req-640e3d14-f6dc-4e3f-a210-09e21011e9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-unplugged", "status": "completed", "tag": "b2910da7-aefa-45b5-ab32-c4167ae080b7"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:45.991312 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:45.991312 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:46.017934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bb40472b-4ce1-4917-9645-67e9c61e35e7 req-640e3d14-f6dc-4e3f-a210-09e21011e9e3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:46.018589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bb40472b-4ce1-4917-9645-67e9c61e35e7 req-640e3d14-f6dc-4e3f-a210-09e21011e9e3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:46.108603 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bb40472b-4ce1-4917-9645-67e9c61e35e7 req-640e3d14-f6dc-4e3f-a210-09e21011e9e3 service nova] Creating event network-vif-unplugged:b2910da7-aefa-45b5-ab32-c4167ae080b7 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:46.137088 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bb40472b-4ce1-4917-9645-67e9c61e35e7 req-640e3d14-f6dc-4e3f-a210-09e21011e9e3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153780 Feb 12 21:15:46.138416 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1801/3520] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:46.155384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:46.157289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:46.171109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:46.175547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:46.178490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:46.179144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:46.380635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'services' on Instance uuid 1d91404c-a99f-42d1-9b08-8fcd8f700a71 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:46.635413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:46.643469 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d96dea2-2230-4de7-a48e-b20b4612b8d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.966027 Feb 12 21:15:46.648285 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1720/3521] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:45 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:46.657630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f05db24b-dac8-48b8-8473-b2bf6f496d55 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fd76eee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:46.716894 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b283c38-9601-4833-a375-21c88c3e83a0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments/9a5cc769-00c9-4456-9c95-a53bbc50a390" status: 202 len: 0 microversion: 2.1 time: 0.575373 Feb 12 21:15:46.717627 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1802/3522] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:15:46 2022] DELETE /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments/9a5cc769-00c9-4456-9c95-a53bbc50a390 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:46.753607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:46.754856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:46.764602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:46.765320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:46.766282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:46.766724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:47.303376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:47.323098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:47.325155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:47.326964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7555e41a-97ee-407a-bcf3-0a9e77c81a2c tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1722 microversion: 2.20 time: 0.607844 Feb 12 21:15:47.327950 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1803/3523] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:46 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1722 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:47.333229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:47.334048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:47.343910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:47.344636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:47.345711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:47.346301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:47.420068 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f05db24b-dac8-48b8-8473-b2bf6f496d55 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/7e0e8ab9-d666-46ac-b3a5-d90ddb1cbf03" status: 202 len: 0 microversion: 2.1 time: 0.770411 Feb 12 21:15:47.421648 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1721/3524] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:15:46 2022] DELETE /compute/v2.1/os-security-groups/7e0e8ab9-d666-46ac-b3a5-d90ddb1cbf03 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:47.432119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:47.437312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:47.460405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:47.460882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:47.465085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:47.466642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:47.528620 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-52244110-6de0-43f8-a0ed-1d792c18f1d5 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102798 Feb 12 21:15:47.530398 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1722/3525] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:15:47 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:47.539817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f5346344-cb8a-42c1-8f48-7994eb67debf tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fe024790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:48.156672 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f5346344-cb8a-42c1-8f48-7994eb67debf tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/b0146cfe-42a2-4304-86ec-40af08c26b45" status: 202 len: 0 microversion: 2.1 time: 0.620160 Feb 12 21:15:48.157423 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1723/3526] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:15:47 2022] DELETE /compute/v2.1/os-security-groups/b0146cfe-42a2-4304-86ec-40af08c26b45 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:48.168763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:48.170005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:48.186027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.187996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.188932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.191431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.220414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.232426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.243173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.244780 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c189f452-98b0-4ff7-a73d-165020bf47c7 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2866 microversion: 2.32 time: 0.915863 Feb 12 21:15:48.245387 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1804/3527] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:47 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2866 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:48.257236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f0983c2b-501d-4849-bca7-a0173dd30fb9 req-34c2df89-d5f1-4777-aa1f-e8a2f0f6deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-deleted", "tag": "b2910da7-aefa-45b5-ab32-c4167ae080b7"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:48.259942 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:48.259942 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:48.282911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f0983c2b-501d-4849-bca7-a0173dd30fb9 req-34c2df89-d5f1-4777-aa1f-e8a2f0f6deed service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.282911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f0983c2b-501d-4849-bca7-a0173dd30fb9 req-34c2df89-d5f1-4777-aa1f-e8a2f0f6deed service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.309414 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f0983c2b-501d-4849-bca7-a0173dd30fb9 req-34c2df89-d5f1-4777-aa1f-e8a2f0f6deed service nova] Creating event network-vif-deleted:b2910da7-aefa-45b5-ab32-c4167ae080b7 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:48.327572 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f0983c2b-501d-4849-bca7-a0173dd30fb9 req-34c2df89-d5f1-4777-aa1f-e8a2f0f6deed service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079739 Feb 12 21:15:48.329279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1805/3528] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:48.340581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-baeaaf48-ab79-4549-9f98-749b05c74853 req-f1b6b50f-d10d-4890-955a-37cadcaa2b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbfee9f-78df-472d-8f1a-f8e602fda68d", "name": "network-vif-deleted", "tag": "3ad38511-3f1f-4f22-831b-955591ab9833"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:48.340581 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:48.340581 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:48.358015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-baeaaf48-ab79-4549-9f98-749b05c74853 req-f1b6b50f-d10d-4890-955a-37cadcaa2b8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.359340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-baeaaf48-ab79-4549-9f98-749b05c74853 req-f1b6b50f-d10d-4890-955a-37cadcaa2b8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.377469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-baeaaf48-ab79-4549-9f98-749b05c74853 req-f1b6b50f-d10d-4890-955a-37cadcaa2b8b service nova] Creating event network-vif-deleted:3ad38511-3f1f-4f22-831b-955591ab9833 for instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d on nch2-master-1 Feb 12 21:15:48.388776 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-baeaaf48-ab79-4549-9f98-749b05c74853 req-f1b6b50f-d10d-4890-955a-37cadcaa2b8b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057595 Feb 12 21:15:48.390189 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1806/3529] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:48.406833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ceb903d-999e-4fa8-8dae-da26909d26b3 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] Calling method '.version_select at 0x7fa8fdf1af70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:48.509932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.553717 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f06bde6f-2ec1-4c61-965e-0a099e62b0df tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.389436 Feb 12 21:15:48.554926 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1724/3530] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:48 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:48.562285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-unplugged", "status": "completed", "tag": "cb16a4b9-5c35-4c83-b676-814b33f4354e"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-unplugged", "status": "completed", "tag": "ea9dd83b-8155-49b9-9961-155b1a2273e6"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-unplugged", "status": "completed", "tag": "c03b11d7-ad51-4a19-be11-d54473d9b412"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-unplugged", "status": "completed", "tag": "335b0423-e329-43fd-bea1-28e4856ef8b9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:48.565972 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:48.565972 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:48.574649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.575106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.594274 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Creating event network-vif-unplugged:cb16a4b9-5c35-4c83-b676-814b33f4354e for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:48.596358 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Creating event network-vif-unplugged:ea9dd83b-8155-49b9-9961-155b1a2273e6 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:48.597084 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Creating event network-vif-unplugged:c03b11d7-ad51-4a19-be11-d54473d9b412 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:48.598186 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] Creating event network-vif-unplugged:335b0423-e329-43fd-bea1-28e4856ef8b9 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:48.604179 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-010cd151-6946-4cf0-b375-07baf7ed38ef req-3686eae1-e834-4db4-bc63-0c8311d95584 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.047554 Feb 12 21:15:48.605128 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1725/3531] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:48.610630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:48.611979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:48.619200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.619654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.620821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.621581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.670420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.671318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.671988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lazy-loading 'fault' on Instance uuid 6bbfee9f-78df-472d-8f1a-f8e602fda68d {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:48.814158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.846419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.850651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd856ca6f15d74ea483e6c02dee0e0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2094e607f7bf4345beb838fc2e483911', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:48.856083 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68ab127b-0098-494e-af1e-912a3e023669 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 200 len: 1370 microversion: 2.20 time: 0.249434 Feb 12 21:15:48.857553 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1726/3532] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:48 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:48.870883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:48.872049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:48.886824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.887266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.890135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:48.891118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:48.945746 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b02be05f-e50c-4691-b087-86daed45aeaa tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084655 Feb 12 21:15:48.953231 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1727/3533] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:15:48 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:15:49.270001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:49.270791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:49.281718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:49.284849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:49.284849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:49.286241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:49.558871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ceb903d-999e-4fa8-8dae-da26909d26b3 tempest-SecurityGroupRulesNegativeTestJSON-1111708575 tempest-SecurityGroupRulesNegativeTestJSON-1111708575-project] 10.222.0.31 "DELETE /compute/v2.1/os-security-groups/085b1cdd-534f-4941-b875-6d141ef4b2e6" status: 202 len: 0 microversion: 2.1 time: 1.167024 Feb 12 21:15:49.562487 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1807/3534] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:15:48 2022] DELETE /compute/v2.1/os-security-groups/085b1cdd-534f-4941-b875-6d141ef4b2e6 => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:15:49.580073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:49.580912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:49.588706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:49.589175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:49.590063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:49.595997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:49.855757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:49.865064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:49.866985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:49.871433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6ce701e3-3391-47a1-ae8a-26717971554e tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2706 microversion: 2.32 time: 0.607408 Feb 12 21:15:49.873704 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1728/3535] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:49 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2706 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:49.880721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:49.887033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:49.904168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:49.904975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:49.906051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:49.906705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:49.924448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] HTTP exception thrown: Instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d could not be found. Feb 12 21:15:49.929125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Returning 404 to user: Instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:49.941861 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c548b167-8db9-46ea-aac3-f331da6c1fbe tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 404 len: 111 microversion: 2.20 time: 0.057849 Feb 12 21:15:49.942831 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1729/3536] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:49 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:49.954167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71fb2632-2654-40b2-b6f9-499266a7ed82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '.version_select at 0x7fa8fd920b80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:50.087404 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71fb2632-2654-40b2-b6f9-499266a7ed82 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232732563" status: 204 len: 0 microversion: 2.20 time: 0.128399 Feb 12 21:15:50.087934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:50.092125 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1730/3537] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:15:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232732563 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:15:50.103098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a9d0a41-2829-4d57-a9d5-cda061af9dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.534874 Feb 12 21:15:50.112992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1808/3538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:49 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:50.355309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3f77bfdb-7cc6-4fa8-98ac-02d2dd72af0b req-df8aa6f7-1de7-49c6-b60d-729e81428e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-deleted", "tag": "c03b11d7-ad51-4a19-be11-d54473d9b412"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:50.357340 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:50.357340 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:50.377870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3f77bfdb-7cc6-4fa8-98ac-02d2dd72af0b req-df8aa6f7-1de7-49c6-b60d-729e81428e79 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:50.378986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3f77bfdb-7cc6-4fa8-98ac-02d2dd72af0b req-df8aa6f7-1de7-49c6-b60d-729e81428e79 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:50.408665 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3f77bfdb-7cc6-4fa8-98ac-02d2dd72af0b req-df8aa6f7-1de7-49c6-b60d-729e81428e79 service nova] Creating event network-vif-deleted:c03b11d7-ad51-4a19-be11-d54473d9b412 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:50.418044 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3f77bfdb-7cc6-4fa8-98ac-02d2dd72af0b req-df8aa6f7-1de7-49c6-b60d-729e81428e79 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065053 Feb 12 21:15:50.421809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1731/3539] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:50.660514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-04b409ca-f355-431a-b554-a8a126432c98 req-b771b548-8772-484d-a894-8f035bfce665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae9bb06-a90d-4b9b-914d-6304f6312070", "name": "network-vif-plugged", "status": "completed", "tag": "b855968a-96a6-49b5-ab4f-9065636385f9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:50.662727 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:50.662727 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:50.673881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-04b409ca-f355-431a-b554-a8a126432c98 req-b771b548-8772-484d-a894-8f035bfce665 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:50.674697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-04b409ca-f355-431a-b554-a8a126432c98 req-b771b548-8772-484d-a894-8f035bfce665 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:50.688567 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-04b409ca-f355-431a-b554-a8a126432c98 req-b771b548-8772-484d-a894-8f035bfce665 service nova] Creating event network-vif-plugged:b855968a-96a6-49b5-ab4f-9065636385f9 for instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 on nch1-master-1 Feb 12 21:15:50.694553 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-04b409ca-f355-431a-b554-a8a126432c98 req-b771b548-8772-484d-a894-8f035bfce665 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037561 Feb 12 21:15:50.705486 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1809/3540] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:50.893149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:50.893873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:50.901200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:50.901915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:50.903030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:50.903682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:51.127960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:51.131710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:51.144418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:51.145985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:51.147645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:51.148789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:51.476810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:51.486299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-20d350d9-fbf2-4eb2-8787-3b221e73a616 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.368870 Feb 12 21:15:51.487440 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1810/3541] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:51 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:51.514477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:51.532242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:51.535246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:51.536512 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-347446e1-41e7-47cd-81f9-49d0236401c2 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2545 microversion: 2.32 time: 0.647398 Feb 12 21:15:51.538936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1732/3542] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:50 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2545 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:52.485504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6c7b7a5e-d393-4de5-be18-a3491f616a18 req-71571272-14ff-4079-9cf0-1b654030a900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-deleted", "tag": "ea9dd83b-8155-49b9-9961-155b1a2273e6"}, {"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-deleted", "tag": "335b0423-e329-43fd-bea1-28e4856ef8b9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:52.487375 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:52.487375 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:15:52.500978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6c7b7a5e-d393-4de5-be18-a3491f616a18 req-71571272-14ff-4079-9cf0-1b654030a900 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:52.506127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6c7b7a5e-d393-4de5-be18-a3491f616a18 req-71571272-14ff-4079-9cf0-1b654030a900 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:52.508006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:52.511864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:52.526701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:52.533610 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6c7b7a5e-d393-4de5-be18-a3491f616a18 req-71571272-14ff-4079-9cf0-1b654030a900 service nova] Creating event network-vif-deleted:ea9dd83b-8155-49b9-9961-155b1a2273e6 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:52.535064 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6c7b7a5e-d393-4de5-be18-a3491f616a18 req-71571272-14ff-4079-9cf0-1b654030a900 service nova] Creating event network-vif-deleted:335b0423-e329-43fd-bea1-28e4856ef8b9 for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:52.541631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:52.545418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:52.551825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:52.552723 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6c7b7a5e-d393-4de5-be18-a3491f616a18 req-71571272-14ff-4079-9cf0-1b654030a900 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070479 Feb 12 21:15:52.556121 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1811/3543] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:52.569231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:52.573000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:52.585870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:52.589345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:52.590432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:52.593105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:52.777983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:52.790049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:52.794782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:52.799986 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3baf8d39-8881-49b7-8fd1-5534edb0a3bf tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 2430 microversion: 2.32 time: 0.241507 Feb 12 21:15:52.802258 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1812/3544] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:52 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 2430 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:53.184092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:53.195786 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4cde661-5a9c-4ae1-9523-c52025fe1f98 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1314 microversion: 2.1 time: 0.694682 Feb 12 21:15:53.197059 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1733/3545] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:52 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:53.717429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:53.720145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:53.728089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:53.730992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:53.732384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:53.735002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:53.779250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:15:53.824594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:53.825230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:53.831909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:53.832357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:53.833132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:53.833698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:53.951228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:53.972926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:53.974548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:53.977458 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5ea7e4d-01e1-4dad-ae26-409626239335 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1605 microversion: 2.32 time: 0.156655 Feb 12 21:15:53.990918 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1734/3546] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:53 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:15:54.213589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:54.214200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:54.220132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:54.220579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:54.221386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:54.221812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:54.244372 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4624466e-5855-4126-b3a1-2d6a3a3fd2ac tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 204 len: 0 microversion: 2.1 time: 0.527740 Feb 12 21:15:54.245847 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1813/3547] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:15:53 2022] DELETE /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:15:54.267840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:54.267840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:54.267840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:54.267840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:54.267840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:54.267840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:54.402201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:54.411661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5a098b9-0fb9-446b-89ac-5586c955e880 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1500 microversion: 2.1 time: 0.201235 Feb 12 21:15:54.441257 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1735/3548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:54 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1500 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:54.594404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-173313ac-052e-43b1-9c9a-493348832745 req-9a629d00-d6ad-44e1-865b-0e6f87f61aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50535b70-1208-4528-82ce-f59f6d18a030", "name": "network-vif-deleted", "tag": "cb16a4b9-5c35-4c83-b676-814b33f4354e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:54.596459 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:54.596459 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:54.610373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-173313ac-052e-43b1-9c9a-493348832745 req-9a629d00-d6ad-44e1-865b-0e6f87f61aa2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:54.610830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-173313ac-052e-43b1-9c9a-493348832745 req-9a629d00-d6ad-44e1-865b-0e6f87f61aa2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:54.650869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-173313ac-052e-43b1-9c9a-493348832745 req-9a629d00-d6ad-44e1-865b-0e6f87f61aa2 service nova] Creating event network-vif-deleted:cb16a4b9-5c35-4c83-b676-814b33f4354e for instance 50535b70-1208-4528-82ce-f59f6d18a030 on nch1-master-1 Feb 12 21:15:54.669907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-173313ac-052e-43b1-9c9a-493348832745 req-9a629d00-d6ad-44e1-865b-0e6f87f61aa2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079848 Feb 12 21:15:54.671223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1736/3549] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:54.706884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:54.715223 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4fd5c558-e218-46c2-8532-00a8d8f6d22b tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1515 microversion: 2.1 time: 0.460905 Feb 12 21:15:54.716487 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1814/3550] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:54 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:54.999950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:55.000653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:55.007995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:55.008444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:55.010001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:55.010765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:55.087726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:55.088598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:55.089267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lazy-loading 'fault' on Instance uuid 50535b70-1208-4528-82ce-f59f6d18a030 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:55.162238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:55.175315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:55.179184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d5e8baa8b2d40f5ae21571ff953b9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ff07a97663458e87406ec3a5e2cf1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:55.181789 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-73a25511-3026-483f-95da-860975301bc4 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 200 len: 1610 microversion: 2.32 time: 0.185489 Feb 12 21:15:55.182559 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1737/3551] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:54 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 1610 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:15:55.732207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:55.732934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:55.747154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:55.747621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:55.748440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:55.749004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:56.012328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:56.043730 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a092724f-fbc1-4204-8d52-d8c5ad4f2eab tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1515 microversion: 2.1 time: 0.311728 Feb 12 21:15:56.054838 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1815/3552] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:55 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:56.213955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:56.215225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:56.224898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:56.225374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:56.226206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:56.226633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:56.241987 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] HTTP exception thrown: Instance 50535b70-1208-4528-82ce-f59f6d18a030 could not be found. Feb 12 21:15:56.242829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Returning 404 to user: Instance 50535b70-1208-4528-82ce-f59f6d18a030 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:56.244240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb285a22-78b1-4bab-830b-a63b08033b19 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 404 len: 111 microversion: 2.32 time: 0.045627 Feb 12 21:15:56.245111 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1738/3553] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:56 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:56.253391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d8d24aba-20e5-479e-96d8-a21c007aa88b tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '.version_select at 0x7fa8fdf399d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:56.422327 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d8d24aba-20e5-479e-96d8-a21c007aa88b tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526943967" status: 204 len: 0 microversion: 2.32 time: 0.172737 Feb 12 21:15:56.431773 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1816/3554] 10.222.0.31 () {60 vars in 1261 bytes} [Sat Feb 12 21:15:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526943967 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 12 21:15:56.600076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-21d7adbf-8973-4698-ad57-0ffe1c32b343 req-7696f34c-ca7e-4ff1-b5c9-5b53620baba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d91404c-a99f-42d1-9b08-8fcd8f700a71", "name": "network-vif-deleted", "tag": "db82307b-d41e-4a9f-8142-3bf9bdf0c157"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:56.606188 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:15:56.606188 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:15:56.613748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-21d7adbf-8973-4698-ad57-0ffe1c32b343 req-7696f34c-ca7e-4ff1-b5c9-5b53620baba0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:56.615214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-21d7adbf-8973-4698-ad57-0ffe1c32b343 req-7696f34c-ca7e-4ff1-b5c9-5b53620baba0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:56.641554 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-21d7adbf-8973-4698-ad57-0ffe1c32b343 req-7696f34c-ca7e-4ff1-b5c9-5b53620baba0 service nova] Creating event network-vif-deleted:db82307b-d41e-4a9f-8142-3bf9bdf0c157 for instance 1d91404c-a99f-42d1-9b08-8fcd8f700a71 on nch2-master-1 Feb 12 21:15:56.653555 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-21d7adbf-8973-4698-ad57-0ffe1c32b343 req-7696f34c-ca7e-4ff1-b5c9-5b53620baba0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057129 Feb 12 21:15:56.654492 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1739/3555] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:15:57.061923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:57.062831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:57.079087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.081078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.084531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.085843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.175272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.178123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.180251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'fault' on Instance uuid 1d91404c-a99f-42d1-9b08-8fcd8f700a71 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:15:57.304950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:57.315103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b5497ee2-a255-4963-b24d-10062e005eb6 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 200 len: 1308 microversion: 2.1 time: 0.257959 Feb 12 21:15:57.325844 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1740/3556] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:57 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:15:57.343808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1601536417", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "ff440b46-6a14-40a5-92a6-786d1475ba12"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:57.429032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] validate_networks() for [('ff440b46-6a14-40a5-92a6-786d1475ba12', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:15:57.474793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "529282b2-ffa4-43d7-8822-61c791cd9d78"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:15:57.476069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:57.495783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.499745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.500854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.501326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.939489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:15:57.940173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:15:57.940817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:15:57.941445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:15:57.942053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:15:57.951653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.952598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.953538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:57.954187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:57.977084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Getting quotas for project 3058088956ea426cb1bfcbbc131c6ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:15:57.983447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Getting quotas for user d334e4f89c4048ca96c5bc8fed4f5bc9 and project 3058088956ea426cb1bfcbbc131c6ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:15:57.998423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:15:58.002749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:15:58.144169 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6696abf6-8986-40bc-abbb-6184d4cb5665 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232761 Feb 12 21:15:58.144882 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1817/3557] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:15:58.154596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-61555ec1-db69-42a2-bafd-4c9185055071 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:58.155195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-61555ec1-db69-42a2-bafd-4c9185055071 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:58.223199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-61555ec1-db69-42a2-bafd-4c9185055071 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:58.230347 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-61555ec1-db69-42a2-bafd-4c9185055071 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1225 microversion: 2.1 time: 0.079302 Feb 12 21:15:58.232142 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1818/3558] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:58 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:15:58.293402 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7dcb042a-4b80-4b85-8e82-66df892d2705 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823024 Feb 12 21:15:58.294644 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1741/3559] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:15:57 2022] POST /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:15:58.333986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:58.335049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 1d91404c-a99f-42d1-9b08-8fcd8f700a71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:58.357481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:58.375038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:58.380054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:58.381413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:58.433607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] HTTP exception thrown: Instance 1d91404c-a99f-42d1-9b08-8fcd8f700a71 could not be found. Feb 12 21:15:58.435313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Returning 404 to user: Instance 1d91404c-a99f-42d1-9b08-8fcd8f700a71 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:58.437122 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d139debf-2673-4d32-9d4a-b442b1d14848 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71" status: 404 len: 111 microversion: 2.1 time: 0.108963 Feb 12 21:15:58.447794 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1819/3560] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:58 2022] GET /compute/v2.1/servers/1d91404c-a99f-42d1-9b08-8fcd8f700a71 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:15:58.825206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:58.826323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:58.841625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:58.842189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:58.843876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:58.845691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:58.892703 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] HTTP exception thrown: Instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d could not be found. Feb 12 21:15:58.893324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Returning 404 to user: Instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:58.894212 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d3bb333-f7fd-465f-8659-8e8ac9fdd6d0 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 404 len: 111 microversion: 2.20 time: 0.075171 Feb 12 21:15:58.899218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1742/3561] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:15:58 2022] DELETE /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:15:58.904291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:58.904967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: 6bbfee9f-78df-472d-8f1a-f8e602fda68d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:58.912349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:58.913071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:58.914280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:15:58.916323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:15:58.932671 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] HTTP exception thrown: Instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d could not be found. Feb 12 21:15:58.933686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Returning 404 to user: Instance 6bbfee9f-78df-472d-8f1a-f8e602fda68d could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:15:58.934744 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f429484-09c8-4dc6-8fd0-57c55d361426 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d" status: 404 len: 111 microversion: 2.20 time: 0.035810 Feb 12 21:15:58.935754 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1820/3562] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:15:58 2022] GET /compute/v2.1/servers/6bbfee9f-78df-472d-8f1a-f8e602fda68d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:15:59.248716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1e7f493-5122-4b2f-a371-9c1e9f3e6feb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:15:59.249710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d1e7f493-5122-4b2f-a371-9c1e9f3e6feb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:15:59.382976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d1e7f493-5122-4b2f-a371-9c1e9f3e6feb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:15:59.399225 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1e7f493-5122-4b2f-a371-9c1e9f3e6feb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1225 microversion: 2.1 time: 0.154066 Feb 12 21:15:59.400888 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1743/3563] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:15:59 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:00.421935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:00.421935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:00.427921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:00.428716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:00.429881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:00.431339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:00.509882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:00.519689 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b591a0bc-fd57-4dac-82dc-dbce714e91cf tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1221 microversion: 2.1 time: 0.105128 Feb 12 21:16:00.524756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1821/3564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:00 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:01.541694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:01.544345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:01.551588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:01.552115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:01.553000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:01.555861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:01.697666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:01.712143 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30581b5a-51bc-495d-b18a-e5afd0db2680 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1295 microversion: 2.1 time: 0.174201 Feb 12 21:16:01.717549 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1744/3565] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:01 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1295 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:01.722453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:01.723761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:01.736511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:01.738678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:01.743901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:01.743901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:01.762881 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] HTTP exception thrown: Instance 50535b70-1208-4528-82ce-f59f6d18a030 could not be found. Feb 12 21:16:01.772917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Returning 404 to user: Instance 50535b70-1208-4528-82ce-f59f6d18a030 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:01.772917 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2294482b-40c8-4504-a7ac-49c0b28e12ec tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "DELETE /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 404 len: 111 microversion: 2.32 time: 0.046501 Feb 12 21:16:01.772917 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1822/3566] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:16:01 2022] DELETE /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:16:01.779137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:01.780092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] [instance: 50535b70-1208-4528-82ce-f59f6d18a030] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:01.786828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:01.787750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:01.788746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:01.789260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:01.804673 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] HTTP exception thrown: Instance 50535b70-1208-4528-82ce-f59f6d18a030 could not be found. Feb 12 21:16:01.805278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] Returning 404 to user: Instance 50535b70-1208-4528-82ce-f59f6d18a030 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:01.806331 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60529778-f2d9-4f2f-a81c-72bc8c234615 tempest-TaggedBootDevicesTest-172445176 tempest-TaggedBootDevicesTest-172445176-project] 10.222.0.31 "GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030" status: 404 len: 111 microversion: 2.32 time: 0.032097 Feb 12 21:16:01.807285 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1745/3567] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:16:01 2022] GET /compute/v2.1/servers/50535b70-1208-4528-82ce-f59f6d18a030 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:16:02.740289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:02.741117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:02.755020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:02.761843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:02.761843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:02.761843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:02.938059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:02.944438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-235e5388-c7f4-4317-8659-31695281835d tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.208017 Feb 12 21:16:02.954272 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1823/3568] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:02 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:02.966650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:02.967236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:02.974839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:02.975136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:02.975933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:02.976374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.022443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:03.338277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-20820288", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2d5eca5e-b457-4c36-8b4b-a1a450e04c3e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:03.389345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] validate_networks() for [('2d5eca5e-b457-4c36-8b4b-a1a450e04c3e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:03.420685 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4174c309-cec9-4577-9098-9205e990fb36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 204 len: 0 microversion: 2.1 time: 0.457185 Feb 12 21:16:03.421450 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1746/3569] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:02 2022] DELETE /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:03.429879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:03.431629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:03.437979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.438713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.439707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.440332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.639189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:03.647334 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc49aee0-3a60-437e-80bd-d5e31b3afaa0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1552 microversion: 2.1 time: 0.221518 Feb 12 21:16:03.647914 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1747/3570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:03 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:03.652809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d73b2cd1-3507-40a7-9dce-3d9b0b888315 req-53a98386-23f6-4257-a122-a4fbbfd42d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aff75cf-3c7c-456b-a559-da1ccacbaaa4", "tag": "e8a54c09-68ac-47cc-a91f-59040d0d1f70"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:03.655111 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:03.655111 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:03.662547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d73b2cd1-3507-40a7-9dce-3d9b0b888315 req-53a98386-23f6-4257-a122-a4fbbfd42d56 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.663010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d73b2cd1-3507-40a7-9dce-3d9b0b888315 req-53a98386-23f6-4257-a122-a4fbbfd42d56 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.675615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d73b2cd1-3507-40a7-9dce-3d9b0b888315 req-53a98386-23f6-4257-a122-a4fbbfd42d56 service nova] Creating event network-changed:e8a54c09-68ac-47cc-a91f-59040d0d1f70 for instance 0aff75cf-3c7c-456b-a559-da1ccacbaaa4 on nch2-master-1 Feb 12 21:16:03.682643 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d73b2cd1-3507-40a7-9dce-3d9b0b888315 req-53a98386-23f6-4257-a122-a4fbbfd42d56 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Feb 12 21:16:03.686774 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1748/3571] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:03.812932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:03.813570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:03.814077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:03.815358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:03.815673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:03.825616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.826180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.827060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.827581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.846243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Getting quotas for project 34fc2aeace2346329e2035646bdd4a65. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:03.855992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Getting quotas for user 7ec5b1c037d942efb8b2d455f7b6a760 and project 34fc2aeace2346329e2035646bdd4a65. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:03.869853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Going to run 2 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:03.872237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a7801aa5-334a-47b7-b62f-943a2af82d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:03.965205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:03.965943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:03.973665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.976653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.976653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:03.976653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:03.997430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=a7801aa5-334a-47b7-b62f-943a2af82d82,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:04.158789 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cf369b1-e57e-4201-bf9d-cb5e8eee194f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106035 Feb 12 21:16:04.159578 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1824/3572] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:16:04.170317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:04.174143 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:04.174143 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:04.175457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:04.176305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Searching by: {'deleted': False, 'project_id': '34fc2aeace2346329e2035646bdd4a65'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:16:04.204008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:04.204551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:04.205631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:04.206177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:04.245532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-570e09b7-ca61-4e92-ae45-0812fe79718d tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.074503 Feb 12 21:16:04.245532 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1825/3573] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:16:04 2022] GET /compute/v2.1/servers => generated 673 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:04.256095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-11c27b85-0d6f-4894-8a73-3f839dc82017 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:04.256797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-11c27b85-0d6f-4894-8a73-3f839dc82017 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:04.348354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-11c27b85-0d6f-4894-8a73-3f839dc82017 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:04.356719 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-11c27b85-0d6f-4894-8a73-3f839dc82017 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1218 microversion: 2.1 time: 0.105402 Feb 12 21:16:04.357828 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1826/3574] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:04 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:04.441189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:04.448927 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5f09da92-9c24-42dd-bed3-70a1299f484f tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.488123 Feb 12 21:16:04.449577 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1749/3575] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:03 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:04.670525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:04.671166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:04.677696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:04.678267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:04.679167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:04.679707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:04.833453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:04.845905 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47a80710-fc97-48bf-a91a-525ab9572e2f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1552 microversion: 2.1 time: 0.176818 Feb 12 21:16:04.845905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1827/3576] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:04 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:05.374263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82e1e27b-60db-4a84-943a-37fb7944d00f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:05.375466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82e1e27b-60db-4a84-943a-37fb7944d00f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:05.434396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-82e1e27b-60db-4a84-943a-37fb7944d00f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:05.441023 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82e1e27b-60db-4a84-943a-37fb7944d00f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1218 microversion: 2.1 time: 0.070483 Feb 12 21:16:05.444592 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1750/3577] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:05 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:05.468555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:05.469242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:05.476157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:05.476811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:05.478364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:05.479995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:05.737981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:05.746850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e1ea1033-9881-45a9-afd7-3c41bd26eb74 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.284564 Feb 12 21:16:05.756606 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1828/3578] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:05 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:05.862198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:05.862844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:05.872897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:05.873275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:05.874366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:05.875405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:05.947332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:05.959050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-cbdc354f-7d49-4434-9a88-df794b22f353 req-8da79a3d-53ed-494d-a2ef-50c028ed2546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ae9bb06-a90d-4b9b-914d-6304f6312070", "name": "network-vif-deleted", "tag": "b855968a-96a6-49b5-ab4f-9065636385f9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:05.961270 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:05.961270 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:05.965324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-46fd53bd-f75c-404b-8fa4-d72c7fb82b90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1510 microversion: 2.1 time: 0.106686 Feb 12 21:16:05.966081 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1751/3579] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:05 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1510 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:05.975341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cbdc354f-7d49-4434-9a88-df794b22f353 req-8da79a3d-53ed-494d-a2ef-50c028ed2546 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:05.975882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cbdc354f-7d49-4434-9a88-df794b22f353 req-8da79a3d-53ed-494d-a2ef-50c028ed2546 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:05.987336 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-cbdc354f-7d49-4434-9a88-df794b22f353 req-8da79a3d-53ed-494d-a2ef-50c028ed2546 service nova] Creating event network-vif-deleted:b855968a-96a6-49b5-ab4f-9065636385f9 for instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 on nch1-master-1 Feb 12 21:16:05.992706 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-cbdc354f-7d49-4434-9a88-df794b22f353 req-8da79a3d-53ed-494d-a2ef-50c028ed2546 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037990 Feb 12 21:16:05.995168 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1829/3580] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:06.459095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:06.459638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:06.467123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:06.467577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:06.468369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:06.469032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:06.546176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:06.553800 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea4cd81f-4596-4592-851c-d16888807150 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1222 microversion: 2.1 time: 0.098282 Feb 12 21:16:06.554383 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1752/3581] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:06 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:06.764664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:06.765388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:06.771973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:06.772439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:06.773225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:06.773710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:06.932577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:06.938524 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5bf0eee-9050-4995-b4e8-193d559b7774 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.178918 Feb 12 21:16:06.945883 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1830/3582] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:06 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:06.984175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:06.984832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:06.992331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:06.992972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:06.994341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:06.995464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.033793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.034255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.034711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lazy-loading 'fault' on Instance uuid 0ae9bb06-a90d-4b9b-914d-6304f6312070 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:07.081160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:07.090760 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6b6c4535-1d5f-485f-afb9-abad02ecdc39 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 200 len: 1350 microversion: 2.1 time: 0.110415 Feb 12 21:16:07.091615 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1753/3583] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:06 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 1350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:07.232382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:07.232892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:07.242034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.242503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.243310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.244487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.276544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:07.570567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:07.571190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:07.580844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.583608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.584655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.585269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.716823 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-424e799e-0244-4c0c-b107-d758a8c7c298 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 204 len: 0 microversion: 2.1 time: 0.488004 Feb 12 21:16:07.723309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1831/3584] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:07 2022] DELETE /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:07.736288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:07.738891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:07.753759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:07.766830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.771760 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14f2a187-e3ea-4888-8931-044e94879130 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1278 microversion: 2.1 time: 0.205203 Feb 12 21:16:07.772368 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1754/3585] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:07 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:07.773091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.775774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.776464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.797236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:07.798774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:07.815945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.816970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.818352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.819021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.834403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] HTTP exception thrown: Instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 could not be found. Feb 12 21:16:07.838789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Returning 404 to user: Instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:07.839990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-917e48de-7a2c-4f95-aa89-83aa7f560265 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 404 len: 111 microversion: 2.20 time: 0.062827 Feb 12 21:16:07.843020 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1755/3586] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:16:07 2022] DELETE /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:16:07.850958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:07.851582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] [instance: ad7ceb24-719e-4fcb-b272-f1ed4dbd8514] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:07.864359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.864821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.865672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.866123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.888647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] HTTP exception thrown: Instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 could not be found. Feb 12 21:16:07.889696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] Returning 404 to user: Instance ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:07.890905 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a506d34e-c60d-4a87-8809-4fcbb027ad84 tempest-AttachVolumeShelveTestJSON-271936705 tempest-AttachVolumeShelveTestJSON-271936705-project] 10.222.0.31 "GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514" status: 404 len: 111 microversion: 2.20 time: 0.043592 Feb 12 21:16:07.893301 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1756/3587] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:16:07 2022] GET /compute/v2.1/servers/ad7ceb24-719e-4fcb-b272-f1ed4dbd8514 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:16:07.957937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:07.958789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:07.967847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.968832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:07.971037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:07.972368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.205336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:08.215294 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77a1273b-b095-46f4-b7c7-cbb68eda8da9 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1514 microversion: 2.1 time: 0.490315 Feb 12 21:16:08.216159 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1832/3588] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:07 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1514 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:08.231360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:08.232310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:08.239451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:08.240751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.243015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:08.243015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.260880 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. Feb 12 21:16:08.262223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:08.263375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b223151-0f87-4b7a-983d-cf2db2ada9c6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 404 len: 111 microversion: 2.1 time: 0.036351 Feb 12 21:16:08.271116 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1833/3589] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:08 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:08.335766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:08.345042 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-540132d1-8f54-4733-b67e-dedcdda02c8c tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.391846 Feb 12 21:16:08.346004 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1757/3590] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:07 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:08.374637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:08.374637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:08.393302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:08.393891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.396928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:08.397432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.434522 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. Feb 12 21:16:08.438208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:08.439400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c75b6c5b-2860-4040-aac6-f8034a70b712 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074376 Feb 12 21:16:08.442700 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1834/3591] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:16:08 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:08.639411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1093250676", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:08.719987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:08.794156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:08.794795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:08.812597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:08.813497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.814555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:08.815004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:08.933585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:08.941633 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d31aaf8-621a-4582-8f23-0f8fa23598cd tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1276 microversion: 2.1 time: 0.152706 Feb 12 21:16:08.945469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1835/3592] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:08 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:09.236463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:09.236463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:09.249251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.251611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.253977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.255976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.551383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:09.552081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:09.553142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:09.553773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:09.554395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:09.569537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.572936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.575175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.578052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.606938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:09.621743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:09.638144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:09.641970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:09.749740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:09.779028 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-02aa1a10-e8b6-4a41-b36f-9b36af017406 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1514 microversion: 2.1 time: 0.549766 Feb 12 21:16:09.789022 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1836/3593] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:09 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1514 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:09.802810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:09.803654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:09.810940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.811729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.812725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.813679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.867732 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2e3d1bd7-b8e6-4ffb-8c47-b7fa89393b22 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232083 Feb 12 21:16:09.868772 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1758/3594] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:16:09.878383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a9022d4c-4801-44b1-8100-7ed72e1b92c5 req-523363c5-999d-4bec-a523-fa7c425eabcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aff75cf-3c7c-456b-a559-da1ccacbaaa4", "name": "network-vif-plugged", "status": "completed", "tag": "e8a54c09-68ac-47cc-a91f-59040d0d1f70"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:09.880311 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:09.880311 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:09.891764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a9022d4c-4801-44b1-8100-7ed72e1b92c5 req-523363c5-999d-4bec-a523-fa7c425eabcd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:09.892516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a9022d4c-4801-44b1-8100-7ed72e1b92c5 req-523363c5-999d-4bec-a523-fa7c425eabcd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:09.944397 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a9022d4c-4801-44b1-8100-7ed72e1b92c5 req-523363c5-999d-4bec-a523-fa7c425eabcd service nova] Creating event network-vif-plugged:e8a54c09-68ac-47cc-a91f-59040d0d1f70 for instance 0aff75cf-3c7c-456b-a559-da1ccacbaaa4 on nch2-master-1 Feb 12 21:16:09.970808 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a9022d4c-4801-44b1-8100-7ed72e1b92c5 req-523363c5-999d-4bec-a523-fa7c425eabcd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100785 Feb 12 21:16:09.998719 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1759/3595] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:10.011122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ce06c59-86e2-4c4a-bf1c-14a50a8cfd62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:10.022671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ce06c59-86e2-4c4a-bf1c-14a50a8cfd62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:10.155095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:10.166694 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49e7df0d-4f1e-436f-aa8d-285bd0f70385 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.372220 Feb 12 21:16:10.167003 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1837/3596] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:09 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:10.172618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:10.173229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:10.208053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:10.209619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:10.211063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:10.211522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:10.598904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:10.610322 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-726115a0-1cd4-4acb-b43a-7beba2a93ba1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.442172 Feb 12 21:16:10.611897 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1838/3597] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:10 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:10.633209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-31592250-603f-4522-82aa-facf0c8786cf req-88fb5b1d-0911-4432-8e5f-8f35ecc88dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7801aa5-334a-47b7-b62f-943a2af82d82", "tag": "3f6aa7d2-ec41-4bb7-b704-52672f8b4073"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:10.639007 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:10.639007 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:10.657456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-31592250-603f-4522-82aa-facf0c8786cf req-88fb5b1d-0911-4432-8e5f-8f35ecc88dc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:10.658376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-31592250-603f-4522-82aa-facf0c8786cf req-88fb5b1d-0911-4432-8e5f-8f35ecc88dc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:10.671582 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-31592250-603f-4522-82aa-facf0c8786cf req-88fb5b1d-0911-4432-8e5f-8f35ecc88dc6 service nova] Creating event network-changed:3f6aa7d2-ec41-4bb7-b704-52672f8b4073 for instance a7801aa5-334a-47b7-b62f-943a2af82d82 on nch1-master-1 Feb 12 21:16:10.677668 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-31592250-603f-4522-82aa-facf0c8786cf req-88fb5b1d-0911-4432-8e5f-8f35ecc88dc6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061720 Feb 12 21:16:10.679007 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1839/3598] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:10.699835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ce06c59-86e2-4c4a-bf1c-14a50a8cfd62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:10.708915 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ce06c59-86e2-4c4a-bf1c-14a50a8cfd62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c" status: 200 len: 1215 microversion: 2.1 time: 0.708557 Feb 12 21:16:10.717580 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1760/3599] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:09 2022] GET /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c => generated 1215 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:10.735323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-204d6fee-bb34-447a-bfce-7a3ecfbbf4c5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:10.736052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-204d6fee-bb34-447a-bfce-7a3ecfbbf4c5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:10.775485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-204d6fee-bb34-447a-bfce-7a3ecfbbf4c5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:10.799912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:10.801129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:10.822932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:10.823986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:10.825522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:10.826254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:10.990319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:10.999325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a2aa835f-2e46-4be2-b7d4-0d782e17a7c1 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1472 microversion: 2.1 time: 0.205594 Feb 12 21:16:11.000579 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1761/3600] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:10 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:11.187038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:11.188022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:11.210328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.211055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.215784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.216528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.543197 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.scheduler.client.report [None req-204d6fee-bb34-447a-bfce-7a3ecfbbf4c5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Deleted allocations for instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c Feb 12 21:16:11.637652 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-204d6fee-bb34-447a-bfce-7a3ecfbbf4c5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c" status: 204 len: 0 microversion: 2.1 time: 0.907898 Feb 12 21:16:11.638332 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1840/3601] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:10 2022] DELETE /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c => generated 0 bytes in 910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:16:11.644844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:11.646724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:11.655941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.656712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.657914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.658622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.731023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:11.741505 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e525ef34-d177-4d1c-b5f0-605069358f4a tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1325 microversion: 2.1 time: 0.561067 Feb 12 21:16:11.750972 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1762/3602] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:11 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1325 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:11.763701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:11.765027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:11.777687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.778152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.779577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.780303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.806721 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c could not be found. Feb 12 21:16:11.807331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:11.808171 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40545f99-8c5b-40e0-b913-ced15a98dc40 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c" status: 404 len: 111 microversion: 2.1 time: 0.061972 Feb 12 21:16:11.809961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1763/3603] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:11 2022] GET /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:11.815201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-16b1643f-ab08-4a8f-8888-2ae50728646d req-11e911fd-745b-4488-8531-ef8307260ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35784dd5-92bd-4601-a897-20bc4969a1f7", "tag": "19908ba6-438c-472f-ad24-2011ccd47a3c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:11.816805 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:11.816805 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:11.825936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-16b1643f-ab08-4a8f-8888-2ae50728646d req-11e911fd-745b-4488-8531-ef8307260ae8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:11.826657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-16b1643f-ab08-4a8f-8888-2ae50728646d req-11e911fd-745b-4488-8531-ef8307260ae8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:11.876422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-16b1643f-ab08-4a8f-8888-2ae50728646d req-11e911fd-745b-4488-8531-ef8307260ae8 service nova] Creating event network-changed:19908ba6-438c-472f-ad24-2011ccd47a3c for instance 35784dd5-92bd-4601-a897-20bc4969a1f7 on nch2-master-1 Feb 12 21:16:11.888948 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-16b1643f-ab08-4a8f-8888-2ae50728646d req-11e911fd-745b-4488-8531-ef8307260ae8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075572 Feb 12 21:16:11.890198 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1764/3604] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:11.932561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:11.941749 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36e16e5a-0f1a-4bc8-9a1f-ca356c3c2ef9 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.301579 Feb 12 21:16:11.942990 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1841/3605] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:11 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:11.975427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-969885163", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:12.021333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:12.022202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:12.033031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.033031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.033031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.033031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.042387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:12.065906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.066435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.066902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'fault' on Instance uuid 98699803-4a38-4e99-96bc-3fee5a9a03ef {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:12.108569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:12.117235 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03b1af44-da29-45f4-a4a3-a2a511371303 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 200 len: 1308 microversion: 2.1 time: 0.100814 Feb 12 21:16:12.117899 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1842/3606] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:12 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:12.705621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5db1dc2f-2c31-4466-998e-b722dc0f6c9a req-75ca5de2-1cd1-4d13-a137-498f3f3d60ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98699803-4a38-4e99-96bc-3fee5a9a03ef", "name": "network-vif-deleted", "tag": "2a51fe93-35ae-44b2-b89e-8ca15e049fcb"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:12.707310 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:12.707310 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:12.715717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5db1dc2f-2c31-4466-998e-b722dc0f6c9a req-75ca5de2-1cd1-4d13-a137-498f3f3d60ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.716884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5db1dc2f-2c31-4466-998e-b722dc0f6c9a req-75ca5de2-1cd1-4d13-a137-498f3f3d60ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.730433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5db1dc2f-2c31-4466-998e-b722dc0f6c9a req-75ca5de2-1cd1-4d13-a137-498f3f3d60ba service nova] Creating event network-vif-deleted:2a51fe93-35ae-44b2-b89e-8ca15e049fcb for instance 98699803-4a38-4e99-96bc-3fee5a9a03ef on nch2-master-1 Feb 12 21:16:12.737094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5db1dc2f-2c31-4466-998e-b722dc0f6c9a req-75ca5de2-1cd1-4d13-a137-498f3f3d60ba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038201 Feb 12 21:16:12.737858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1843/3607] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:12.767206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:12.768058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:12.774403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.775195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.775999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.780319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.867956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:12.869876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:12.870871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:12.871454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:12.871872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:12.881634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.882084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.882946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:12.883384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:12.904410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:12.909868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:12.926135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:12.929257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:13.098590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5792f11-2e04-498c-8e2b-526df747fc4a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129360 Feb 12 21:16:13.099804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1765/3608] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:16:13.107424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.108426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:13.116861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.117582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.119094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.119717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.244122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:13.256210 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa2d6027-e139-4ce3-a128-109504e1e0fb tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1522 microversion: 2.1 time: 0.493371 Feb 12 21:16:13.256831 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1844/3609] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:12 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:13.262056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-51e782db-baab-4509-a1b2-5b169a5a1ff7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.270334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-51e782db-baab-4509-a1b2-5b169a5a1ff7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:13.357066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51e782db-baab-4509-a1b2-5b169a5a1ff7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:13.370257 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-51e782db-baab-4509-a1b2-5b169a5a1ff7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1214 microversion: 2.1 time: 0.109859 Feb 12 21:16:13.370924 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1845/3610] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:13 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:13.379373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.380000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 98699803-4a38-4e99-96bc-3fee5a9a03ef] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:13.407883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.408601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.409625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.410214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.445867 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] HTTP exception thrown: Instance 98699803-4a38-4e99-96bc-3fee5a9a03ef could not be found. Feb 12 21:16:13.447749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Returning 404 to user: Instance 98699803-4a38-4e99-96bc-3fee5a9a03ef could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:13.449578 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fb9fbc1-34a9-4442-8763-7f49883b1b4f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef" status: 404 len: 111 microversion: 2.1 time: 0.073866 Feb 12 21:16:13.456819 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1846/3611] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:13 2022] GET /compute/v2.1/servers/98699803-4a38-4e99-96bc-3fee5a9a03ef => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:13.462776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.467837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:13.484483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.486308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.487341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.488963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.543246 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] HTTP exception thrown: Instance is not a member of specified network Feb 12 21:16:13.550322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Returning 404 to user: Instance is not a member of specified network {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:13.551139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b897765-6801-4dc1-8055-2890552e8084 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.092894 Feb 12 21:16:13.551929 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1847/3612] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:16:13 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4/ips/invalid => generated 91 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:16:13.565678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.568123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:13.581768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.586146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.588785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.589450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.625348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:13.637403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e4a9caf-fbee-4cae-ac59-828beda211e1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.535920 Feb 12 21:16:13.638233 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1766/3613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:13 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:13.645272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55757b1b-e5d0-4bec-844b-2223be983bea tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.647581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55757b1b-e5d0-4bec-844b-2223be983bea tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Failed to fetch instance by id 999 {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2891}} Feb 12 21:16:13.650331 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-55757b1b-e5d0-4bec-844b-2223be983bea tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] HTTP exception thrown: Instance 999 could not be found. Feb 12 21:16:13.653754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55757b1b-e5d0-4bec-844b-2223be983bea tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Returning 404 to user: Instance 999 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:13.657698 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55757b1b-e5d0-4bec-844b-2223be983bea tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.015403 Feb 12 21:16:13.661177 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1767/3614] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:16:13 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:16:13.671221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:13.678509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:13.680107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:13.694796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.697723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.700417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:13.702190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:13.769396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:14.209892 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5800282f-82d7-4374-980a-381c1f66679a tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 204 len: 0 microversion: 2.1 time: 0.656800 Feb 12 21:16:14.212969 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81f8c6ff-a692-4683-b813-78730dcdc012 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 204 len: 0 microversion: 2.1 time: 0.536341 Feb 12 21:16:14.213972 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1768/3615] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:13 2022] DELETE /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:14.214398 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1848/3616] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:13 2022] DELETE /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:14.236861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:14.244313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:14.244691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:14.244691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:14.248450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.249242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.250464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.251345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.256243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.256637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.257820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.263915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.506403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:14.516858 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae849d53-3790-4a48-bc31-52804c9486d7 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1514 microversion: 2.1 time: 0.296900 Feb 12 21:16:14.517490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1769/3617] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:14 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1514 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:14.522328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:14.523223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:14.531092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.531892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.532668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.533115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.610999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:14.618967 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d91a525-a334-458f-9855-05a911bc46da tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1218 microversion: 2.1 time: 0.099924 Feb 12 21:16:14.619785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1770/3618] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:14 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:14.657708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:14.658351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:14.665621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.666208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.667025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:14.667469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:14.899130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:14.911090 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71d73e9c-fb47-4fdc-b3e5-d66930f618ac tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.259000 Feb 12 21:16:14.912450 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1771/3619] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:14 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:14.965789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:14.974644 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff68a4b3-905c-4c17-ab48-fb811daf692b tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1528 microversion: 2.1 time: 0.756210 Feb 12 21:16:14.975238 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1849/3620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:14 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1528 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:15.534749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:15.535365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:15.560277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.565778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:15.567375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.568225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:15.643101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:15.643760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:15.652383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.653280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:15.654338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.654988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:15.837301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:15.883712 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-29f5fd22-3ceb-4679-9132-af1c71573e28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1274 microversion: 2.1 time: 0.245937 Feb 12 21:16:15.885215 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1850/3621] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:15 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:15.908629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-33b5e1de-7af5-4290-827b-bdef40cb152f req-edee6645-25f2-42e2-a32a-70fbf00b93cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7801aa5-334a-47b7-b62f-943a2af82d82", "name": "network-vif-plugged", "status": "completed", "tag": "3f6aa7d2-ec41-4bb7-b704-52672f8b4073"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:15.922368 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:15.922368 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:15.935255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-33b5e1de-7af5-4290-827b-bdef40cb152f req-edee6645-25f2-42e2-a32a-70fbf00b93cd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.935994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-33b5e1de-7af5-4290-827b-bdef40cb152f req-edee6645-25f2-42e2-a32a-70fbf00b93cd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:15.951063 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-33b5e1de-7af5-4290-827b-bdef40cb152f req-edee6645-25f2-42e2-a32a-70fbf00b93cd service nova] Creating event network-vif-plugged:3f6aa7d2-ec41-4bb7-b704-52672f8b4073 for instance a7801aa5-334a-47b7-b62f-943a2af82d82 on nch1-master-1 Feb 12 21:16:15.956533 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-33b5e1de-7af5-4290-827b-bdef40cb152f req-edee6645-25f2-42e2-a32a-70fbf00b93cd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056806 Feb 12 21:16:15.957869 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1851/3622] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:15.964213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:15.965289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:15.972556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.973987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:15.975374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:15.976020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.198851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:16.209294 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9593c972-6ff0-4655-9a0e-5d0c84d5d1c2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.249897 Feb 12 21:16:16.210885 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1852/3623] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:15 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:16.236767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:16.238476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:16.252134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:16.255976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.257063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:16.265074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.542056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:16.553558 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-10e91048-c6ae-4a12-af0e-e334470566e8 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1528 microversion: 2.1 time: 0.339524 Feb 12 21:16:16.554593 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1853/3624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:16 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:16.676586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:16.691790 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b1499a07-0b5c-445c-8bd6-ca92b1218033 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1514 microversion: 2.1 time: 1.160745 Feb 12 21:16:16.693342 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1772/3625] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:15 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1514 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:16.905679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:16.906858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:16.916432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:16.917124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.918127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:16.918749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.934462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:16.934973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:16.945978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:16.950100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.951014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:16.951469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:16.987666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:17.190191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:17.201712 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f33d540f-336e-4b8e-ad27-a2851e3eaae6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.299735 Feb 12 21:16:17.202908 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1854/3626] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:16 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:17.230153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:17.236024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:17.263596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.264050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.264869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.265307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.371855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a60f351e-0fe9-431b-93b4-5d936bee90d6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "DELETE /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 204 len: 0 microversion: 2.1 time: 0.441110 Feb 12 21:16:17.374015 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1773/3627] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:16 2022] DELETE /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:17.385059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:17.386155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:17.397275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.397275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.397275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.397275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.635239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:17.661810 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4341025c-9adb-49e9-9c4d-934f08d47052 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.431912 Feb 12 21:16:17.661810 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1855/3628] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:17 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:17.667668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:17.669562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:17.694944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:17.706732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.708676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.709504 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10ca1128-d50e-45dd-8a1f-f6015059e46a tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1665 microversion: 2.1 time: 0.328641 Feb 12 21:16:17.713528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.714045 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1774/3629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:17 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1665 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:17.715831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.726224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:17.729212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:17.746561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.747303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.748393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.749489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.878390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:17.889039 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e28c348a-33d3-44dd-b267-84150a747911 tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1486 microversion: 2.1 time: 0.228953 Feb 12 21:16:17.897454 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1856/3630] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:17 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1486 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:17.935126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-60372c2f-5c27-45b3-872b-d7a5d12a6708 req-c6cdcf9c-8441-49fc-8687-97184a3ca123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae66924-5617-4e45-a05b-3792b2bf1c82", "name": "network-vif-deleted", "tag": "dd227e33-f70a-4937-a239-d5f76f172b3e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:17.936866 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:17.936866 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:17.945891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-60372c2f-5c27-45b3-872b-d7a5d12a6708 req-c6cdcf9c-8441-49fc-8687-97184a3ca123 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.947189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-60372c2f-5c27-45b3-872b-d7a5d12a6708 req-c6cdcf9c-8441-49fc-8687-97184a3ca123 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:17.960008 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-60372c2f-5c27-45b3-872b-d7a5d12a6708 req-c6cdcf9c-8441-49fc-8687-97184a3ca123 service nova] Creating event network-vif-deleted:dd227e33-f70a-4937-a239-d5f76f172b3e for instance eae66924-5617-4e45-a05b-3792b2bf1c82 on nch2-master-1 Feb 12 21:16:17.965962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:17.974003 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-60372c2f-5c27-45b3-872b-d7a5d12a6708 req-c6cdcf9c-8441-49fc-8687-97184a3ca123 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043556 Feb 12 21:16:17.974808 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c64d3f35-e646-461e-8b97-8b4232704b73 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1472 microversion: 2.1 time: 0.259719 Feb 12 21:16:17.975005 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1857/3631] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:17.976680 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1775/3632] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:17 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:17.986287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-393a8a0e-ab80-4dd0-8d9e-409d0691e654 req-efdfb1a0-10a2-4020-b54d-55b6e807c129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35784dd5-92bd-4601-a897-20bc4969a1f7", "name": "network-vif-plugged", "status": "completed", "tag": "19908ba6-438c-472f-ad24-2011ccd47a3c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:17.987939 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:17.987939 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:17.997718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-393a8a0e-ab80-4dd0-8d9e-409d0691e654 req-efdfb1a0-10a2-4020-b54d-55b6e807c129 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:17.998303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-393a8a0e-ab80-4dd0-8d9e-409d0691e654 req-efdfb1a0-10a2-4020-b54d-55b6e807c129 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.012209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-393a8a0e-ab80-4dd0-8d9e-409d0691e654 req-efdfb1a0-10a2-4020-b54d-55b6e807c129 service nova] Creating event network-vif-plugged:19908ba6-438c-472f-ad24-2011ccd47a3c for instance 35784dd5-92bd-4601-a897-20bc4969a1f7 on nch2-master-1 Feb 12 21:16:18.017174 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-393a8a0e-ab80-4dd0-8d9e-409d0691e654 req-efdfb1a0-10a2-4020-b54d-55b6e807c129 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034851 Feb 12 21:16:18.024313 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1858/3633] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:18.220169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:18.220790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:18.237561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.238998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.241455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.242087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.441412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:18.449692 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de68593c-2496-475c-9711-98f0c2843a11 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.233317 Feb 12 21:16:18.451087 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1776/3634] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:18 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:18.477552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bd592907-1938-498a-b545-20d6a1f2e32b req-7bc12436-db89-4dc4-9d87-c3a5bda70fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc9519e0-9ff9-49f2-898e-a7cea01ca2c1", "tag": "70b3cdf4-7ef0-4187-8da4-b1a3092c5dbb"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:18.479629 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:18.479629 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:18.487060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bd592907-1938-498a-b545-20d6a1f2e32b req-7bc12436-db89-4dc4-9d87-c3a5bda70fec service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.487508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bd592907-1938-498a-b545-20d6a1f2e32b req-7bc12436-db89-4dc4-9d87-c3a5bda70fec service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.499351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bd592907-1938-498a-b545-20d6a1f2e32b req-7bc12436-db89-4dc4-9d87-c3a5bda70fec service nova] Creating event network-changed:70b3cdf4-7ef0-4187-8da4-b1a3092c5dbb for instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 on nch1-master-1 Feb 12 21:16:18.504330 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bd592907-1938-498a-b545-20d6a1f2e32b req-7bc12436-db89-4dc4-9d87-c3a5bda70fec service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 Feb 12 21:16:18.505104 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1859/3635] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:18.677706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:18.678439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:18.687430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.687894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.688855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.689300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.733941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:18.733941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:18.737203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.737901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.738866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:18.739472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:18.982224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:18.990907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc90b4ae-9405-4eda-803a-00f974cca13b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1318 microversion: 2.1 time: 0.316831 Feb 12 21:16:19.001389 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1777/3636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:18 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:19.001389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:19.001389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:19.010323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.010323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.010323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.010323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.054662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.055272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.057531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lazy-loading 'fault' on Instance uuid 0aff75cf-3c7c-456b-a559-da1ccacbaaa4 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:19.090810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:19.101409 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-08d1f40f-21a3-4cec-93fa-96fda5d884e6 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1665 microversion: 2.1 time: 0.375627 Feb 12 21:16:19.104617 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1860/3637] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:18 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1665 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:19.113773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:19.114372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:19.123924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.124743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.124870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd334e4f89c4048ca96c5bc8fed4f5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3058088956ea426cb1bfcbbc131c6ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:19.125909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.126633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.136945 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f4b755e-6df0-41f4-b31e-34e917a3c7bd tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 200 len: 1315 microversion: 2.1 time: 0.143960 Feb 12 21:16:19.143603 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1778/3638] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:18 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:19.172588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.173373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.174077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'fault' on Instance uuid eae66924-5617-4e45-a05b-3792b2bf1c82 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:19.316340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:19.326388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea12c70b-eb5f-44bd-9648-5163efabe4b8 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 200 len: 1308 microversion: 2.1 time: 0.220651 Feb 12 21:16:19.326985 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1861/3639] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:19 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:19.467280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:19.468084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:19.479465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.481678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.484178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.484829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:19.719014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:19.724628 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df0b8b0d-b81d-470f-a7bf-c3cc71745553 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.261548 Feb 12 21:16:19.725223 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1779/3640] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:19 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:19.989748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f95ab3b9-0ae1-4acd-a9a6-988ae0748df0 req-c3d1382d-6eb6-4353-987e-f3950240e9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aff75cf-3c7c-456b-a559-da1ccacbaaa4", "name": "network-vif-deleted", "tag": "e8a54c09-68ac-47cc-a91f-59040d0d1f70"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:19.991437 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:19.991437 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:19.999240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f95ab3b9-0ae1-4acd-a9a6-988ae0748df0 req-c3d1382d-6eb6-4353-987e-f3950240e9ab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:19.999615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f95ab3b9-0ae1-4acd-a9a6-988ae0748df0 req-c3d1382d-6eb6-4353-987e-f3950240e9ab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.008006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.008621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.012302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f95ab3b9-0ae1-4acd-a9a6-988ae0748df0 req-c3d1382d-6eb6-4353-987e-f3950240e9ab service nova] Creating event network-vif-deleted:e8a54c09-68ac-47cc-a91f-59040d0d1f70 for instance 0aff75cf-3c7c-456b-a559-da1ccacbaaa4 on nch2-master-1 Feb 12 21:16:20.015400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.015844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.016705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.017149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.018031 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f95ab3b9-0ae1-4acd-a9a6-988ae0748df0 req-c3d1382d-6eb6-4353-987e-f3950240e9ab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031663 Feb 12 21:16:20.019147 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1862/3641] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:20.122694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.124266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.131076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.131747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.132546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.132975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.239841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:20.248625 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a6a9012-46bb-414e-95ae-a73961f3275e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 200 len: 1507 microversion: 2.1 time: 0.243937 Feb 12 21:16:20.251779 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1780/3642] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:20 2022] GET /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:20.256590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.257467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] [instance: 0aff75cf-3c7c-456b-a559-da1ccacbaaa4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.269556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.270274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.271252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.271927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.286818 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] HTTP exception thrown: Instance 0aff75cf-3c7c-456b-a559-da1ccacbaaa4 could not be found. Feb 12 21:16:20.287711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] Returning 404 to user: Instance 0aff75cf-3c7c-456b-a559-da1ccacbaaa4 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:20.288737 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4735d582-386f-45ae-9b22-70b20fb989ff tempest-ServerAddressesNegativeTestJSON-258199324 tempest-ServerAddressesNegativeTestJSON-258199324-project] 10.222.0.31 "GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4" status: 404 len: 111 microversion: 2.1 time: 0.035703 Feb 12 21:16:20.289494 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1781/3643] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:20 2022] GET /compute/v2.1/servers/0aff75cf-3c7c-456b-a559-da1ccacbaaa4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:20.304630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.305425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a7801aa5-334a-47b7-b62f-943a2af82d82] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.317088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.317732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.318987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.319305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.330787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:20.343500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3997aba-8b8a-4f5b-a959-8e446666e1f5 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1597 microversion: 2.1 time: 0.226472 Feb 12 21:16:20.349483 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1863/3644] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:20 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1597 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:20.363534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.364521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: eae66924-5617-4e45-a05b-3792b2bf1c82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.379172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.385029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.386450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.387270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.440358 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] HTTP exception thrown: Instance eae66924-5617-4e45-a05b-3792b2bf1c82 could not be found. Feb 12 21:16:20.447004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Returning 404 to user: Instance eae66924-5617-4e45-a05b-3792b2bf1c82 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:20.450126 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fcf2ef55-922e-45d7-a3ac-d40bbc3b8d46 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82" status: 404 len: 111 microversion: 2.1 time: 0.099366 Feb 12 21:16:20.450767 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1864/3645] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:20 2022] GET /compute/v2.1/servers/eae66924-5617-4e45-a05b-3792b2bf1c82 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:20.683474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:20.692208 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c15228c0-2eb2-4163-a1ba-f5c70fa40a1f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/a7801aa5-334a-47b7-b62f-943a2af82d82" status: 200 len: 1506 microversion: 2.1 time: 0.401029 Feb 12 21:16:20.704523 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1782/3646] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:20 2022] GET /compute/v2.1/servers/a7801aa5-334a-47b7-b62f-943a2af82d82 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:20.709255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.709818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a7801aa5-334a-47b7-b62f-943a2af82d82] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.717909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.721510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.721510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.721510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.741829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:20.742521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:20.746813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a7801aa5-334a-47b7-b62f-943a2af82d82] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:20.751652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.753554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:20.754877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:20.756415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:21.100334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:21.125006 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40d88fa2-a4a9-4a20-bc7e-3f5f00fcdc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.386697 Feb 12 21:16:21.128546 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1783/3647] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:20 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:21.242098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a2f9a426-d66a-4b81-aeff-cfc65c9bd91f tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a7801aa5-334a-47b7-b62f-943a2af82d82" status: 204 len: 0 microversion: 2.1 time: 0.532274 Feb 12 21:16:21.242098 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1865/3648] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:20 2022] DELETE /compute/v2.1/servers/a7801aa5-334a-47b7-b62f-943a2af82d82 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:16:21.249292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:21.250148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:21.258395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:21.262875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:21.262875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:21.262875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:21.291506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: 35784dd5-92bd-4601-a897-20bc4969a1f7] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:21.371683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:21.373433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:21.380896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:21.381910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:21.387303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:21.387303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:21.422086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:21.422086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:21.422086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lazy-loading 'fault' on Instance uuid aed342e0-10ca-4835-ad0d-cf55a6aabc75 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:21.464253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f722c48df9c9480a924039b1cfe3b2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5577c08c6bb4cc0bec1ad0fe18260ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:21.472424 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-742423d3-0d3e-4eee-805b-437670e13590 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 200 len: 1315 microversion: 2.1 time: 0.110204 Feb 12 21:16:21.473169 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1866/3649] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:21 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 1315 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:21.666399 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59463285-3576-4a72-a45a-3c783b73b538 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "DELETE /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7" status: 204 len: 0 microversion: 2.1 time: 0.421365 Feb 12 21:16:21.676898 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1784/3650] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:21 2022] DELETE /compute/v2.1/servers/35784dd5-92bd-4601-a897-20bc4969a1f7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:21.986966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-271289687", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2d5eca5e-b457-4c36-8b4b-a1a450e04c3e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:22.042240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-89935c12-755f-4846-8d8f-b0f026afebea req-fd7c1b59-1690-4e90-8923-f8fcd879bb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed342e0-10ca-4835-ad0d-cf55a6aabc75", "name": "network-vif-deleted", "tag": "89a1b42b-d5fd-47e5-a706-9448ba078c8e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:22.044162 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:22.044162 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:22.073193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-89935c12-755f-4846-8d8f-b0f026afebea req-fd7c1b59-1690-4e90-8923-f8fcd879bb3c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.074151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-89935c12-755f-4846-8d8f-b0f026afebea req-fd7c1b59-1690-4e90-8923-f8fcd879bb3c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.099710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] validate_networks() for [('2d5eca5e-b457-4c36-8b4b-a1a450e04c3e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:22.111350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-89935c12-755f-4846-8d8f-b0f026afebea req-fd7c1b59-1690-4e90-8923-f8fcd879bb3c service nova] Creating event network-vif-deleted:89a1b42b-d5fd-47e5-a706-9448ba078c8e for instance aed342e0-10ca-4835-ad0d-cf55a6aabc75 on nch1-master-1 Feb 12 21:16:22.123030 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-89935c12-755f-4846-8d8f-b0f026afebea req-fd7c1b59-1690-4e90-8923-f8fcd879bb3c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085436 Feb 12 21:16:22.127163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1785/3651] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:22.145034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:22.146011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:22.158947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.159508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.161007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.161537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.413890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:22.423936 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4683197b-f1b8-4d22-af06-32a8a95162d1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.284488 Feb 12 21:16:22.425467 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1786/3652] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:22 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:22.490176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:22.491116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] [instance: aed342e0-10ca-4835-ad0d-cf55a6aabc75] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:22.498164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.498730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.499602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.500099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.515838 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] HTTP exception thrown: Instance aed342e0-10ca-4835-ad0d-cf55a6aabc75 could not be found. Feb 12 21:16:22.516572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Returning 404 to user: Instance aed342e0-10ca-4835-ad0d-cf55a6aabc75 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:22.517755 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7dabff58-744d-42bf-be69-bf90e4f3c838 tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75" status: 404 len: 111 microversion: 2.1 time: 0.031437 Feb 12 21:16:22.521658 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1787/3653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:22 2022] GET /compute/v2.1/servers/aed342e0-10ca-4835-ad0d-cf55a6aabc75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:22.527828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b968d2d-800b-4fc1-acdc-feb0b6bf14dc tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] Calling method '.version_select at 0x7fa8fd6da700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:22.641299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:22.641899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:22.642230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:22.642647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:22.643078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:22.655050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.655529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.656383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:22.656813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:22.672336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b968d2d-800b-4fc1-acdc-feb0b6bf14dc tempest-ServersTestFqdnHostnames-359026930 tempest-ServersTestFqdnHostnames-359026930-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475145375" status: 202 len: 0 microversion: 2.1 time: 0.149167 Feb 12 21:16:22.672925 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1788/3654] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475145375 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:16:22.674574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Getting quotas for project 34fc2aeace2346329e2035646bdd4a65. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:22.680983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Getting quotas for user 7ec5b1c037d942efb8b2d455f7b6a760 and project 34fc2aeace2346329e2035646bdd4a65. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:22.698080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Going to run 2 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:22.700782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:22.843946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=a86bfb3b-f693-42f1-b99a-e4ff52df8415,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:23.031210 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-639167ac-fa79-41f1-aa91-4073427d7a08 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.056459 Feb 12 21:16:23.033024 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1867/3655] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Feb 12 21:16:23.042836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:23.047687 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:23.047687 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:23.049835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:23.050819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Searching by: {'deleted': False, 'project_id': '34fc2aeace2346329e2035646bdd4a65'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:16:23.078351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:23.079069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:23.085294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:23.086054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:23.122144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:16:23.167844 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d616e0d-6e3b-4736-9205-2c4fd8eb513a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.131261 Feb 12 21:16:23.168597 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1789/3656] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:16:23 2022] GET /compute/v2.1/servers => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:23.182175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-97fef821-198d-485d-a6b7-ce0b74806488 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:23.184288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-97fef821-198d-485d-a6b7-ce0b74806488 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:23.303554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-97fef821-198d-485d-a6b7-ce0b74806488 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:23.312542 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-97fef821-198d-485d-a6b7-ce0b74806488 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1217 microversion: 2.1 time: 0.137135 Feb 12 21:16:23.325280 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1868/3657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:23 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:23.445340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:23.454236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:23.482274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:23.484878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:23.488278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:23.490069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:23.671785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4246d4c6-837a-4c4e-b88e-df43c0271e05 req-dde5b377-0519-4470-8467-2a3d94948da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc9519e0-9ff9-49f2-898e-a7cea01ca2c1", "name": "network-vif-plugged", "status": "completed", "tag": "70b3cdf4-7ef0-4187-8da4-b1a3092c5dbb"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:23.675981 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:23.675981 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:23.694314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4246d4c6-837a-4c4e-b88e-df43c0271e05 req-dde5b377-0519-4470-8467-2a3d94948da5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:23.695672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4246d4c6-837a-4c4e-b88e-df43c0271e05 req-dde5b377-0519-4470-8467-2a3d94948da5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:23.714075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4246d4c6-837a-4c4e-b88e-df43c0271e05 req-dde5b377-0519-4470-8467-2a3d94948da5 service nova] Creating event network-vif-plugged:70b3cdf4-7ef0-4187-8da4-b1a3092c5dbb for instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 on nch1-master-1 Feb 12 21:16:23.722906 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4246d4c6-837a-4c4e-b88e-df43c0271e05 req-dde5b377-0519-4470-8467-2a3d94948da5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058175 Feb 12 21:16:23.724453 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1869/3658] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:24.294163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3ba7b701-0da0-4255-8b9f-302169e244cb req-d8336772-b473-41c1-b0b2-824580ed1f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7801aa5-334a-47b7-b62f-943a2af82d82", "name": "network-vif-deleted", "tag": "3f6aa7d2-ec41-4bb7-b704-52672f8b4073"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:24.301567 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:24.301567 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:24.313091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3ba7b701-0da0-4255-8b9f-302169e244cb req-d8336772-b473-41c1-b0b2-824580ed1f9f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:24.313746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3ba7b701-0da0-4255-8b9f-302169e244cb req-d8336772-b473-41c1-b0b2-824580ed1f9f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:24.333655 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3ba7b701-0da0-4255-8b9f-302169e244cb req-d8336772-b473-41c1-b0b2-824580ed1f9f service nova] Creating event network-vif-deleted:3f6aa7d2-ec41-4bb7-b704-52672f8b4073 for instance a7801aa5-334a-47b7-b62f-943a2af82d82 on nch1-master-1 Feb 12 21:16:24.341346 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3ba7b701-0da0-4255-8b9f-302169e244cb req-d8336772-b473-41c1-b0b2-824580ed1f9f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054409 Feb 12 21:16:24.342705 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1870/3659] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:24.369118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c80abcfa-472b-4f2b-aabf-4aa261565b4a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:24.370864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c80abcfa-472b-4f2b-aabf-4aa261565b4a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:24.375205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:24.384667 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ed51922-287c-44e3-8eea-532f90dafacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.945748 Feb 12 21:16:24.387119 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1790/3660] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:23 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:24.522709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c80abcfa-472b-4f2b-aabf-4aa261565b4a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:24.533500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c80abcfa-472b-4f2b-aabf-4aa261565b4a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1217 microversion: 2.1 time: 0.188481 Feb 12 21:16:24.539915 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1871/3661] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:24 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:25.410637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:25.412855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:25.426439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:25.428593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:25.442277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:25.442277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:25.559290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:25.560906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:25.576425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:25.577303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:25.579467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:25.580653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:25.701427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:25.717944 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5977428-21b6-47d7-99c7-9470d788ed0e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1314 microversion: 2.1 time: 0.311149 Feb 12 21:16:25.729826 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1791/3662] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:25 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:25.778862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:25.786593 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe4d3c94-031a-48bc-a262-c0d689a2468e tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1221 microversion: 2.1 time: 0.233152 Feb 12 21:16:25.787309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1872/3663] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:25 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1221 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:26.362797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d246e909-d253-40e7-b8d1-95651f916bb8 req-d87149e0-2e0d-4e11-a00d-2911566e7af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35784dd5-92bd-4601-a897-20bc4969a1f7", "name": "network-vif-deleted", "tag": "19908ba6-438c-472f-ad24-2011ccd47a3c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:26.364968 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:26.364968 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:26.380025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d246e909-d253-40e7-b8d1-95651f916bb8 req-d87149e0-2e0d-4e11-a00d-2911566e7af0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:26.380935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d246e909-d253-40e7-b8d1-95651f916bb8 req-d87149e0-2e0d-4e11-a00d-2911566e7af0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:26.406799 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d246e909-d253-40e7-b8d1-95651f916bb8 req-d87149e0-2e0d-4e11-a00d-2911566e7af0 service nova] Creating event network-vif-deleted:19908ba6-438c-472f-ad24-2011ccd47a3c for instance 35784dd5-92bd-4601-a897-20bc4969a1f7 on nch2-master-1 Feb 12 21:16:26.417566 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d246e909-d253-40e7-b8d1-95651f916bb8 req-d87149e0-2e0d-4e11-a00d-2911566e7af0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058681 Feb 12 21:16:26.419265 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1792/3664] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:26.737185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:26.739112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:26.777298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:26.777298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:26.778102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:26.784034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:26.804378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:26.805248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:26.819241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:26.820042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:26.822282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:26.822933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:27.038785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:27.097804 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-765b6dc8-3c42-43d3-ba37-e081982623fb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1277 microversion: 2.1 time: 0.295779 Feb 12 21:16:27.103149 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1793/3665] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:26 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:27.394421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:27.403513 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3ef6af6-3ca1-4056-ad5c-bfe726013af6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1501 microversion: 2.1 time: 0.670253 Feb 12 21:16:27.410126 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1873/3666] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:26 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1501 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:27.427770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:27.429088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:27.439351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:27.442817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:27.443909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:27.445965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:27.717613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc99fe54-3439-4b6e-a417-652cbb3292b9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1/action" status: 202 len: 0 microversion: 2.1 time: 0.294122 Feb 12 21:16:27.722717 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1794/3667] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:16:27 2022] POST /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:16:27.733450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:27.734177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:27.746196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:27.751066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:27.754769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:27.755372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:28.119153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:28.119851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:28.126545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:28.133166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:28.135162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:28.137457 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-48273203-5bc5-44ae-94a8-132e6f63f3c1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1506 microversion: 2.1 time: 0.413309 Feb 12 21:16:28.137673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:28.146858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1874/3668] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:27 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:28.147452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:28.226052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:28.244116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d660b64-ea56-4265-a81a-2758232574c6 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1275 microversion: 2.1 time: 0.129307 Feb 12 21:16:28.247086 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1795/3669] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:28 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:28.303376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:28.304091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:28.312663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:28.313384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:28.314409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:28.315046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:28.347788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:28.777532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2bf391c-d94a-4419-bfd9-19ff1ff1708e tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 204 len: 0 microversion: 2.1 time: 0.476886 Feb 12 21:16:28.778447 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1875/3670] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:28 2022] DELETE /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:28.786659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:28.787281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:28.801662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:28.802228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:28.804174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:28.805026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:29.157979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:29.158990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:29.173669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:29.174399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:29.175479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:29.177669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:29.591223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:29.604533 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b01d1f6a-e6ac-4a91-b5d0-670b312b87e3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1486 microversion: 2.1 time: 0.450897 Feb 12 21:16:29.615869 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1876/3671] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:29 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1486 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:29.624520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:29.624917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:29.648771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:29.650076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:29.652705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:29.653165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:30.042829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:30.050974 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-923dc6af-c823-476f-8fd9-b89f33d9d92a tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.443427 Feb 12 21:16:30.072141 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1877/3672] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:29 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:30.077131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:30.077663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:30.099079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:30.099537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:30.100357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:30.101461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:30.148442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:30.522366 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-42596bd1-20d3-4d42-832e-4556ff7a375c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 204 len: 0 microversion: 2.1 time: 0.448661 Feb 12 21:16:30.527935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:30.529109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1878/3673] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:30 2022] DELETE /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:30.535080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:30.537134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:30.557668 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77cb9224-9957-42dd-877d-94db4b2b1674 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1515 microversion: 2.1 time: 1.773215 Feb 12 21:16:30.570279 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1796/3674] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:28 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1515 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:30.589327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:30.590414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:30.591407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:30.592011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:31.069780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:31.069780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:31.082310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:31.084309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:31.086500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:31.097006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:31.272403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:31.283873 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d813de3f-393e-4f3d-bbd3-872c80ba4df3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1492 microversion: 2.1 time: 0.752986 Feb 12 21:16:31.285237 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1879/3675] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:30 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1492 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:31.577307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:31.577974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:31.591209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:31.591744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:31.594104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:31.594602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:31.732876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:31.741397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d657cda9-bc6c-49fa-a6f9-8f1cf522c94f tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1473 microversion: 2.1 time: 0.169619 Feb 12 21:16:31.763087 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1880/3676] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:31 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:31.868928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bb4018fa-2adf-4af2-bb1f-d46f38513400 req-fbe797e6-4128-40d5-9d8e-37b010ecabce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca29232-9b41-4183-b84b-ce26da0aea7b", "name": "network-vif-deleted", "tag": "535bef55-124d-44f2-9478-80c0a813b588"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:31.874783 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:31.874783 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:31.885158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bb4018fa-2adf-4af2-bb1f-d46f38513400 req-fbe797e6-4128-40d5-9d8e-37b010ecabce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:31.885916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bb4018fa-2adf-4af2-bb1f-d46f38513400 req-fbe797e6-4128-40d5-9d8e-37b010ecabce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:31.898901 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bb4018fa-2adf-4af2-bb1f-d46f38513400 req-fbe797e6-4128-40d5-9d8e-37b010ecabce service nova] Creating event network-vif-deleted:535bef55-124d-44f2-9478-80c0a813b588 for instance 8ca29232-9b41-4183-b84b-ce26da0aea7b on nch1-master-1 Feb 12 21:16:31.907583 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bb4018fa-2adf-4af2-bb1f-d46f38513400 req-fbe797e6-4128-40d5-9d8e-37b010ecabce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043990 Feb 12 21:16:31.907583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1881/3677] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:32.049744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:32.060354 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-191153ab-a261-452e-9b7d-c6b9e9476919 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.995871 Feb 12 21:16:32.072430 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1797/3678] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:31 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:32.302579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:32.303359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:32.313411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:32.317972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:32.322029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:32.322763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:32.573263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b3414b79-2ad8-4c34-b599-60cc8c68d845 req-a2d60c8c-bc0f-44c2-880f-99b266865ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86bfb3b-f693-42f1-b99a-e4ff52df8415", "tag": "93f02fa8-36e2-4b7b-ac34-b8fe172d03ba"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:32.575548 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:32.575548 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:32.606564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b3414b79-2ad8-4c34-b599-60cc8c68d845 req-a2d60c8c-bc0f-44c2-880f-99b266865ea1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:32.610372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b3414b79-2ad8-4c34-b599-60cc8c68d845 req-a2d60c8c-bc0f-44c2-880f-99b266865ea1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:32.625068 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b3414b79-2ad8-4c34-b599-60cc8c68d845 req-a2d60c8c-bc0f-44c2-880f-99b266865ea1 service nova] Creating event network-changed:93f02fa8-36e2-4b7b-ac34-b8fe172d03ba for instance a86bfb3b-f693-42f1-b99a-e4ff52df8415 on nch2-master-1 Feb 12 21:16:32.636368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b3414b79-2ad8-4c34-b599-60cc8c68d845 req-a2d60c8c-bc0f-44c2-880f-99b266865ea1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066377 Feb 12 21:16:32.639085 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1798/3679] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:32.737569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:32.762196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:32.764714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:32.772671 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c248c9d1-6679-4e29-a740-1744d823f04d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1492 microversion: 2.1 time: 0.472829 Feb 12 21:16:32.777195 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1882/3680] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:32 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1492 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:32.783430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:32.786633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:32.786633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:32.786633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:32.906194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:32.906683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:32.907081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lazy-loading 'fault' on Instance uuid 8ca29232-9b41-4183-b84b-ce26da0aea7b {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:33.083615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daa98fa6e3104489af8bd77f8217a07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3339620b21d4394a171733276444b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:33.087521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:33.088837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:33.095061 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88309507-fa65-47e2-8a74-6453afd18390 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 200 len: 1308 microversion: 2.1 time: 0.339089 Feb 12 21:16:33.096838 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1799/3681] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:32 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:33.100489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:33.100953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:33.108673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:33.108673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:33.585553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:33.595452 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d4ddfcfe-efe4-4a7e-8783-a90704929b47 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.512961 Feb 12 21:16:33.597475 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1883/3682] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:33 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:33.792369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:33.793001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:33.804138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:33.804615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:33.811630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:33.812267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:33.860039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:33.860863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:33.861545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lazy-loading 'fault' on Instance uuid fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:33.926873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f912cdc0-3af1-4e2c-a71d-95c78e8ec969 req-d2a84542-3b98-4f61-9d02-deb280ce0a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc9519e0-9ff9-49f2-898e-a7cea01ca2c1", "name": "network-vif-deleted", "tag": "70b3cdf4-7ef0-4187-8da4-b1a3092c5dbb"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:33.928405 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:33.928405 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:33.936365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f912cdc0-3af1-4e2c-a71d-95c78e8ec969 req-d2a84542-3b98-4f61-9d02-deb280ce0a8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:33.936815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f912cdc0-3af1-4e2c-a71d-95c78e8ec969 req-d2a84542-3b98-4f61-9d02-deb280ce0a8b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:33.948224 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f912cdc0-3af1-4e2c-a71d-95c78e8ec969 req-d2a84542-3b98-4f61-9d02-deb280ce0a8b service nova] Creating event network-vif-deleted:70b3cdf4-7ef0-4187-8da4-b1a3092c5dbb for instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 on nch1-master-1 Feb 12 21:16:33.953160 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f912cdc0-3af1-4e2c-a71d-95c78e8ec969 req-d2a84542-3b98-4f61-9d02-deb280ce0a8b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029868 Feb 12 21:16:33.957255 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1884/3683] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:33.975839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:33.986673 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9f9fab9c-9e8a-4f6b-8280-adfaa3b81de8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 200 len: 1304 microversion: 2.1 time: 0.197237 Feb 12 21:16:33.987629 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1800/3684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:33 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:34.117243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:34.120113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] [instance: 8ca29232-9b41-4183-b84b-ce26da0aea7b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:34.125534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:34.126274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:34.127310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:34.128584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:34.153918 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] HTTP exception thrown: Instance 8ca29232-9b41-4183-b84b-ce26da0aea7b could not be found. Feb 12 21:16:34.154870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] Returning 404 to user: Instance 8ca29232-9b41-4183-b84b-ce26da0aea7b could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:34.155975 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56df548c-f182-4d6b-8af1-6fd30837cdf0 tempest-AttachVolumeNegativeTest-377263399 tempest-AttachVolumeNegativeTest-377263399-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b" status: 404 len: 111 microversion: 2.1 time: 0.043756 Feb 12 21:16:34.157183 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1885/3685] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:34 2022] GET /compute/v2.1/servers/8ca29232-9b41-4183-b84b-ce26da0aea7b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:16:34.615548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:34.616790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:34.629345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:34.630447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:34.632360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:34.634357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:34.987820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0e56aa9a-2eb6-463c-b4e5-9583b2e7edc7 req-de48a4d3-a58d-4ee1-bd1d-385a3ae0bc75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c17a1dbb-861a-43c9-b417-0cd379869e0c", "tag": "2b497b99-f059-46d5-86fa-8f5cb6613ed5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:34.991860 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:34.991860 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:35.003760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0e56aa9a-2eb6-463c-b4e5-9583b2e7edc7 req-de48a4d3-a58d-4ee1-bd1d-385a3ae0bc75 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:35.004692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0e56aa9a-2eb6-463c-b4e5-9583b2e7edc7 req-de48a4d3-a58d-4ee1-bd1d-385a3ae0bc75 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:35.027592 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0e56aa9a-2eb6-463c-b4e5-9583b2e7edc7 req-de48a4d3-a58d-4ee1-bd1d-385a3ae0bc75 service nova] Creating event network-changed:2b497b99-f059-46d5-86fa-8f5cb6613ed5 for instance c17a1dbb-861a-43c9-b417-0cd379869e0c on nch2-master-1 Feb 12 21:16:35.038153 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0e56aa9a-2eb6-463c-b4e5-9583b2e7edc7 req-de48a4d3-a58d-4ee1-bd1d-385a3ae0bc75 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055297 Feb 12 21:16:35.039246 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1886/3686] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:35.045470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:35.046830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:35.056799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:35.056799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:35.056799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:35.056799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:35.072952 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 could not be found. Feb 12 21:16:35.073688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:35.075164 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf1e962d-4b6f-458d-b69f-838dfad1bf13 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 404 len: 111 microversion: 2.1 time: 0.033635 Feb 12 21:16:35.076329 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1887/3687] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:35 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:35.256291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:35.275322 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-42e9bdb0-1a37-4f72-b3a0-1987803d9071 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.664605 Feb 12 21:16:35.277136 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1801/3688] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:34 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:35.336067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1557258091", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:35.434326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:36.297338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:36.297338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:36.303351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:36.303812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:36.304622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:36.305066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:36.654235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:36.654787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:36.655364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:36.655874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:36.656521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:36.666513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:36.666965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:36.667773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:36.668601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:36.693762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:36.699953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:36.715547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:36.718223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:36.864898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df33d7cb-4a62-4c60-ae7d-5fc79a62fddd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532832 Feb 12 21:16:36.870550 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1888/3689] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:16:36.875565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d18b844-62ea-4daf-bdc6-4122678fc645 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:36.876370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d18b844-62ea-4daf-bdc6-4122678fc645 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:36.984487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:36.998877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa227190-bc58-4ee9-b6c0-d86fb1e90d01 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.703079 Feb 12 21:16:37.004648 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1802/3690] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:36 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:37.018329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d18b844-62ea-4daf-bdc6-4122678fc645 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:37.029852 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d18b844-62ea-4daf-bdc6-4122678fc645 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1215 microversion: 2.1 time: 0.156937 Feb 12 21:16:37.030663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1889/3691] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:36 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:38.021773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:38.023171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:38.039234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:38.041010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:38.048240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:38.050585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:38.056995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:38.057834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:38.066586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:38.068622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:38.070640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:38.073493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:38.241445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:38.258094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ae30496-d112-4329-b80c-b478963c56f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1219 microversion: 2.1 time: 0.212451 Feb 12 21:16:38.262049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1890/3692] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:38 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1219 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:38.456886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:38.468595 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e9042b9-4399-4af6-85d2-91341a9b6101 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.451324 Feb 12 21:16:38.475887 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1803/3693] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:38 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:39.277581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:39.278918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:39.304166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:39.304624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:39.305984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:39.306419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:39.495662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:39.496283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:39.507826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:39.508280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:39.509349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:39.509822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:39.531715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:39.540673 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7126f5bc-366b-46ea-9b4d-1b916ac00966 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1267 microversion: 2.1 time: 0.268397 Feb 12 21:16:39.545220 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1891/3694] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:39 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:40.551085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:40.557746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:40.560699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:40.567160 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0bdd011b-eb5e-40b9-889f-a6b02b24d5b1 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 1.077455 Feb 12 21:16:40.578435 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1804/3695] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:39 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:40.583560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:40.584237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:40.585243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:40.585852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:40.693702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:40.721629 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dd0170ff-eb16-43e3-9721-7816e74f6062 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1273 microversion: 2.1 time: 0.167558 Feb 12 21:16:40.722719 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1892/3696] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:40 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:41.595271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:41.595872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:41.597971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2145454788", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:41.615872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:41.616328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:41.617144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:41.617616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:41.671327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] validate_networks() for [('79e30242-36dd-47be-b9fc-d5fa9a5cbbe7', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:42.748871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:42.757038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa8b3abe-5480-4265-9295-c6056739deec tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 1.165405 Feb 12 21:16:42.759472 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1893/3697] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:41 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:42.764698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:42.765472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:42.771733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:42.772198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:42.773253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:42.773998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:43.391665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:43.404837 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2515e3e-5919-40f4-8bab-cd7cfba2a2e7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1315 microversion: 2.1 time: 0.642079 Feb 12 21:16:43.407903 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1894/3698] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:42 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:43.431055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e1dcbc8b-fada-4f7a-84ac-3fc385b6b952 req-d3dcf0a7-bab6-46fd-9e91-af2565c098e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86bfb3b-f693-42f1-b99a-e4ff52df8415", "name": "network-vif-plugged", "status": "completed", "tag": "93f02fa8-36e2-4b7b-ac34-b8fe172d03ba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:43.434366 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:43.434366 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:43.464827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e1dcbc8b-fada-4f7a-84ac-3fc385b6b952 req-d3dcf0a7-bab6-46fd-9e91-af2565c098e1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:43.466986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e1dcbc8b-fada-4f7a-84ac-3fc385b6b952 req-d3dcf0a7-bab6-46fd-9e91-af2565c098e1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:43.473854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:43.473854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:43.473854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:43.473854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:43.473854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:43.519899 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e1dcbc8b-fada-4f7a-84ac-3fc385b6b952 req-d3dcf0a7-bab6-46fd-9e91-af2565c098e1 service nova] Creating event network-vif-plugged:93f02fa8-36e2-4b7b-ac34-b8fe172d03ba for instance a86bfb3b-f693-42f1-b99a-e4ff52df8415 on nch2-master-1 Feb 12 21:16:43.528636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:43.529086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:43.532976 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e1dcbc8b-fada-4f7a-84ac-3fc385b6b952 req-d3dcf0a7-bab6-46fd-9e91-af2565c098e1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112332 Feb 12 21:16:43.533864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1895/3699] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:43.542882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:43.542882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:43.637687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Getting quotas for project 036d2491a97d486eb196e0cdafa05500. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:43.655153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Getting quotas for user 29b2541501314a6991b5b4e81289c117 and project 036d2491a97d486eb196e0cdafa05500. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:43.703619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:43.708750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:43.780263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:43.782206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:43.807953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:43.808435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:43.809256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:43.809725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:43.903815 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf093fc7-5523-4e7e-a099-71fa519f3d9a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.905157 Feb 12 21:16:43.906599 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1805/3700] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:16:43.924078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4a13e7ff-ab23-49ba-881f-f79f76be4a45 req-dbcff834-a1f7-4ccd-94bf-f64fbb01cbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43260354-ea4d-4384-9956-3ded0eb6b91c", "tag": "2cf67411-9b4d-404c-9292-87f1a03fd2b1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:43.927445 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:43.927445 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:43.949052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4a13e7ff-ab23-49ba-881f-f79f76be4a45 req-dbcff834-a1f7-4ccd-94bf-f64fbb01cbd2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:43.949744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4a13e7ff-ab23-49ba-881f-f79f76be4a45 req-dbcff834-a1f7-4ccd-94bf-f64fbb01cbd2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:44.014668 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4a13e7ff-ab23-49ba-881f-f79f76be4a45 req-dbcff834-a1f7-4ccd-94bf-f64fbb01cbd2 service nova] Creating event network-changed:2cf67411-9b4d-404c-9292-87f1a03fd2b1 for instance 43260354-ea4d-4384-9956-3ded0eb6b91c on nch1-master-1 Feb 12 21:16:44.026788 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4a13e7ff-ab23-49ba-881f-f79f76be4a45 req-dbcff834-a1f7-4ccd-94bf-f64fbb01cbd2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118320 Feb 12 21:16:44.028799 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1806/3701] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:44.042422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a86a6c18-f2cf-4e36-9ab6-fd1ed1cfed6e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:44.045371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a86a6c18-f2cf-4e36-9ab6-fd1ed1cfed6e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:44.330284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a86a6c18-f2cf-4e36-9ab6-fd1ed1cfed6e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:44.338690 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a86a6c18-f2cf-4e36-9ab6-fd1ed1cfed6e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1214 microversion: 2.1 time: 0.306958 Feb 12 21:16:44.347189 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1807/3702] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:44 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:44.423912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:44.429255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:44.434593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:44.435044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:44.437036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:44.437509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:44.451755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:44.462529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-385f09f4-5bb5-4124-bea5-ede77464d5ea tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.689046 Feb 12 21:16:44.465230 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1896/3703] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:43 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:45.371750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c13a31f9-f376-4a94-bde7-e4d7ed6abc07 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:45.372863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c13a31f9-f376-4a94-bde7-e4d7ed6abc07 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:45.470624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c13a31f9-f376-4a94-bde7-e4d7ed6abc07 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:45.479391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c13a31f9-f376-4a94-bde7-e4d7ed6abc07 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1214 microversion: 2.1 time: 0.111977 Feb 12 21:16:45.484694 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1897/3704] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:45 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:45.487148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:45.487769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:45.498025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:45.498486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:45.499301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:45.499725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:45.536460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:45.552615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40937530-c77e-4b8b-9cc0-b309cddd958a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1315 microversion: 2.1 time: 1.125353 Feb 12 21:16:45.559479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1808/3705] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:44 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:45.810284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-731743e4-b077-4a36-b455-65231fcda6c6 req-b65ca2c2-55b5-4801-805a-4d2a4b745512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17a1dbb-861a-43c9-b417-0cd379869e0c", "name": "network-vif-plugged", "status": "completed", "tag": "2b497b99-f059-46d5-86fa-8f5cb6613ed5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:45.812765 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:45.812765 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:45.830216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-731743e4-b077-4a36-b455-65231fcda6c6 req-b65ca2c2-55b5-4801-805a-4d2a4b745512 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:45.830939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-731743e4-b077-4a36-b455-65231fcda6c6 req-b65ca2c2-55b5-4801-805a-4d2a4b745512 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:45.857615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-731743e4-b077-4a36-b455-65231fcda6c6 req-b65ca2c2-55b5-4801-805a-4d2a4b745512 service nova] Creating event network-vif-plugged:2b497b99-f059-46d5-86fa-8f5cb6613ed5 for instance c17a1dbb-861a-43c9-b417-0cd379869e0c on nch2-master-1 Feb 12 21:16:45.865151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-731743e4-b077-4a36-b455-65231fcda6c6 req-b65ca2c2-55b5-4801-805a-4d2a4b745512 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060708 Feb 12 21:16:45.865972 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1809/3706] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:45.944337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:45.955568 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e9077d2b-2033-4434-a81c-763e86afce1c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.470032 Feb 12 21:16:45.967972 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1898/3707] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:45 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:46.496459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:46.497203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:46.510068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:46.510529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:46.511340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:46.511773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:46.579456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:46.580853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:46.603435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:46.604283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:46.605487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:46.606085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:46.660688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:46.670982 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8fef5175-9037-49df-a386-d900d029e49f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1266 microversion: 2.1 time: 0.178410 Feb 12 21:16:46.672324 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1810/3708] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:46 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:46.974946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:46.975623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:46.986738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:46.995883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:46.999370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:47.001873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:47.418911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:47.434645 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5d9f0fe6-2d52-49a7-ba19-dc45a207a707 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1317 microversion: 2.1 time: 0.463260 Feb 12 21:16:47.436270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1811/3709] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:46 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:47.693555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:47.694347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:47.694772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:47.709980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:47.712383 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d00aded-ad2d-4529-bdf9-43804e2379ce tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1315 microversion: 2.1 time: 1.137491 Feb 12 21:16:47.712383 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1899/3710] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:46 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:47.714869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:47.717174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:47.718402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:47.847070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:47.858598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8796a2d7-0634-4ecf-a0ec-7b983cf92b1f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1272 microversion: 2.1 time: 0.170325 Feb 12 21:16:47.859383 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1812/3711] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:47 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:48.452270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:48.452888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:48.460913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:48.462319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:48.463324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:48.463923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:48.729107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:48.730690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:48.744166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:48.744984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:48.747036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:48.752384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:49.119412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:49.131063 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b242c313-f380-4166-bacb-19ffd6ac2561 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1315 microversion: 2.1 time: 0.406157 Feb 12 21:16:49.132894 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1813/3712] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:48 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:49.146541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:49.148708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:49.165939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:49.166394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:49.167205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:49.167637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:49.298890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:49.311898 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-28fab894-d713-4dde-bfaf-6ecab13c2e02 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 200 len: 1506 microversion: 2.1 time: 0.863257 Feb 12 21:16:49.312501 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1900/3713] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:48 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 1506 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:49.331546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:49.332180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:49.334637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:49.347694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6017b573-3365-46e9-b690-f818097a9471 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1272 microversion: 2.1 time: 0.212320 Feb 12 21:16:49.349733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:49.350404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:49.352445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:49.354533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:49.363001 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1814/3714] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:49 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:49.927892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:49.941917 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25e3efbf-700e-483e-83c7-fc89bc7e3fe2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415" status: 200 len: 1505 microversion: 2.1 time: 0.616661 Feb 12 21:16:49.944108 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1901/3715] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:49 2022] GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415 => generated 1505 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:49.961895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:49.962504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:49.971942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:49.972400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:49.973214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:49.973699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.006545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:50.151878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:50.153133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:50.163111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:50.163739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.165285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:50.165960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.385194 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54e89e2e-2c4c-4320-bd51-eae6e3834d6c tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415" status: 204 len: 0 microversion: 2.1 time: 0.427285 Feb 12 21:16:50.387785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1815/3716] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:49 2022] DELETE /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:50.395297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:50.396282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:50.409900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:50.410775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.411135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:50.411575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.634623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:50.643809 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f31a7104-3ce4-4a6e-88e4-0c775b409aa0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1314 microversion: 2.1 time: 0.256563 Feb 12 21:16:50.644978 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1816/3717] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:50 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:50.660871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:50.661698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:50.669309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:50.670316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.671333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:50.671969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:50.717586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:16:50.790331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:50.816167 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d9c9a38a-65f5-4913-93f1-0d5722f0bd8d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1315 microversion: 2.1 time: 0.670018 Feb 12 21:16:50.828275 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1902/3718] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:50 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:50.992029 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55ef5dc7-b6a7-41c9-b758-2ab19c94ffc2 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 204 len: 0 microversion: 2.1 time: 0.334285 Feb 12 21:16:50.993538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1817/3719] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:16:50 2022] DELETE /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:16:51.004220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:51.005101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:51.026614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:51.027081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:51.028323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:51.028840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:51.465761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:51.474385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e633cb3-9793-4e7d-a036-d9fb031b419b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415" status: 200 len: 1511 microversion: 2.1 time: 0.475889 Feb 12 21:16:51.478408 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1903/3720] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:50 2022] GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415 => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:51.673958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:51.675634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:51.703751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:51.704462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:51.706523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:51.707828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:51.845447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:51.847645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:51.867290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:51.868684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:51.872033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:51.878005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:52.160378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:52.168325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-144175cb-0f22-4307-b1b9-2aee991ffbf8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1314 microversion: 2.1 time: 0.509294 Feb 12 21:16:52.171162 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1818/3721] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:51 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:52.184605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-583d05e1-8c2d-4005-9f86-a013f4bbf82b req-3d921c59-8993-4510-881b-113c1075ff06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43260354-ea4d-4384-9956-3ded0eb6b91c", "name": "network-vif-plugged", "status": "completed", "tag": "2cf67411-9b4d-404c-9292-87f1a03fd2b1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:52.186617 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:52.186617 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:52.200780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-583d05e1-8c2d-4005-9f86-a013f4bbf82b req-3d921c59-8993-4510-881b-113c1075ff06 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:52.206298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-583d05e1-8c2d-4005-9f86-a013f4bbf82b req-3d921c59-8993-4510-881b-113c1075ff06 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:52.229521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-583d05e1-8c2d-4005-9f86-a013f4bbf82b req-3d921c59-8993-4510-881b-113c1075ff06 service nova] Creating event network-vif-plugged:2cf67411-9b4d-404c-9292-87f1a03fd2b1 for instance 43260354-ea4d-4384-9956-3ded0eb6b91c on nch1-master-1 Feb 12 21:16:52.246797 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-583d05e1-8c2d-4005-9f86-a013f4bbf82b req-3d921c59-8993-4510-881b-113c1075ff06 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073357 Feb 12 21:16:52.251485 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1819/3722] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:52.498014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:52.498736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:52.511397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:52.511856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:52.513011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:52.513484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:52.665254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:52.673088 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5148681-2dcf-4e43-ab98-2b1837ccd8eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1315 microversion: 2.1 time: 0.834164 Feb 12 21:16:52.676466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1904/3723] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:51 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:52.698837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-446376eb-23cc-48c8-bf49-97cf2ed43b24 req-f3204281-0146-43ae-8ead-4f3883ea9bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714a1949-e3c7-4d02-9972-0d3aa74311af", "tag": "05bf65a0-d7cd-46e3-8256-7885b95b7048"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:52.700346 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:52.700346 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:52.713820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-446376eb-23cc-48c8-bf49-97cf2ed43b24 req-f3204281-0146-43ae-8ead-4f3883ea9bb7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:52.716149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-446376eb-23cc-48c8-bf49-97cf2ed43b24 req-f3204281-0146-43ae-8ead-4f3883ea9bb7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:52.731335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-446376eb-23cc-48c8-bf49-97cf2ed43b24 req-f3204281-0146-43ae-8ead-4f3883ea9bb7 service nova] Creating event network-changed:05bf65a0-d7cd-46e3-8256-7885b95b7048 for instance 714a1949-e3c7-4d02-9972-0d3aa74311af on nch1-master-1 Feb 12 21:16:52.747439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-446376eb-23cc-48c8-bf49-97cf2ed43b24 req-f3204281-0146-43ae-8ead-4f3883ea9bb7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052731 Feb 12 21:16:52.749700 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1905/3724] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:52.998360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:53.016762 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5be52005-d710-44a0-8703-526d2bd6ed00 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415" status: 200 len: 1511 microversion: 2.1 time: 0.522619 Feb 12 21:16:53.017920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1820/3725] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:52 2022] GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415 => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:53.194839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:53.198279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:53.216173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:53.217861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:53.222297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:53.224630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:53.651342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ab28ef9-634d-4b7b-ac54-e9e6d26f2690 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Action: 'create', calling method: .version_select at 0x7fa8fdf1a790>, body: {"keypair": {"name": "tempest-keypair-614800946"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:53.692885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9ab28ef9-634d-4b7b-ac54-e9e6d26f2690 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:53.708430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9ab28ef9-634d-4b7b-ac54-e9e6d26f2690 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for user 4b20374617ab42cda524d241b44b43d2 and project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:53.979794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9ab28ef9-634d-4b7b-ac54-e9e6d26f2690 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:53.991009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9ab28ef9-634d-4b7b-ac54-e9e6d26f2690 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for user 4b20374617ab42cda524d241b44b43d2 and project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:54.034595 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ab28ef9-634d-4b7b-ac54-e9e6d26f2690 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.977152 Feb 12 21:16:54.035726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1906/3726] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:16:53 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:54.048687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9e78b9bf-4384-49d0-b8bb-6efdccf8f74f req-e6d52857-b394-464e-9b0f-26b5cb707802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86bfb3b-f693-42f1-b99a-e4ff52df8415", "name": "network-vif-deleted", "tag": "93f02fa8-36e2-4b7b-ac34-b8fe172d03ba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:54.051457 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:54.051457 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:54.073933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9e78b9bf-4384-49d0-b8bb-6efdccf8f74f req-e6d52857-b394-464e-9b0f-26b5cb707802 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.074857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9e78b9bf-4384-49d0-b8bb-6efdccf8f74f req-e6d52857-b394-464e-9b0f-26b5cb707802 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.107025 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9e78b9bf-4384-49d0-b8bb-6efdccf8f74f req-e6d52857-b394-464e-9b0f-26b5cb707802 service nova] Creating event network-vif-deleted:93f02fa8-36e2-4b7b-ac34-b8fe172d03ba for instance a86bfb3b-f693-42f1-b99a-e4ff52df8415 on nch2-master-1 Feb 12 21:16:54.114766 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9e78b9bf-4384-49d0-b8bb-6efdccf8f74f req-e6d52857-b394-464e-9b0f-26b5cb707802 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077663 Feb 12 21:16:54.115578 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1907/3727] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:54.135081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:54.136119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:54.145047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.145763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.146784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.148166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.275975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:54.290419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d1f5531-40b2-4039-93cc-0b787a5fab64 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1314 microversion: 2.1 time: 1.106532 Feb 12 21:16:54.291954 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1821/3728] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:53 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1314 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:54.307933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:54.309025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:54.318092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.318835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.320826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.321540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.374190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.374971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.376108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lazy-loading 'fault' on Instance uuid a86bfb3b-f693-42f1-b99a-e4ff52df8415 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:54.450262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5b1c037d942efb8b2d455f7b6a760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34fc2aeace2346329e2035646bdd4a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:54.462948 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ef67637-aecc-433d-b738-6d4d0bd3f047 tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415" status: 200 len: 1307 microversion: 2.1 time: 0.159648 Feb 12 21:16:54.466670 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1822/3729] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:54 2022] GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:54.602810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:54.644058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2fa0cbb7-e038-46c6-a8b3-417cd9b36420 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1502 microversion: 2.1 time: 0.527067 Feb 12 21:16:54.655222 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1908/3730] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:54 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1502 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:54.675743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:54.676342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:54.691058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.691570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.705588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:54.707402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:54.785619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lazy-loading 'flavor' on Instance uuid 43260354-ea4d-4384-9956-3ded0eb6b91c {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:55.317689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:55.318567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:55.330962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.331637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.332779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.333813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.460407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0790772a-56d4-4590-9151-cee2318b6add tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c/action" status: 202 len: 0 microversion: 2.1 time: 0.787836 Feb 12 21:16:55.467572 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1823/3731] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:16:54 2022] POST /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:16:55.498875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:55.500815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:55.521059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.522215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.523519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.526211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.613611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:55.623313 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5fc54aae-68bd-44c6-b499-5ab6d21b9b89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1314 microversion: 2.1 time: 0.318925 Feb 12 21:16:55.624598 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1909/3732] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:55 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:55.629627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:55.631535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: a86bfb3b-f693-42f1-b99a-e4ff52df8415] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:55.647715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.653908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.675978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.675978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.702274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] HTTP exception thrown: Instance a86bfb3b-f693-42f1-b99a-e4ff52df8415 could not be found. Feb 12 21:16:55.702891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Returning 404 to user: Instance a86bfb3b-f693-42f1-b99a-e4ff52df8415 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:55.704470 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56a6a63a-5012-4400-b4aa-bd019a80074b tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415" status: 404 len: 111 microversion: 2.1 time: 0.078151 Feb 12 21:16:55.704775 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1910/3733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:55 2022] GET /compute/v2.1/servers/a86bfb3b-f693-42f1-b99a-e4ff52df8415 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:16:55.719466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:55.720355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] [instance: c17a1dbb-861a-43c9-b417-0cd379869e0c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:55.751118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.751735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.752664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:55.763812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:55.810420 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] HTTP exception thrown: Instance c17a1dbb-861a-43c9-b417-0cd379869e0c could not be found. Feb 12 21:16:55.818321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] Returning 404 to user: Instance c17a1dbb-861a-43c9-b417-0cd379869e0c could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:16:55.819218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa78d956-0f7f-49d2-bd56-df310502aeeb tempest-MultipleCreateTestJSON-1637110307 tempest-MultipleCreateTestJSON-1637110307-project] 10.222.0.31 "GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c" status: 404 len: 111 microversion: 2.1 time: 0.110311 Feb 12 21:16:55.820100 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1911/3734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:55 2022] GET /compute/v2.1/servers/c17a1dbb-861a-43c9-b417-0cd379869e0c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:16:56.041276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:56.049636 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3830c8b9-0336-4099-a8a4-cfdbc9d86242 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.577850 Feb 12 21:16:56.053707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1824/3735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:55 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:56.147792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3490a8f6-aea4-4036-aed8-a88a89f2bc7a req-e3f0a008-4868-4fe8-92d1-9de383e933c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c17a1dbb-861a-43c9-b417-0cd379869e0c", "name": "network-vif-deleted", "tag": "2b497b99-f059-46d5-86fa-8f5cb6613ed5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:56.151753 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:56.151753 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:16:56.167611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3490a8f6-aea4-4036-aed8-a88a89f2bc7a req-e3f0a008-4868-4fe8-92d1-9de383e933c2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:56.168072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3490a8f6-aea4-4036-aed8-a88a89f2bc7a req-e3f0a008-4868-4fe8-92d1-9de383e933c2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:56.182817 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3490a8f6-aea4-4036-aed8-a88a89f2bc7a req-e3f0a008-4868-4fe8-92d1-9de383e933c2 service nova] Creating event network-vif-deleted:2b497b99-f059-46d5-86fa-8f5cb6613ed5 for instance c17a1dbb-861a-43c9-b417-0cd379869e0c on nch2-master-1 Feb 12 21:16:56.188127 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3490a8f6-aea4-4036-aed8-a88a89f2bc7a req-e3f0a008-4868-4fe8-92d1-9de383e933c2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046481 Feb 12 21:16:56.189051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1912/3736] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:16:56.643170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:56.645051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:56.654847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:56.655914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:56.657455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:56.658137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:57.068713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:57.069750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:57.099213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:57.108875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:57.108875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:57.108875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:57.196027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:57.204675 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-834814a0-82a5-4883-ab7a-67be0aa86610 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1314 microversion: 2.1 time: 0.566348 Feb 12 21:16:57.209060 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1825/3737] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:56 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:57.920051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-38e2ca00-8b6b-49b9-9b15-ddf478d2282a req-0b75339f-d7ea-4156-a476-ad4929209bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714a1949-e3c7-4d02-9972-0d3aa74311af", "name": "network-vif-plugged", "status": "completed", "tag": "05bf65a0-d7cd-46e3-8256-7885b95b7048"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:57.923030 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:16:57.923030 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:16:57.931572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-38e2ca00-8b6b-49b9-9b15-ddf478d2282a req-0b75339f-d7ea-4156-a476-ad4929209bc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:57.932323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-38e2ca00-8b6b-49b9-9b15-ddf478d2282a req-0b75339f-d7ea-4156-a476-ad4929209bc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:57.949121 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-38e2ca00-8b6b-49b9-9b15-ddf478d2282a req-0b75339f-d7ea-4156-a476-ad4929209bc6 service nova] Creating event network-vif-plugged:05bf65a0-d7cd-46e3-8256-7885b95b7048 for instance 714a1949-e3c7-4d02-9972-0d3aa74311af on nch1-master-1 Feb 12 21:16:57.955770 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-38e2ca00-8b6b-49b9-9b15-ddf478d2282a req-0b75339f-d7ea-4156-a476-ad4929209bc6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039528 Feb 12 21:16:57.957486 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1826/3738] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:16:58.229056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:58.230142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:58.236837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:58.237542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:58.238501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:58.238943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:58.304870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:58.312754 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-02096901-0bbd-4bea-977a-81f58a37781a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 1.248926 Feb 12 21:16:58.323494 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1913/3739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:57 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:58.406252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:58.414348 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57eb7b8d-3945-4c79-b4fa-347f09cb0f87 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1314 microversion: 2.1 time: 0.191385 Feb 12 21:16:58.425229 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1827/3740] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:58 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:16:58.637437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2111320448", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "60c18811-ef4a-47ff-b603-d10b9aa4b0c2"}], "security_groups": [{"name": "tempest-securitygroup--765848098"}], "key_name": "tempest-keypair-614800946", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:58.747585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] validate_networks() for [('60c18811-ef4a-47ff-b603-d10b9aa4b0c2', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:59.166915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:59.172104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for user 4b20374617ab42cda524d241b44b43d2 and project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: dict_keys(['metadata_items']) {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:59.185348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:59.185878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:59.186435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:59.186922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:59.187516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:16:59.196980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.197508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.198329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.198766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.216881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:16:59.222957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Getting quotas for user 4b20374617ab42cda524d241b44b43d2 and project 49299cdcee8d47d1b73297ccf7e09ef6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:16:59.235520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:16:59.237969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:16:59.381103 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ec940fbf-937f-42fb-bea8-f86c9c14a791 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.752319 Feb 12 21:16:59.388608 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1914/3741] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:16:59.393905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:59.394698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:59.402235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.402890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.403847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.404450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.463049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1515785104", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "f840d0d6-34c0-4ae8-a6b5-7fb846e48b92"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:59.546726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] validate_networks() for [('f840d0d6-34c0-4ae8-a6b5-7fb846e48b92', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:16:59.625866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:59.640703 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea68df6a-73e8-477e-ab4b-2ca853a58d0f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.250572 Feb 12 21:16:59.641682 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1915/3742] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:59 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:59.649489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b760d396-106b-43d7-8a3c-4d4c6bbb4ab9 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:59.649762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b760d396-106b-43d7-8a3c-4d4c6bbb4ab9 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:59.704623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b760d396-106b-43d7-8a3c-4d4c6bbb4ab9 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:59.711378 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b760d396-106b-43d7-8a3c-4d4c6bbb4ab9 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1277 microversion: 2.1 time: 0.068491 Feb 12 21:16:59.712011 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1916/3743] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:59 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1277 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:59.716452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:16:59.717096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:59.723913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.724909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.725966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.727097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.879565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:16:59.888257 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a3b838c-b021-4ccf-b48f-fab60f0386e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1499 microversion: 2.1 time: 0.175175 Feb 12 21:16:59.888992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1917/3744] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:16:59 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:16:59.905755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:16:59.906781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:16:59.912806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.913498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.914349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:16:59.915422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:16:59.939404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lazy-loading 'flavor' on Instance uuid 714a1949-e3c7-4d02-9972-0d3aa74311af {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:16:59.991151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:16:59.991151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:16:59.991430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:16:59.992053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:16:59.992536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:00.003959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.003959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.004853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.005301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.030954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Getting quotas for project 3c5bbc73117e44dcafcdec9e0fc9ae67. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:00.037675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Getting quotas for user 42b141ef758e4f4fb86607df206bdbad and project 3c5bbc73117e44dcafcdec9e0fc9ae67. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:00.052576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:17:00.055942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:17:00.188278 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-897e218f-d943-4ff0-a386-a56bbe57bbfc tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910924 Feb 12 21:17:00.193570 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1828/3745] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:17:00.201191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cce36d6-bf99-419e-98b8-0caaab651a89 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:00.202181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3cce36d6-bf99-419e-98b8-0caaab651a89 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:00.234832 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3c78f472-f8a9-44f3-b413-1ae7c2d453b5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "POST /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af/action" status: 200 len: 32 microversion: 2.1 time: 0.332797 Feb 12 21:17:00.235633 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1918/3746] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:16:59 2022] POST /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af/action => generated 32 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 12 21:17:00.246126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:00.253155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:00.253799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.254991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.256054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.256654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.282286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3cce36d6-bf99-419e-98b8-0caaab651a89 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:00.292156 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3cce36d6-bf99-419e-98b8-0caaab651a89 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1225 microversion: 2.1 time: 0.097147 Feb 12 21:17:00.309515 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1829/3747] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:00 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:00.627893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:00.639839 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b544792-8e2e-4cd3-b6f1-3c13dc0c3bab tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.398808 Feb 12 21:17:00.643678 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1919/3748] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:00 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:00.659196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:00.660408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:00.668624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.669232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.670111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.670504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.727827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:00.728637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:00.735682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.737462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.738491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:00.739136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:00.866764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:00.872469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:00.878363 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2358b01a-948d-4d3b-99c3-9ec988550385 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1281 microversion: 2.1 time: 0.154058 Feb 12 21:17:00.879370 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1920/3749] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:00 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:00.889626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5f4cd7fb-5dd0-4fcc-9db9-3420e7cd4710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.234455 Feb 12 21:17:00.890232 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1830/3750] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:00 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:01.315689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-55d7e648-0fea-4ad1-8ec6-4fb99555ff81 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:01.316309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-55d7e648-0fea-4ad1-8ec6-4fb99555ff81 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:01.392732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-55d7e648-0fea-4ad1-8ec6-4fb99555ff81 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:01.411583 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-55d7e648-0fea-4ad1-8ec6-4fb99555ff81 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1225 microversion: 2.1 time: 0.100722 Feb 12 21:17:01.412932 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1921/3751] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:01 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:01.659386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:01.660409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:01.674172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:01.674172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:01.674172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:01.674862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:01.896785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:01.896785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:01.907131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:01.908564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:01.909588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:01.910134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:01.984462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:01.993539 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-18f8fa6d-3a4b-40ec-ae04-9abae196042a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1329 microversion: 2.1 time: 0.101114 Feb 12 21:17:01.994521 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1922/3752] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:01 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:02.001156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:02.001927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:02.009169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:02.010248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:02.011306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:02.011910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:02.132091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:02.141823 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3847bcb6-d19f-44a9-b7dd-12e5f873737b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.485748 Feb 12 21:17:02.142419 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1831/3753] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:01 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:02.316640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:02.325816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eca4d8bc-e555-4655-876c-f3829dceea31 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.329994 Feb 12 21:17:02.344435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1923/3754] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:01 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:02.431352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:02.435877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:02.449438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:02.453225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:02.453225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:02.453225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:02.597468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:02.605853 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9eeb1ec-df9c-438b-825c-93d77284e37d tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1277 microversion: 2.1 time: 0.178452 Feb 12 21:17:02.606655 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1832/3755] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:02 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:03.013074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:03.013681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:03.020206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.020832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.021656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.022090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.107716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:03.126250 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ec5f3715-573e-454b-9bc4-7bf96381c763 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1335 microversion: 2.1 time: 0.108573 Feb 12 21:17:03.128542 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1924/3756] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:03 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:03.160200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:03.162308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:03.170508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.171610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.172449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.173127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.345517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:03.346141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:03.354062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.354282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.354983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.355431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.400929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:03.408765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f5d92672-53d6-4a1b-948b-50b4ce84ffb7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.252293 Feb 12 21:17:03.409527 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1833/3757] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:03 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:03.542812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:03.552009 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0406f177-0034-405a-ad7a-d06b74f63f06 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.210258 Feb 12 21:17:03.553153 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1925/3758] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:03 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:03.623206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:03.627465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:03.634158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.634679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.635506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:03.637547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:03.796316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:03.809193 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cccf63a9-01e8-4a82-b8de-6dd44e383a8b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1295 microversion: 2.1 time: 0.189178 Feb 12 21:17:03.810720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1834/3759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:03 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1295 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:04.133182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:04.133822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:04.140648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.141101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.142738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.143179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.321637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-211305808", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "44186d02-70f8-4028-8e69-858d25e0db1e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:04.388978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] validate_networks() for [('44186d02-70f8-4028-8e69-858d25e0db1e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:17:04.514117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:04.530156 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c4fa5e5-d227-4a33-b97c-6f6b8a88d296 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.400713 Feb 12 21:17:04.531363 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1835/3760] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:04 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:04.535956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:04.536955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:04.549545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.550206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.551267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.551858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.769382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:04.785034 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fbc2c463-96aa-460c-83eb-75c4009a646d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.251170 Feb 12 21:17:04.785928 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1836/3761] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:04 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:04.825906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:04.849227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:04.850049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:17:04.850049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:17:04.850049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:17:04.850049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:17:04.850049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:04.850797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.850797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.850797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.850797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.870724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.871937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.873443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:04.877911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:04.923062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Getting quotas for project 95a1429cd8d84c728ca087a71fdd26b5. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:04.932351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Getting quotas for user 5f2c9d4b3ea044359b030a7dc91bd7ea and project 95a1429cd8d84c728ca087a71fdd26b5. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:04.964440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:17:04.968314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:17:05.182304 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93121c43-ad40-4851-86c4-0d787056eec9 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140049 Feb 12 21:17:05.187756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1926/3762] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:17:05.190020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:05.191247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:05.231839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.235779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:05.238285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.238750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:05.306314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:05.316530 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3cadb268-141c-4f08-ba77-0da15c1a52c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.529397 Feb 12 21:17:05.317762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1837/3763] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:04 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:05.324012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a898960d-a3c6-422d-94d2-208259f81f57 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:05.324971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a898960d-a3c6-422d-94d2-208259f81f57 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:05.411941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a898960d-a3c6-422d-94d2-208259f81f57 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:05.423269 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a898960d-a3c6-422d-94d2-208259f81f57 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1223 microversion: 2.1 time: 0.103410 Feb 12 21:17:05.424371 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1838/3764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:05 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:05.480038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:05.488342 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16e2a67c-700d-4620-b922-f34351660cd8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1325 microversion: 2.1 time: 0.303942 Feb 12 21:17:05.490738 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1927/3765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:05 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:05.547335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:05.547988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:05.554069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.554528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:05.555521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.555975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:05.701048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-808b788b-4e89-4ebb-892d-1ab2f05199a0 req-38aff091-ba70-4d87-8f32-2ab11207c80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bcdf4e-680f-4f72-a170-6bc26614f067", "tag": "f91629a6-c2b4-4bc9-b4ab-82ef49b98450"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:05.703835 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:05.703835 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:05.714560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-808b788b-4e89-4ebb-892d-1ab2f05199a0 req-38aff091-ba70-4d87-8f32-2ab11207c80f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.715481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-808b788b-4e89-4ebb-892d-1ab2f05199a0 req-38aff091-ba70-4d87-8f32-2ab11207c80f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:05.729165 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-808b788b-4e89-4ebb-892d-1ab2f05199a0 req-38aff091-ba70-4d87-8f32-2ab11207c80f service nova] Creating event network-changed:f91629a6-c2b4-4bc9-b4ab-82ef49b98450 for instance 30bcdf4e-680f-4f72-a170-6bc26614f067 on nch2-master-1 Feb 12 21:17:05.741490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-808b788b-4e89-4ebb-892d-1ab2f05199a0 req-38aff091-ba70-4d87-8f32-2ab11207c80f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044598 Feb 12 21:17:05.743508 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1928/3766] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:05.803889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:05.805288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:05.816908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.816908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:05.816908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:05.816908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:06.062884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:06.064941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:06.075069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ec4e9b0-2563-419d-afcd-13d8d23f90dd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.531402 Feb 12 21:17:06.076048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1839/3767] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:05 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:06.079858 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-06673603-7097-471d-aede-e5e4a7069303 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.280119 Feb 12 21:17:06.080621 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1929/3768] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:05 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:06.338704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:06.341140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:06.364008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:06.364433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:06.365233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:06.365709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:06.441296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7b8b997-2271-490a-9895-55348cfb7c91 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:06.442097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b7b8b997-2271-490a-9895-55348cfb7c91 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:06.508058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b7b8b997-2271-490a-9895-55348cfb7c91 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:06.516047 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b7b8b997-2271-490a-9895-55348cfb7c91 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1223 microversion: 2.1 time: 0.078350 Feb 12 21:17:06.525481 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1930/3769] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:06 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:06.525481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:06.525481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:06.531905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:06.532438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:06.534018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:06.534018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:06.766334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:06.776121 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d8586647-cd30-43e0-8ddc-6669c49142a1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.444725 Feb 12 21:17:06.789088 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1840/3770] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:06 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:06.842780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:06.850375 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-78696938-c964-4d3a-b5e2-c7445443bd1b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1325 microversion: 2.1 time: 0.332058 Feb 12 21:17:06.857958 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1931/3771] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:06 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:07.096979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:07.097204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:07.098022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:07.098180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:07.106709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.114760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.114913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.114913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.115432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.115536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.115630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.115630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.319889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:07.331967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b87a9ad-6993-43b2-8403-4354e26c6f7f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.238873 Feb 12 21:17:07.333304 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1932/3772] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:07 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:07.438370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:07.454383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c89f8faa-6280-4bea-994a-e1206d116ef1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.362712 Feb 12 21:17:07.455815 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1841/3773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:07 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:07.533486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:07.535224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:07.543404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.544128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.545109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.545887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.618952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:07.627490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b83614b-d5ef-44e2-924d-ef82bd030a3b tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1275 microversion: 2.1 time: 0.097578 Feb 12 21:17:07.628570 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1933/3774] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:07 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:07.777898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-58720367-311d-4725-8c81-e6b711f1d345 req-6a405a8d-4afe-456e-9fd1-0c2c012b437c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c156c72-c3aa-4235-92ee-32b2e447f9d6", "tag": "824f283f-b4b1-4f13-aa18-8427b9255212"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:07.779479 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:07.779479 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:07.786816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-58720367-311d-4725-8c81-e6b711f1d345 req-6a405a8d-4afe-456e-9fd1-0c2c012b437c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.787264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-58720367-311d-4725-8c81-e6b711f1d345 req-6a405a8d-4afe-456e-9fd1-0c2c012b437c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.795616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:07.804551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:07.804924 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-58720367-311d-4725-8c81-e6b711f1d345 req-6a405a8d-4afe-456e-9fd1-0c2c012b437c service nova] Creating event network-changed:824f283f-b4b1-4f13-aa18-8427b9255212 for instance 2c156c72-c3aa-4235-92ee-32b2e447f9d6 on nch2-master-1 Feb 12 21:17:07.805077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.805077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.805283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.805716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.806809 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-58720367-311d-4725-8c81-e6b711f1d345 req-6a405a8d-4afe-456e-9fd1-0c2c012b437c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033226 Feb 12 21:17:07.807495 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1842/3775] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:07.875513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:07.876298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:07.884464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.884923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:07.885958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:07.887447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.135527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:08.147042 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d1aff7ec-f798-42f1-88ce-30537cb724d0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.355219 Feb 12 21:17:08.147667 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1934/3776] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:07 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:08.353989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:08.358708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:08.362760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:08.363546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.364811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:08.366505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.493987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:08.511077 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55a2f8ab-8521-42a1-bde5-db95af8888aa tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1325 microversion: 2.1 time: 0.637822 Feb 12 21:17:08.512485 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1843/3777] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:07 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:08.523077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:08.526315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:08.543605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:08.546769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.547822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:08.548375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.630371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:08.639227 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1212140-7788-43c4-8578-ea33bae60786 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.293187 Feb 12 21:17:08.640089 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1935/3778] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:08 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:08.647823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:08.649194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:08.655955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:08.656533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.657633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:08.658303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:08.728569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:08.740576 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a721b523-17c1-4c18-8dea-f40dd21cc3c4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1281 microversion: 2.1 time: 0.091920 Feb 12 21:17:08.746501 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1936/3779] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:08 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:08.866549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:08.882414 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-216b4384-e405-4f29-9134-5028e81d6807 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.367839 Feb 12 21:17:08.883648 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1844/3780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:08 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:09.177788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:09.178654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:09.203045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.203502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.205115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.207474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.530324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:09.531317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:09.538676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.539192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.540507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.540950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.565639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:09.574766 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-277417e6-0e2b-41e6-9b7d-a4268636f03e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.414521 Feb 12 21:17:09.575753 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1937/3781] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:09 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:09.660341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:09.661853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:09.673457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.674297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.675654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.676308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.767267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:09.782131 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e9040a19-eb3a-455e-9bb6-ea1cdb2c3798 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1325 microversion: 2.1 time: 0.251653 Feb 12 21:17:09.782131 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1845/3782] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:09 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1325 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:09.783062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:09.783937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:09.792628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.793088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.794107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:09.794644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:09.997452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:10.005023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:10.030577 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c68e70b-4bc4-4e59-bc21-b45a15c32f5a tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.251268 Feb 12 21:17:10.040836 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1846/3783] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:09 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:10.041313 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-128da3f2-930c-49c3-9223-bcf9a4d47ae3 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.376354 Feb 12 21:17:10.044929 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1938/3784] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:09 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:10.050098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:10.050829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:10.059387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.059835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:10.060653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.061098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:10.229391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ba3ab89f-fa0a-4428-9732-73dd2dfab77d req-70049b28-1bf0-47a2-8e30-21bf5c63f27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a81dfab-eea2-4abf-b66d-de52c64735b9", "tag": "236967cf-2667-4591-92ad-3078283d88e3"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:10.232217 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:10.232217 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:10.248567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ba3ab89f-fa0a-4428-9732-73dd2dfab77d req-70049b28-1bf0-47a2-8e30-21bf5c63f27e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.249049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ba3ab89f-fa0a-4428-9732-73dd2dfab77d req-70049b28-1bf0-47a2-8e30-21bf5c63f27e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:10.284887 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ba3ab89f-fa0a-4428-9732-73dd2dfab77d req-70049b28-1bf0-47a2-8e30-21bf5c63f27e service nova] Creating event network-changed:236967cf-2667-4591-92ad-3078283d88e3 for instance 4a81dfab-eea2-4abf-b66d-de52c64735b9 on nch1-master-1 Feb 12 21:17:10.298917 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ba3ab89f-fa0a-4428-9732-73dd2dfab77d req-70049b28-1bf0-47a2-8e30-21bf5c63f27e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076108 Feb 12 21:17:10.301850 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1939/3785] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:10.359092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:10.374093 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c4025ed-dc95-4555-b803-70d07a7e6df6 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.328181 Feb 12 21:17:10.374692 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1847/3786] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:10 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:10.594635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:10.595987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:10.615815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.619331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:10.622221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.623199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:10.795356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:10.795999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:10.807238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.808335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:10.811460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:10.813054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.066339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:11.080190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36c34788-9770-44c7-9cdb-53789990a4b6 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1325 microversion: 2.1 time: 0.289049 Feb 12 21:17:11.080794 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1848/3787] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:10 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:11.087589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:11.091721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:11.104199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.107901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.109017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.109936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.215053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:11.229985 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f4758c9-b2b8-4c4f-920a-1e7ba3b18bac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.640470 Feb 12 21:17:11.242037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1940/3788] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:10 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:11.248065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:11.254008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:11.259936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.260626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.263040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.263760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.354408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:11.369516 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30dbece7-7581-4d87-acad-3b3f789362f8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.280098 Feb 12 21:17:11.369516 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1849/3789] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:11 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:11.394259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:11.394994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:11.404866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.405331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.406168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.406628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.550662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:11.560790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9d31d68d-702d-48db-8cee-9ef02bff4698 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.316978 Feb 12 21:17:11.572259 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1941/3790] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:11 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:11.626128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:11.639504 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1e4d35ee-f23c-4b6d-8718-2fb41b0758bc tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.245991 Feb 12 21:17:11.652548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1850/3791] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:11 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:11.718826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7e67ad39-c87e-4172-a747-e83f7da81286 req-19b6323d-f328-4355-9a53-d5fe38d9dc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c156c72-c3aa-4235-92ee-32b2e447f9d6", "name": "network-vif-plugged", "status": "completed", "tag": "824f283f-b4b1-4f13-aa18-8427b9255212"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:11.720954 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:11.720954 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:11.729108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7e67ad39-c87e-4172-a747-e83f7da81286 req-19b6323d-f328-4355-9a53-d5fe38d9dc19 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:11.729619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7e67ad39-c87e-4172-a747-e83f7da81286 req-19b6323d-f328-4355-9a53-d5fe38d9dc19 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:11.741249 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7e67ad39-c87e-4172-a747-e83f7da81286 req-19b6323d-f328-4355-9a53-d5fe38d9dc19 service nova] Creating event network-vif-plugged:824f283f-b4b1-4f13-aa18-8427b9255212 for instance 2c156c72-c3aa-4235-92ee-32b2e447f9d6 on nch2-master-1 Feb 12 21:17:11.747248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7e67ad39-c87e-4172-a747-e83f7da81286 req-19b6323d-f328-4355-9a53-d5fe38d9dc19 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032286 Feb 12 21:17:11.753193 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1942/3792] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:12.097307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:12.104264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:12.105463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.105926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.106737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.107190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.250708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:12.252602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:12.252852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:12.261275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.263393 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9e40264-3f4b-4096-b0fa-e30a0bced116 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1325 microversion: 2.1 time: 0.168346 Feb 12 21:17:12.263505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.263505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.263980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.268990 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1851/3793] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:12 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:12.380985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:12.380985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:12.388379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.388954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.389874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.390388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.468862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:12.480008 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8cee511-03b1-45a7-ba38-182a43ce82f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.235807 Feb 12 21:17:12.480978 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1943/3794] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:12 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:12.549042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:12.557856 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15b5826b-86de-4c38-b6be-2423f72752fc tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.181584 Feb 12 21:17:12.558536 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1852/3795] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:12 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:12.577339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:12.577972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:12.583917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.584370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.585153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.585697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.660599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:12.661204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:12.668316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.668701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.669544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:12.669987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:12.776253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:12.797461 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe18dabd-fb41-4aec-b67b-738262f70091 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.220699 Feb 12 21:17:12.798636 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1944/3796] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:12 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:12.919845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:12.928218 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a553657-2989-4eb6-a31f-6ef2cf4b7e31 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.276129 Feb 12 21:17:12.929050 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1853/3797] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:12 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:13.285192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:13.285935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:13.294870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.295397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.296953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.297490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.458737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:13.467183 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c769dfa7-c038-4846-8773-03eabcacf026 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1521 microversion: 2.1 time: 0.185521 Feb 12 21:17:13.469017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1945/3798] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:13.483555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:13.484110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:13.492821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.493309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.494318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.494927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.501152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:13.502383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:13.514768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.515457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.517032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.517715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.534493 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] HTTP exception thrown: Action 999 not found Feb 12 21:17:13.535105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Returning 404 to user: Action 999 not found {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:13.540462 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e29d5131-7315-4aa5-8c37-18bc360ea373 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.056221 Feb 12 21:17:13.540462 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1854/3799] 10.222.0.31 () {58 vars in 1307 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6/os-instance-actions/999 => generated 66 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:17:13.552398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba911d4e-1779-4227-9213-5d860ae094ff tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '.version_select at 0x7fa8fd7763a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:13.554107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ba911d4e-1779-4227-9213-5d860ae094ff tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 7f640982-7e64-44d9-b8d0-6bed686c8c49] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:13.560643 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ba911d4e-1779-4227-9213-5d860ae094ff tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] HTTP exception thrown: Instance 7f640982-7e64-44d9-b8d0-6bed686c8c49 could not be found. Feb 12 21:17:13.561492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba911d4e-1779-4227-9213-5d860ae094ff tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Returning 404 to user: Instance 7f640982-7e64-44d9-b8d0-6bed686c8c49 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:13.562759 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ba911d4e-1779-4227-9213-5d860ae094ff tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/7f640982-7e64-44d9-b8d0-6bed686c8c49/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019112 Feb 12 21:17:13.563658 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1855/3800] 10.222.0.31 () {58 vars in 1295 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/7f640982-7e64-44d9-b8d0-6bed686c8c49/os-instance-actions => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:17:13.585062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:13.585062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:13.588770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.589451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.590478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.591097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.627267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:17:13.699340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:13.708994 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f0d0546-bbf1-4870-8702-9de307a868f8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.213723 Feb 12 21:17:13.709535 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1946/3801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:13.715234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:13.716099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:13.722581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.723158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.724110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.724992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.908693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:13.923923 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c22f7df2-0905-42a8-bd01-b87fff61f240 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.213023 Feb 12 21:17:13.924497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1947/3802] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:13.935914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d616d639-a4c4-40a7-8005-89ca932771be req-23d9db45-7c3b-47e2-94dd-69830ba0a22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bcdf4e-680f-4f72-a170-6bc26614f067", "name": "network-vif-plugged", "status": "completed", "tag": "f91629a6-c2b4-4bc9-b4ab-82ef49b98450"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:13.950812 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:13.950812 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:13.968167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d616d639-a4c4-40a7-8005-89ca932771be req-23d9db45-7c3b-47e2-94dd-69830ba0a22a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:13.968806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d616d639-a4c4-40a7-8005-89ca932771be req-23d9db45-7c3b-47e2-94dd-69830ba0a22a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:13.986288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d616d639-a4c4-40a7-8005-89ca932771be req-23d9db45-7c3b-47e2-94dd-69830ba0a22a service nova] Creating event network-vif-plugged:f91629a6-c2b4-4bc9-b4ab-82ef49b98450 for instance 30bcdf4e-680f-4f72-a170-6bc26614f067 on nch2-master-1 Feb 12 21:17:13.990554 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3e158dd-5c0b-4ff6-ab10-2d8f5ef99c5a tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 204 len: 0 microversion: 2.1 time: 0.420525 Feb 12 21:17:13.991620 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1856/3803] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:17:13 2022] DELETE /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:17:13.996201 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d616d639-a4c4-40a7-8005-89ca932771be req-23d9db45-7c3b-47e2-94dd-69830ba0a22a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070265 Feb 12 21:17:14.000384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:14.000384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:14.001266 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1948/3804] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:14.006833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:14.007542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:14.015784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.017707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.020370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.021164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.021978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.022692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.024775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.025241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.257296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:14.271880 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1fa14353-694d-4312-ace5-2a24a44f3ca0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.277509 Feb 12 21:17:14.274577 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1857/3805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:14.281199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:14.290134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:14.290817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:14.298778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.299458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.299587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f523fabf-775f-4fdf-9355-d302f333f3a2 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.298370 Feb 12 21:17:14.300191 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1949/3806] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:13 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:14.301304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.305829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.449740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:14.457148 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a5bd453-dd82-4b78-8928-a40f4c2a0328 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1527 microversion: 2.1 time: 0.181327 Feb 12 21:17:14.457748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1858/3807] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:14 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:14.726500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:14.727929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:14.734565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.735016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.735817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.736251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.901712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:14.909525 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-566d8d0b-e948-4d63-b785-0c674c4eaacd tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.186934 Feb 12 21:17:14.910178 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1950/3808] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:14 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:14.941562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:14.942306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:14.949840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.954437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:14.954437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:14.954437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.115658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:15.123472 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9d9912b7-4b6a-4b45-9408-ada42c8c7f1d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.185694 Feb 12 21:17:15.124042 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1859/3809] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:14 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:15.290552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:15.291057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:15.296895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.299660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.299660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.299660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.316513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:15.317338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:15.324286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.324742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.325693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.326138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.470812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:15.480651 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f74ea33-9986-406b-967a-1e595de9adc2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.193936 Feb 12 21:17:15.481253 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1951/3810] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:15 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:15.507667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:15.508612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:15.510508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:15.519274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.522463 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-084d6878-ca79-4b5a-b763-5feedf5ddb34 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1402 microversion: 2.1 time: 0.209609 Feb 12 21:17:15.522940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.523850 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1860/3811] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:15 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1402 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:15.524904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.526943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.773142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:15.781889 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49b6c427-5117-4c14-bd35-bafa8c0ce4f1 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1527 microversion: 2.1 time: 0.299470 Feb 12 21:17:15.792996 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1952/3812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:15 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1527 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:15.927130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:15.928019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:15.935660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.936254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:15.939182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:15.940769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.012131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-626fccb9-6cc1-45c4-858d-233beb3ee38d req-671676bb-f3b4-4015-aee0-491a88c556bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81dfab-eea2-4abf-b66d-de52c64735b9", "name": "network-vif-plugged", "status": "completed", "tag": "236967cf-2667-4591-92ad-3078283d88e3"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:16.014779 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:16.014779 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:16.022495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-626fccb9-6cc1-45c4-858d-233beb3ee38d req-671676bb-f3b4-4015-aee0-491a88c556bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.022942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-626fccb9-6cc1-45c4-858d-233beb3ee38d req-671676bb-f3b4-4015-aee0-491a88c556bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.035370 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-626fccb9-6cc1-45c4-858d-233beb3ee38d req-671676bb-f3b4-4015-aee0-491a88c556bf service nova] Creating event network-vif-plugged:236967cf-2667-4591-92ad-3078283d88e3 for instance 4a81dfab-eea2-4abf-b66d-de52c64735b9 on nch1-master-1 Feb 12 21:17:16.040563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-626fccb9-6cc1-45c4-858d-233beb3ee38d req-671676bb-f3b4-4015-aee0-491a88c556bf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Feb 12 21:17:16.041181 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1953/3813] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:17:16.148094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:16.149738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:16.157588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.158897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.162694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.165864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.189215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:16.199491 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7fb7afaf-e081-431b-bf7c-73e3790bea00 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.276136 Feb 12 21:17:16.201184 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1861/3814] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:15 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:16.363756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:16.372250 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b8725c1-f0ca-4867-a698-8bea3c41af26 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.228521 Feb 12 21:17:16.373327 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1954/3815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:16 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:16.464165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5b6970c3-3b09-4021-8f87-78e4ea154a9f req-c13ee1fd-729f-4b21-94ba-5db51e9142c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c156c72-c3aa-4235-92ee-32b2e447f9d6", "name": "network-vif-deleted", "tag": "824f283f-b4b1-4f13-aa18-8427b9255212"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:16.465897 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:16.465897 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:16.475018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5b6970c3-3b09-4021-8f87-78e4ea154a9f req-c13ee1fd-729f-4b21-94ba-5db51e9142c6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.475477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5b6970c3-3b09-4021-8f87-78e4ea154a9f req-c13ee1fd-729f-4b21-94ba-5db51e9142c6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.488224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5b6970c3-3b09-4021-8f87-78e4ea154a9f req-c13ee1fd-729f-4b21-94ba-5db51e9142c6 service nova] Creating event network-vif-deleted:824f283f-b4b1-4f13-aa18-8427b9255212 for instance 2c156c72-c3aa-4235-92ee-32b2e447f9d6 on nch2-master-1 Feb 12 21:17:16.498469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:16.499085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:16.505307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.505797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.509850 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5b6970c3-3b09-4021-8f87-78e4ea154a9f req-c13ee1fd-729f-4b21-94ba-5db51e9142c6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048250 Feb 12 21:17:16.509850 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1862/3816] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:16.510160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.510528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.542603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:16.544005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:16.550849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.556032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.556032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.556032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.706156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:16.718456 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b2b6b0b3-bb06-4390-9854-6bc2043baf48 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.223521 Feb 12 21:17:16.722501 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1955/3817] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:16 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:16.734929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:16.744555 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-640a6615-8016-4d57-8916-66b049a54fcd tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1589 microversion: 2.1 time: 0.207826 Feb 12 21:17:16.746039 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1863/3818] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:16 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1589 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:16.765175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:16.766021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:16.779362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.779816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.780620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.781061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.801098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:16.801908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:16.810435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.811479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.812493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.813042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.849982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:16.850481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:16.851035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lazy-loading 'fault' on Instance uuid 2c156c72-c3aa-4235-92ee-32b2e447f9d6 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:17:16.879735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7cdaef88-45fd-4f01-a0dc-ca9f5081c331 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118979 Feb 12 21:17:16.882023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1956/3819] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:17:16 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:16.902272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b141ef758e4f4fb86607df206bdbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5bbc73117e44dcafcdec9e0fc9ae67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:16.913420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8b94a508-a92a-43de-8eb4-bcecb67c469b tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 200 len: 1315 microversion: 2.1 time: 0.116264 Feb 12 21:17:16.916334 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1864/3820] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:16 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 1315 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:17.220845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:17.222018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:17.231636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.232709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.234183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.234837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.390220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:17.391668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:17.399325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.400546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.407985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.408675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.520418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:17.528905 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca8c0977-9849-46cc-a282-1de749eed984 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.313821 Feb 12 21:17:17.538709 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1957/3821] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:17 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:17.560154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:17.567583 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b5f26de5-136a-4f6c-8a02-cc36d3c00af8 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1323 microversion: 2.1 time: 0.181982 Feb 12 21:17:17.568164 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1865/3822] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:17 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1323 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:17.735983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:17.736694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:17.743058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.743508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.744379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.745194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.931614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:17.932703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] [instance: 2c156c72-c3aa-4235-92ee-32b2e447f9d6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:17.939310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.939989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.943477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:17.943477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:17.956641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] HTTP exception thrown: Instance 2c156c72-c3aa-4235-92ee-32b2e447f9d6 could not be found. Feb 12 21:17:17.957645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] Returning 404 to user: Instance 2c156c72-c3aa-4235-92ee-32b2e447f9d6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:17.958677 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e79eb317-622a-4dcd-85d8-24543a8636a8 tempest-InstanceActionsNegativeTestJSON-579968405 tempest-InstanceActionsNegativeTestJSON-579968405-project] 10.222.0.31 "GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6" status: 404 len: 111 microversion: 2.1 time: 0.031232 Feb 12 21:17:17.963220 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1866/3823] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:17 2022] GET /compute/v2.1/servers/2c156c72-c3aa-4235-92ee-32b2e447f9d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:17:18.006530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:18.016100 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab7b69b2-c595-4aa5-b37a-93b20dcb93b8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.283527 Feb 12 21:17:18.017056 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1958/3824] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:17 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:18.209619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c2f4d20d-5ee9-4698-83a8-e31085b96b0b req-db995a3a-2f3c-4c4f-b09f-165bf92b4758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bcdf4e-680f-4f72-a170-6bc26614f067", "tag": "f91629a6-c2b4-4bc9-b4ab-82ef49b98450"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:18.211743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:18.212375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:18.216622 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:18.216622 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:18.222653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.223230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.227294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c2f4d20d-5ee9-4698-83a8-e31085b96b0b req-db995a3a-2f3c-4c4f-b09f-165bf92b4758 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.227294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c2f4d20d-5ee9-4698-83a8-e31085b96b0b req-db995a3a-2f3c-4c4f-b09f-165bf92b4758 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.227504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.228481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.241019 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c2f4d20d-5ee9-4698-83a8-e31085b96b0b req-db995a3a-2f3c-4c4f-b09f-165bf92b4758 service nova] Creating event network-changed:f91629a6-c2b4-4bc9-b4ab-82ef49b98450 for instance 30bcdf4e-680f-4f72-a170-6bc26614f067 on nch2-master-1 Feb 12 21:17:18.246486 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c2f4d20d-5ee9-4698-83a8-e31085b96b0b req-db995a3a-2f3c-4c4f-b09f-165bf92b4758 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040349 Feb 12 21:17:18.247442 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1959/3825] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:18.541461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:18.549034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:18.549864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:18.551478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2e4b0c79-9fd9-4b68-9f12-46015aa09625 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1589 microversion: 2.1 time: 0.348766 Feb 12 21:17:18.555411 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1867/3826] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:18 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1589 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:18.572490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.573060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.574528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.575049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.586349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:18.587295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:18.596345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.598282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.600805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:18.601926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:18.862924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:18.875551 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e4f0944-6379-4778-b25f-d24795571c81 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.331754 Feb 12 21:17:18.878005 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1960/3827] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:18 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:18.930302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:18.940690 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-991b3b80-a484-4acb-a0aa-fcb1d1a48170 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1519 microversion: 2.1 time: 0.357903 Feb 12 21:17:18.942218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1868/3828] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:18 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:19.041273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:19.042800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:19.051769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:19.052369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:19.053275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:19.053880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:19.204475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8d1ee1f-6106-449a-8309-27dcd714c6f2 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-134195684", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "44186d02-70f8-4028-8e69-858d25e0db1e"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:19.205896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8d1ee1f-6106-449a-8309-27dcd714c6f2 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:19.206985 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8d1ee1f-6106-449a-8309-27dcd714c6f2 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.006887 Feb 12 21:17:19.207882 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1869/3829] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:19 2022] POST /compute/v2.1/servers => generated 175 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:17:19.220393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b8b4fcc-9bd2-431f-9df9-97519fb642d4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:19.221564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9b8b4fcc-9bd2-431f-9df9-97519fb642d4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 16bf60b8-5479-4974-bfd5-6e8e7a54ccbb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:19.228857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:19.234748 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-9b8b4fcc-9bd2-431f-9df9-97519fb642d4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] HTTP exception thrown: Instance 16bf60b8-5479-4974-bfd5-6e8e7a54ccbb could not be found. Feb 12 21:17:19.235340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b8b4fcc-9bd2-431f-9df9-97519fb642d4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 404 to user: Instance 16bf60b8-5479-4974-bfd5-6e8e7a54ccbb could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:19.236178 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b8b4fcc-9bd2-431f-9df9-97519fb642d4 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/16bf60b8-5479-4974-bfd5-6e8e7a54ccbb/metadata" status: 404 len: 111 microversion: 2.1 time: 0.020651 Feb 12 21:17:19.236748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1870/3830] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:17:19 2022] GET /compute/v2.1/servers/16bf60b8-5479-4974-bfd5-6e8e7a54ccbb/metadata => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:17:19.276628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4adae488-b0ae-4024-b737-2c93d4398e77 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.242989 Feb 12 21:17:19.278629 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1961/3831] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:19 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:19.684457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a7d7acb-d288-49ce-a2e7-193fe04e337f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1553720253", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "44186d02-70f8-4028-8e69-858d25e0db1e"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:19.686564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a7d7acb-d288-49ce-a2e7-193fe04e337f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:19.687743 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a7d7acb-d288-49ce-a2e7-193fe04e337f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.008483 Feb 12 21:17:19.689788 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1871/3832] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:19 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:17:19.895618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:19.896214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:19.903987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:19.904759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:19.906147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:19.906697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:19.942326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0282cbe1-71a3-4165-b2e8-7679c6ca9514 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1922924675", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "44186d02-70f8-4028-8e69-858d25e0db1e"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:19.952654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0282cbe1-71a3-4165-b2e8-7679c6ca9514 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:19.954151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0282cbe1-71a3-4165-b2e8-7679c6ca9514 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.015513 Feb 12 21:17:19.965551 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1872/3833] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:19 2022] POST /compute/v2.1/servers => generated 689 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:17:20.068144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:20.075899 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-afaa9263-c6c2-493a-8540-9cb33ad12127 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.183963 Feb 12 21:17:20.076710 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1962/3834] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:19 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:20.294667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:20.295306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:20.301257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:20.301766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:20.302587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:20.303028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:20.441249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b2f851de-d298-4543-9bfe-478b22b3e3ca tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1485938021", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "44186d02-70f8-4028-8e69-858d25e0db1e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:20.444151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b2f851de-d298-4543-9bfe-478b22b3e3ca tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:20.446413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b2f851de-d298-4543-9bfe-478b22b3e3ca tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012702 Feb 12 21:17:20.447666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1963/3835] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:20 2022] POST /compute/v2.1/servers => generated 1197 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Feb 12 21:17:20.482245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:20.490077 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a290ecbc-2670-40a8-87b8-fe39885575d2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.200737 Feb 12 21:17:20.490808 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1873/3836] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:20 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:20.707117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8bd26feb-29b0-4414-9871-04a1c3475c4d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-573066950", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "44186d02-70f8-4028-8e69-858d25e0db1e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:20.713414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8bd26feb-29b0-4414-9871-04a1c3475c4d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:20.714592 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8bd26feb-29b0-4414-9871-04a1c3475c4d tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011980 Feb 12 21:17:20.723587 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1964/3837] 10.222.0.31 () {60 vars in 1147 bytes} [Sat Feb 12 21:17:20 2022] POST /compute/v2.1/servers => generated 2221 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Feb 12 21:17:20.729798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e23076c-d152-4b44-8e93-3a49a76a5e3f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:20.731076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e23076c-d152-4b44-8e93-3a49a76a5e3f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4ac411f9-a17b-4264-b171-21074540886c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:20.736581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3e23076c-d152-4b44-8e93-3a49a76a5e3f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] HTTP exception thrown: Instance 4ac411f9-a17b-4264-b171-21074540886c could not be found. Feb 12 21:17:20.737176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e23076c-d152-4b44-8e93-3a49a76a5e3f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 404 to user: Instance 4ac411f9-a17b-4264-b171-21074540886c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:20.738055 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e23076c-d152-4b44-8e93-3a49a76a5e3f tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4ac411f9-a17b-4264-b171-21074540886c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.013862 Feb 12 21:17:20.738584 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1874/3838] 10.222.0.31 () {58 vars in 1280 bytes} [Sat Feb 12 21:17:20 2022] GET /compute/v2.1/servers/4ac411f9-a17b-4264-b171-21074540886c/metadata/test2 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:17:20.756965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:20.756965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:20.760507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:20.760979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:20.761823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:20.763312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:20.790262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:17:21.092599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:21.093202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:21.098656 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f359781-b97c-43be-b0b2-f66f399d4b68 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 204 len: 0 microversion: 2.1 time: 0.349716 Feb 12 21:17:21.099992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1965/3839] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:17:20 2022] DELETE /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:17:21.100916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:21.101446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:21.104412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:21.104412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:21.107941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:21.108639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:21.114495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:21.114946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:21.115728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:21.116163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:21.269162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:21.289975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:21.290108 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-945767db-3214-4627-b894-77c82ac9651d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.189616 Feb 12 21:17:21.290108 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1875/3840] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:21 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:21.294490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f982a841-0bb2-453b-b166-dc1c401d428e tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1525 microversion: 2.1 time: 0.190327 Feb 12 21:17:21.295514 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1966/3841] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:21 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:21.507335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:21.508664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:21.515709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:21.516167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:21.516963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:21.517442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:21.663227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:21.671928 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e24c58c-c020-417c-8c7a-63908f452ae0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.168255 Feb 12 21:17:21.672501 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1876/3842] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:21 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:22.299160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:22.300027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:22.311582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:22.312975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:22.319271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:22.319733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:22.322376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:22.323269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:22.323721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:22.326938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:22.327757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:22.328217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:22.513876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:22.523170 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd7e04c7-c011-4552-9c60-92210cf25c64 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.227715 Feb 12 21:17:22.533765 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1967/3843] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:22 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:22.533965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:22.542874 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e958c97-7f48-4512-ae95-5d59c6ee8e25 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1525 microversion: 2.1 time: 0.234950 Feb 12 21:17:22.543453 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1877/3844] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:22 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1525 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:22.692067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:22.693020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:22.700076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:22.700919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:22.701749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:22.702405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:22.940236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:22.949035 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-370e9b99-cde9-406f-83ad-0d2a7b0a5dde tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.263020 Feb 12 21:17:22.959383 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1968/3845] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:22 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:23.407368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c6abaa67-ab04-4cf5-aad4-56aaf6852687 req-a06bd3e4-bf89-406b-a094-bdbaad1fa934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a81dfab-eea2-4abf-b66d-de52c64735b9", "name": "network-vif-deleted", "tag": "236967cf-2667-4591-92ad-3078283d88e3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:23.410402 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:23.410402 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:23.421244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c6abaa67-ab04-4cf5-aad4-56aaf6852687 req-a06bd3e4-bf89-406b-a094-bdbaad1fa934 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.422379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c6abaa67-ab04-4cf5-aad4-56aaf6852687 req-a06bd3e4-bf89-406b-a094-bdbaad1fa934 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.452393 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c6abaa67-ab04-4cf5-aad4-56aaf6852687 req-a06bd3e4-bf89-406b-a094-bdbaad1fa934 service nova] Creating event network-vif-deleted:236967cf-2667-4591-92ad-3078283d88e3 for instance 4a81dfab-eea2-4abf-b66d-de52c64735b9 on nch1-master-1 Feb 12 21:17:23.465011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c6abaa67-ab04-4cf5-aad4-56aaf6852687 req-a06bd3e4-bf89-406b-a094-bdbaad1fa934 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235016 Feb 12 21:17:23.466010 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1878/3846] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:23.541578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:23.542215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:23.549337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.549823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.550628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.551075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.564504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:23.565659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:23.573041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.573568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.574433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.575170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.611011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.611749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.612254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lazy-loading 'fault' on Instance uuid 4a81dfab-eea2-4abf-b66d-de52c64735b9 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:17:23.672274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2c9d4b3ea044359b030a7dc91bd7ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a1429cd8d84c728ca087a71fdd26b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:23.694176 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88d23f87-7c11-4977-bab3-bc924b897340 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 200 len: 1313 microversion: 2.1 time: 0.130089 Feb 12 21:17:23.701876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1879/3847] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:23 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:23.740263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:23.770403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9193e32c-50e0-4cd8-b8c7-a3455f015c76 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.233306 Feb 12 21:17:23.784011 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1969/3848] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:23 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:23.966899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:23.967593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:23.976023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.976754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:23.977735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:23.979964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:24.141150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:24.150525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e502d930-9885-433d-a7bb-b418388ab8ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.188082 Feb 12 21:17:24.151446 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1880/3849] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:23 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:24.708017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:24.709377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] [instance: 4a81dfab-eea2-4abf-b66d-de52c64735b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:24.717556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:24.718148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:24.719098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:24.719544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:24.735279 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] HTTP exception thrown: Instance 4a81dfab-eea2-4abf-b66d-de52c64735b9 could not be found. Feb 12 21:17:24.736063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] Returning 404 to user: Instance 4a81dfab-eea2-4abf-b66d-de52c64735b9 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:24.737764 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f77e183c-ff99-48e9-9c88-e241c1fe3649 tempest-ServerMetadataNegativeTestJSON-963674578 tempest-ServerMetadataNegativeTestJSON-963674578-project] 10.222.0.31 "GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9" status: 404 len: 111 microversion: 2.1 time: 0.033350 Feb 12 21:17:24.744138 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1970/3850] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:24 2022] GET /compute/v2.1/servers/4a81dfab-eea2-4abf-b66d-de52c64735b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:17:24.792601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:24.796090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:24.811710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:24.812194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:24.813961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:24.816582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:25.095234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:25.100298 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eeaa5011-53a2-4f38-8024-4a7a958ec094 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.314675 Feb 12 21:17:25.101002 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1881/3851] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:24 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:25.168777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:25.169676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:25.177719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:25.178496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:25.180839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:25.180839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:25.456117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:25.468109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f14e56be-5f62-4200-8b9b-f7e90d7df7f5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.303632 Feb 12 21:17:25.478839 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1971/3852] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:25 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:26.118483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:26.119953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:26.127465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:26.129180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:26.130062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:26.130695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:26.318757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:26.338511 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48395773-2047-4450-92b3-a07586de3f2e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1508 microversion: 2.1 time: 0.225266 Feb 12 21:17:26.350277 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1882/3853] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:26 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:26.487891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:26.489630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:26.500027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:26.500563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:26.505956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:26.505956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:27.193141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:27.205111 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9607ceea-ceec-4349-a743-dd6cf5e762dd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.724049 Feb 12 21:17:27.206395 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1972/3854] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:26 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:27.358485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:27.363984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:27.373530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:27.374333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:27.375946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:27.379764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:27.622176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:27.630957 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9be5e8c4-7754-48f6-8c17-92fcaca36fc0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1529 microversion: 2.1 time: 0.278110 Feb 12 21:17:27.638213 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1883/3855] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:27 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1529 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:28.225407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:28.226783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:28.243430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:28.243430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:28.245114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:28.247104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:28.536260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:28.544865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-292d5f88-378f-4606-b2b9-8e85d3ceb288 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.325273 Feb 12 21:17:28.552629 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1973/3856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:28 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:28.653894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:28.655326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:28.666324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:28.666896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:28.670910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:28.671439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:29.297581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:29.312017 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e7928a58-e105-4b98-9b77-9fdb2b8e7b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.662414 Feb 12 21:17:29.314266 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1884/3857] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:28 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:29.562949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:29.563656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:29.574800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:29.575269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:29.576087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:29.576575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:29.931428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:29.944583 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b4b156c-c93e-4dee-a07e-2f02f1f1222d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.383024 Feb 12 21:17:29.946266 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1974/3858] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:29 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:29.989406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9ee63153-437c-4799-95d6-412db778f558 req-5a5147d4-4dc1-4ecf-9101-951324d10944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43260354-ea4d-4384-9956-3ded0eb6b91c", "name": "network-vif-plugged", "status": "completed", "tag": "2cf67411-9b4d-404c-9292-87f1a03fd2b1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:29.991186 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:29.991186 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:30.011819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9ee63153-437c-4799-95d6-412db778f558 req-5a5147d4-4dc1-4ecf-9101-951324d10944 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:30.012294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9ee63153-437c-4799-95d6-412db778f558 req-5a5147d4-4dc1-4ecf-9101-951324d10944 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:30.046012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9ee63153-437c-4799-95d6-412db778f558 req-5a5147d4-4dc1-4ecf-9101-951324d10944 service nova] Creating event network-vif-plugged:2cf67411-9b4d-404c-9292-87f1a03fd2b1 for instance 43260354-ea4d-4384-9956-3ded0eb6b91c on nch1-master-1 Feb 12 21:17:30.052753 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9ee63153-437c-4799-95d6-412db778f558 req-5a5147d4-4dc1-4ecf-9101-951324d10944 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067417 Feb 12 21:17:30.055667 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1885/3859] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:30.330669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:30.331647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:30.346589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:30.347059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:30.353149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:30.355877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:30.690231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:30.705035 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-69d7e1ac-9536-4e1f-999f-2c9df61d9f1a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.378106 Feb 12 21:17:30.708382 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1975/3860] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:30 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:30.966214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:30.967348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:30.980083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:30.981721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:30.983988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:30.985957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:31.438359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:31.450747 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60523cf8-b9d4-40b1-b8ca-4a47dddc56c2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.490007 Feb 12 21:17:31.451760 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1886/3861] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:30 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:31.725634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:31.727516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:31.738366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:31.742418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:31.743519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:31.744168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:32.025635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:32.033274 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-32b2d54d-f2c5-43b9-b067-1dbff25f75c3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.312943 Feb 12 21:17:32.036066 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1887/3862] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:31 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:32.311278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-769254877", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": "none"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:32.401975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:17:32.402502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:17:32.403312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:17:32.403787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:17:32.404296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:32.422667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:32.423829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:32.424968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:32.426055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:32.452332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Getting quotas for project d6281d1c3f6741828c12de21ad0cf52a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:32.459295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Getting quotas for user f076063f926f48028edb9ec8e61acdf9 and project d6281d1c3f6741828c12de21ad0cf52a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:32.478872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:17:32.482058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:17:32.501393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-566cce2e-ce2d-4cae-b396-c33ed3c44e62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'create', calling method: .version_select at 0x7fa8fdff8ee0>, body: {"keypair": {"name": "tempest-keypair-1794518578"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:32.538097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-566cce2e-ce2d-4cae-b396-c33ed3c44e62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:32.561704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-566cce2e-ce2d-4cae-b396-c33ed3c44e62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:32.691120 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3debbc69-4999-4d66-b5a0-0a478baf08fb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.061905 Feb 12 21:17:32.698306 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1976/3863] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:17:32.703038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:32.703575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:32.718668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:32.722877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:32.724634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:32.725086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:33.138194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-566cce2e-ce2d-4cae-b396-c33ed3c44e62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:33.157076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-566cce2e-ce2d-4cae-b396-c33ed3c44e62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:33.174950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:33.185749 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3f91782f-4063-4927-a104-1768f22b5ed6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.486287 Feb 12 21:17:33.190013 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1977/3864] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:32 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:33.197056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aecf802a-2c65-467a-982f-8a4d9dee4e0c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:33.197972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aecf802a-2c65-467a-982f-8a4d9dee4e0c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:33.227590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-566cce2e-ce2d-4cae-b396-c33ed3c44e62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.190176 Feb 12 21:17:33.228539 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1888/3865] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:17:32 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:33.243421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:33.248349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:33.264016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:33.266558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:33.267643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:33.269869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:33.396241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aecf802a-2c65-467a-982f-8a4d9dee4e0c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:33.408721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aecf802a-2c65-467a-982f-8a4d9dee4e0c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:33.413160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aecf802a-2c65-467a-982f-8a4d9dee4e0c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:33.416140 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aecf802a-2c65-467a-982f-8a4d9dee4e0c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1" status: 200 len: 1277 microversion: 2.47 time: 0.224675 Feb 12 21:17:33.430621 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1978/3866] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:33 2022] GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:33.699160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:33.706850 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f60b2b4-a5e0-4b45-b971-dcc3d3b3d7ca tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.476530 Feb 12 21:17:33.707632 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1889/3867] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:33 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:33.868565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1418725304", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": "none"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:34.025862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:17:34.026295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:17:34.026770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:17:34.027180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:17:34.027592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:34.064694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:34.065443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:34.073641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:34.079074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:34.106915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Getting quotas for project d6281d1c3f6741828c12de21ad0cf52a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:34.113396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Getting quotas for user f076063f926f48028edb9ec8e61acdf9 and project d6281d1c3f6741828c12de21ad0cf52a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:34.131831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:17:34.135570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:17:34.210616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:34.211677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:34.218913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:34.219407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:34.221299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:34.222284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:34.407885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:34.419022 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6c46b9cc-6fa8-4c82-8aab-de71e3ddc77e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1505 microversion: 2.1 time: 0.211288 Feb 12 21:17:34.430325 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1890/3868] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:34 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:34.491287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a7cfce7-9e1a-4ccc-b386-1bc2f652ea1b tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.626908 Feb 12 21:17:34.500551 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1979/3869] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:17:34.508499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c58fbc14-5b61-4de8-8877-eb46e9250058 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:34.509894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c58fbc14-5b61-4de8-8877-eb46e9250058 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:34.672714 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c58fbc14-5b61-4de8-8877-eb46e9250058 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "PUT /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 992 microversion: 2.47 time: 0.168961 Feb 12 21:17:34.672714 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1891/3870] 10.222.0.31 () {62 vars in 1296 bytes} [Sat Feb 12 21:17:34 2022] PUT /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 992 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:17:34.687031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ebe9e504-a06e-442b-85ce-522e4c91ce29 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:34.688328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ebe9e504-a06e-442b-85ce-522e4c91ce29 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:34.724844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:34.725707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:34.754482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:34.764413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:34.764413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:34.764413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:34.925784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ebe9e504-a06e-442b-85ce-522e4c91ce29 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:34.934708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ebe9e504-a06e-442b-85ce-522e4c91ce29 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:34.944412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ebe9e504-a06e-442b-85ce-522e4c91ce29 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:34.950425 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ebe9e504-a06e-442b-85ce-522e4c91ce29 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1278 microversion: 2.47 time: 0.265557 Feb 12 21:17:34.974463 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1980/3871] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:34 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1278 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:35.204116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:35.214632 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b76edf3b-8439-4562-942e-2a80193164b6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.493551 Feb 12 21:17:35.216249 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1892/3872] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:34 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:35.436812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:35.438890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:35.465955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:35.466741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:35.469404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:35.471192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:35.973100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2e7ecce-67fe-4307-8abb-f3e8b12861b3 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:35.973748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2e7ecce-67fe-4307-8abb-f3e8b12861b3 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:36.047003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:36.056829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-173ef5e4-af52-4dbe-b1de-ec9d84104de5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1485 microversion: 2.1 time: 0.623400 Feb 12 21:17:36.065236 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1981/3873] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:35 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1485 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:36.234673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:36.235603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:36.243820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:36.252069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:36.256304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:36.256904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:36.343794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2e7ecce-67fe-4307-8abb-f3e8b12861b3 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:36.353378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2e7ecce-67fe-4307-8abb-f3e8b12861b3 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:36.359485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2e7ecce-67fe-4307-8abb-f3e8b12861b3 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:36.363998 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2e7ecce-67fe-4307-8abb-f3e8b12861b3 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1278 microversion: 2.47 time: 0.395744 Feb 12 21:17:36.365788 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1893/3874] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:35 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1278 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:36.551287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-140219373", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:36.737269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] validate_networks() for [('79e30242-36dd-47be-b9fc-d5fa9a5cbbe7', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:17:36.985639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:36.995672 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8f9daa12-081c-40cc-9b0f-43c85c965077 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.765974 Feb 12 21:17:37.015576 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1982/3875] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:36 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:37.383554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:37.384383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:37.409080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:37.411242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:37.417602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:37.421507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:37.676085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:37.676085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:37.676085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:37.676085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cfaea401-5aec-477f-b5b1-7040d4d41925 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1330 microversion: 2.47 time: 0.208500 Feb 12 21:17:37.676085 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1983/3876] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:37 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1330 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:37.822121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:17:37.822629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:17:37.823753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:17:37.825566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:17:37.826010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:37.854466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:37.855022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:37.855742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:37.856184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:37.889821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Getting quotas for project 036d2491a97d486eb196e0cdafa05500. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:37.895479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Getting quotas for user 29b2541501314a6991b5b4e81289c117 and project 036d2491a97d486eb196e0cdafa05500. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:37.910447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:17:37.913065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:17:38.024762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:38.025408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:38.050626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:38.051087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:38.051903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:38.077824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:38.084984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78788b58-b3d3-4bfa-bb4c-5bb4c1d34d5d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.540129 Feb 12 21:17:38.091490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1894/3877] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:17:38.114280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-feccad72-c5c9-427e-bd8d-63d1980b1eda tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:38.116734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-feccad72-c5c9-427e-bd8d-63d1980b1eda tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:38.336392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-feccad72-c5c9-427e-bd8d-63d1980b1eda tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:38.346601 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-feccad72-c5c9-427e-bd8d-63d1980b1eda tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1213 microversion: 2.1 time: 0.253428 Feb 12 21:17:38.371951 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1895/3878] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:38 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1213 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:38.491367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:38.503498 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f8c4296d-711d-4452-bd5f-d76518cccf0d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.484555 Feb 12 21:17:38.514430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1984/3879] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:38 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:38.635456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:38.636102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:38.663545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:38.665740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:38.668410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:38.672546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:38.851862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:38.861537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:38.868916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:38.876657 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5d33659-8391-4afc-b046-d7deaffc0833 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1336 microversion: 2.47 time: 0.265882 Feb 12 21:17:38.877680 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1896/3880] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:38 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1336 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:39.368326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:39.369637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:39.422600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:39.427004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:39.433885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:39.439104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:39.526301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:39.527024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:39.576702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:39.577308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:39.579435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:39.579894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:39.689124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:39.713629 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f9e888c-c934-4924-bea7-0a1859c65cd4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1217 microversion: 2.1 time: 0.353288 Feb 12 21:17:39.718509 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1985/3881] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:39 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1217 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:39.837018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-835619124", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d2fb25f-a576-44b7-8aec-e44f4519d495"}], "security_groups": [{"name": "tempest-securitygroup--500234459"}], "key_name": "tempest-keypair-1794518578", "user_data": "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:39.933393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:39.941297 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-835499c8-d715-45db-882d-58b49a6e93d5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.424056 Feb 12 21:17:39.941938 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1897/3882] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:39 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:39.973739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:39.978329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:40.004866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.005476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.006333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.006695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.057439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] validate_networks() for [('2d2fb25f-a576-44b7-8aec-e44f4519d495', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:17:40.129211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:40.142760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:40.144603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:40.146391 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99c26c08-e85c-40ae-9926-f5589024e384 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1336 microversion: 2.47 time: 0.187992 Feb 12 21:17:40.159157 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1898/3883] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:39 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1336 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:40.596570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:17:40.597200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:17:40.597856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:17:40.598449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:17:40.598872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:40.612923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.617272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.618229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.618733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.657390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:17:40.665003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:17:40.683489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:17:40.690483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:17:40.735227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:40.739970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:40.772387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.773934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.776759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.779198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.854013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:40.862363 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64f44797-01cd-495f-ba8e-6331203ea3ea tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1265 microversion: 2.1 time: 0.131794 Feb 12 21:17:40.872986 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1899/3884] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:40 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:40.890672 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b66b336-41a9-4386-981f-31bc57a97764 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.059124 Feb 12 21:17:40.891807 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1986/3885] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:17:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:17:40.906008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5d94652-6be8-45eb-8057-9d99a74cdf83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:40.907652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5d94652-6be8-45eb-8057-9d99a74cdf83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:40.959350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:40.961744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:40.971350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.972787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.974463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:40.979291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:40.988465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5d94652-6be8-45eb-8057-9d99a74cdf83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:40.997528 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5d94652-6be8-45eb-8057-9d99a74cdf83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1238 microversion: 2.1 time: 0.095086 Feb 12 21:17:41.008320 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1900/3886] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:40 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:41.166224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:41.166856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:41.177099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.178442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.179862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.180358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.309244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:41.350826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:41.360891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:41.366184 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db477029-cef8-4704-a9e5-d7e268d10e12 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1357 microversion: 2.47 time: 0.201501 Feb 12 21:17:41.372407 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1901/3887] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:41 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:17:41.388147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:41.390526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:41.397869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.405231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.405231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.405231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.501955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:41.511326 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-057e3d1c-c109-4f2d-8633-a26eb4461204 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.555861 Feb 12 21:17:41.531493 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1987/3888] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:40 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:41.564358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:17:41.564798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:17:41.572675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:17:41.572675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:17:41.572675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:17:41.811815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:41.870214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.870780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.877672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.878229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.885811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:41.887107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:41.907924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.909024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.914123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.914809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.952192 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1114e535-9185-4106-95fa-cb60eb1b185d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "POST /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c/action" status: 202 len: 1079 microversion: 2.47 time: 0.570058 Feb 12 21:17:41.953901 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1902/3889] 10.222.0.31 () {62 vars in 1318 bytes} [Sat Feb 12 21:17:41 2022] POST /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c/action => generated 1079 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Feb 12 21:17:41.970237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:41.971019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:41.982286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.982991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:41.984269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:41.985277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:42.206602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:42.221728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:42.231902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:42.232561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:42.242215 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-601bdfa2-6f5c-4e6e-a8df-dfc84c0cbcaa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.275527 Feb 12 21:17:42.246727 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-226eaec8-9e2c-411f-97ae-207244ee50fe tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1271 microversion: 2.1 time: 0.370117 Feb 12 21:17:42.248852 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1903/3890] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:41 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:17:42.258341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4218f621-6043-4123-a1d4-ce637c2ac91f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:42.258566 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1988/3891] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:41 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:42.259443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4218f621-6043-4123-a1d4-ce637c2ac91f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:42.319468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4218f621-6043-4123-a1d4-ce637c2ac91f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:42.328264 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4218f621-6043-4123-a1d4-ce637c2ac91f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1238 microversion: 2.1 time: 0.075578 Feb 12 21:17:42.341933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1904/3892] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:42 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:42.541835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:42.542568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:42.562400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:42.564071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:42.566692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:42.574449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:42.923506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:42.934587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8bacd2c0-ef6e-4ae3-8e40-a1a45f379661 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.398294 Feb 12 21:17:42.951779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1989/3893] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:42 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:43.266299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:43.266911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:43.267446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:43.268800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:43.278468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.278977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.279819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.280260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.284314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.285030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.286071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.288610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.406287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:43.432214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:43.440913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:43.446309 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49d0bb11-72b2-4b41-b355-4eac4654562a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.183819 Feb 12 21:17:43.462585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1990/3894] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:43 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:17:43.478246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:43.479515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:43.487757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.488546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.489629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.490320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.610285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:43.610285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff344efa-b3e0-4dcd-a3e8-5387d10eeeba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.333405 Feb 12 21:17:43.610285 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1905/3895] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:43 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:43.644020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:43.667775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9a78be0-2c15-4462-ab9b-78b8da0a553d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1290 microversion: 2.1 time: 0.202469 Feb 12 21:17:43.670024 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1991/3896] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:43 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1290 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:43.951906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:43.952528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:43.958668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.959128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:43.965451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:43.965451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:44.408659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:44.417813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54430a6e-d64a-44e0-8100-9cde831ca9ee tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.469524 Feb 12 21:17:44.432094 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1906/3897] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:43 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:44.470196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:44.471741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:44.486912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:44.487581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:44.489293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:44.490030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:44.626981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:44.628086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:44.655752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:44.657963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:44.661544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:44.662255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:45.001573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:45.019669 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-26083685-7eb2-4247-bd68-8fba9025da3b tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.396645 Feb 12 21:17:45.024490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1907/3898] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:44 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:45.028923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:45.037500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:45.038401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:45.041881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:45.046855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:45.051053 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d19f788a-f156-433f-bab2-d22088cf228c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.584824 Feb 12 21:17:45.052573 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1992/3899] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:44 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:45.070295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:45.070538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:45.071442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ab5c56ee-a955-4fbd-a68a-e5baeb03a2a1 req-97266ee3-17d1-4211-9106-9b7311521c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c488ea90-1cee-4992-9fa0-7290df83f23d", "tag": "98cca7e1-4777-4b0c-ad16-c0516fe1d47e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:45.071734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:45.072189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:45.073923 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:45.073923 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:45.084305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ab5c56ee-a955-4fbd-a68a-e5baeb03a2a1 req-97266ee3-17d1-4211-9106-9b7311521c3f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:45.085567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ab5c56ee-a955-4fbd-a68a-e5baeb03a2a1 req-97266ee3-17d1-4211-9106-9b7311521c3f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:45.099112 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ab5c56ee-a955-4fbd-a68a-e5baeb03a2a1 req-97266ee3-17d1-4211-9106-9b7311521c3f service nova] Creating event network-changed:98cca7e1-4777-4b0c-ad16-c0516fe1d47e for instance c488ea90-1cee-4992-9fa0-7290df83f23d on nch1-master-1 Feb 12 21:17:45.106877 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ab5c56ee-a955-4fbd-a68a-e5baeb03a2a1 req-97266ee3-17d1-4211-9106-9b7311521c3f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051887 Feb 12 21:17:45.127676 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1993/3900] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:45.223063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:45.234286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64503b3a-cf9e-4844-a77e-f9edf83eeb1b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1296 microversion: 2.1 time: 0.206107 Feb 12 21:17:45.236338 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1908/3901] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:45 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1296 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:45.439071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:45.439971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:45.453519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:45.453988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:45.454822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:45.455267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:45.782702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:45.813054 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-665c9c9d-e929-4ba5-8a3b-31f6d32c1ef3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.377871 Feb 12 21:17:45.816377 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1994/3902] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:45 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:46.043388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:46.044939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:46.062860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.062860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.062860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.064228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.075608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:46.076738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:46.096234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.099813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.105628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.105932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.310109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:46.318921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:46.325897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:46.333521 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7375443-93ff-4312-b86e-56de2b35299a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.263780 Feb 12 21:17:46.337428 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1995/3903] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:46 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:46.343890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:46.354202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:46.374062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.381421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.383230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.388189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.645879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:46.657771 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc92b9bc-c0c7-4daa-b381-3fe2bcf93714 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.318988 Feb 12 21:17:46.658961 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1996/3904] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:46 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:46.784755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:46.799888 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-340a6926-35e9-470e-9cc8-3d756676c32c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.762945 Feb 12 21:17:46.809304 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1909/3905] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:46 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:46.834473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:46.836258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:46.844672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.845392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:46.846443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:46.847113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:47.076902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:47.088651 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd212da7-9cce-49da-a874-a8e279ebf668 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.260152 Feb 12 21:17:47.105721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1997/3906] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:46 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:47.356435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:47.358118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:47.380107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:47.381158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:47.383586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:47.384624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:47.590645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:47.600287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:47.607551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:47.609307 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5ec1ba8-44df-4b60-8ded-99bf58b3d524 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.258288 Feb 12 21:17:47.622341 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1910/3907] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:47 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:47.678034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:47.681123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:47.697616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:47.698603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:47.702216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:47.702880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:47.815719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:47.816603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:47.827735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:47.828196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:47.829009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:47.829474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:48.207550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:48.248507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c393180-5b9a-4207-998f-f8739b3dcf55 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.573464 Feb 12 21:17:48.251732 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1998/3908] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:47 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:48.270272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:48.271394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:48.281640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:48.282653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:48.290536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:48.290536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:48.399017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:48.416528 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-466012e4-4bb6-4ce9-9dca-f073179bd9ef tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.597447 Feb 12 21:17:48.417864 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1911/3909] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:47 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:48.884815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-eb147570-3680-4d33-b831-8388f380bfbf req-102097a3-ca36-4e6f-b795-222000b7d805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:48.887048 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:48.887048 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:48.908001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-eb147570-3680-4d33-b831-8388f380bfbf req-102097a3-ca36-4e6f-b795-222000b7d805 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:48.908559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-eb147570-3680-4d33-b831-8388f380bfbf req-102097a3-ca36-4e6f-b795-222000b7d805 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:48.932102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:48.935949 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-eb147570-3680-4d33-b831-8388f380bfbf req-102097a3-ca36-4e6f-b795-222000b7d805 service nova] Creating event network-changed:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:17:48.942044 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-eb147570-3680-4d33-b831-8388f380bfbf req-102097a3-ca36-4e6f-b795-222000b7d805 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.518339 Feb 12 21:17:48.943896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-40514cef-493c-4546-b935-5309167260fb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.689556 Feb 12 21:17:48.948611 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 1999/3910] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:48 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:48.953757 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1912/3911] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:48.959422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:48.960179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:48.979339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:48.980071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:48.983213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:48.984418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:49.101586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:49.138186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:49.140034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:49.141226 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84560027-d705-40a0-a058-5fb4a67befa7 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.190626 Feb 12 21:17:49.142287 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2000/3912] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:48 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:49.267490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:49.268178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:49.278494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:49.279235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:49.280236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:49.280844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:49.434889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:49.435590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:49.450680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:49.454729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:49.457145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:49.459801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:49.641437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:49.655903 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2cf933eb-4ffc-48d9-b50c-b2751a9cce38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.391681 Feb 12 21:17:49.660182 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1913/3913] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:49 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:49.811127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:49.823335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84280506-608b-481c-a3cd-f1eefbb48d78 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.393098 Feb 12 21:17:49.833516 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2001/3914] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:49 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:49.963640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:49.964197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:50.061551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.061551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.061551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.061551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.166288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:50.166917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:50.208629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.211244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.212827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.217177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.226765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:50.257878 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-755280ed-9d87-4040-a396-e94e96919ea7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.301539 Feb 12 21:17:50.259207 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1914/3915] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:49 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:50.323886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:50.333296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:50.336132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:50.337604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d4616d7-f65e-4aed-9a18-7c51242909af tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.176274 Feb 12 21:17:50.350585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2002/3916] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:50 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:50.674128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:50.674861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:50.685382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.687241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.690070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.691787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.841228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:50.841875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:50.849001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.849499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.850373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:50.851398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:50.905745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:50.914521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9d98f03a-3e48-4644-931c-4a6228906c62 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.244608 Feb 12 21:17:50.924841 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1915/3917] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:50 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:51.120138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:51.128541 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6433cc0-dd5b-4e03-b64c-05da9ade3f21 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.289254 Feb 12 21:17:51.129166 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2003/3918] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:50 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:51.276807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:51.277583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:51.283825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:51.284291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:51.285081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:51.285728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:51.357174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:51.364335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:51.370221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:51.370902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:51.371884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:51.373674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:51.476701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:51.486015 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dac97bef-e8f2-4706-b8bd-2afef532959b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1524 microversion: 2.1 time: 0.213953 Feb 12 21:17:51.487478 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1916/3919] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:51 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1524 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:51.538780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:51.547039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:51.548742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:51.549964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f6c6bc7-c321-457e-8c62-ed172f49ea7e tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.197572 Feb 12 21:17:51.561610 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2004/3920] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:51 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:51.932354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:51.932977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:51.941472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:51.942440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:51.944215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:51.946424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.272140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:52.284568 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aaae75f7-1078-49e4-a789-34a3f0333c5e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.356980 Feb 12 21:17:52.285624 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1917/3921] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:51 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:52.306419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:52.309277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:52.318320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.318776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.325100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.329545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.363591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ac2f0957-3de0-4816-bc1a-1f288ec4db8a req-7e033613-2ba2-4669-8dd8-73a863e99583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c488ea90-1cee-4992-9fa0-7290df83f23d", "name": "network-vif-plugged", "status": "completed", "tag": "98cca7e1-4777-4b0c-ad16-c0516fe1d47e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:52.365978 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:52.365978 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:52.380622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac2f0957-3de0-4816-bc1a-1f288ec4db8a req-7e033613-2ba2-4669-8dd8-73a863e99583 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.381009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac2f0957-3de0-4816-bc1a-1f288ec4db8a req-7e033613-2ba2-4669-8dd8-73a863e99583 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.394922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ac2f0957-3de0-4816-bc1a-1f288ec4db8a req-7e033613-2ba2-4669-8dd8-73a863e99583 service nova] Creating event network-vif-plugged:98cca7e1-4777-4b0c-ad16-c0516fe1d47e for instance c488ea90-1cee-4992-9fa0-7290df83f23d on nch1-master-1 Feb 12 21:17:52.400407 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ac2f0957-3de0-4816-bc1a-1f288ec4db8a req-7e033613-2ba2-4669-8dd8-73a863e99583 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383075 Feb 12 21:17:52.401482 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2005/3922] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:17:52.513622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:52.516349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:52.529042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.532983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.534739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.538822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.672047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:52.685198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe826413-028d-4946-90ce-8f8b4b38320a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.386354 Feb 12 21:17:52.696288 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1918/3923] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:52 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:52.705686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:52.706643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:52.715338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.716467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.717554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:52.718243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:52.804689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:52.818645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:52.824371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:52.827350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e56658db-6102-4a1c-a54f-81d541663d79 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.129415 Feb 12 21:17:52.827931 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1919/3924] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:52 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:52.844730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:52.852990 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c395008-9b6e-4824-a2ac-577ea08bb3b2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1506 microversion: 2.1 time: 0.352227 Feb 12 21:17:52.853615 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2006/3925] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:52 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:53.301494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:53.302140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:53.308891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.309348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.310211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.310615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.401958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:53.406836 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:53.406836 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:53.407894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.408659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Searching by: {'deleted': False, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:17:53.415334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.415883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.416704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.417524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.442900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:17:53.467245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.471929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fab34f29-b85e-4244-bee8-f65cf1759761 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.173789 Feb 12 21:17:53.472602 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1920/3926] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:53.482528 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4214c133-9ee8-4b67-9651-d8a222dccdf1 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.085358 Feb 12 21:17:53.483132 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2007/3927] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/servers => generated 340 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:17:53.501687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:53.504966 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:53.504966 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:53.506065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.507065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Searching by: {'deleted': False, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:17:53.513139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.513700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.518599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.518599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.542035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:17:53.577158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.583173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.583627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.703731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:53.704779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:53.711567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.711976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.712763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.713197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.726220 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9b3e4ac-c526-4f24-a43a-a773b960b018 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.229540 Feb 12 21:17:53.728963 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1921/3928] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:53.744074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff5d000a-8372-4c7a-8adc-8e427c4ab06e tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:53.753633 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff5d000a-8372-4c7a-8adc-8e427c4ab06e tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012927 Feb 12 21:17:53.756082 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1922/3929] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:17:53.846434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:53.847259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:53.854890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.857051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.867006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:53.867006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:53.964558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.982321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.984812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:53.987373 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f95fcb44-b02d-498b-9060-009335e76052 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.144388 Feb 12 21:17:53.989449 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1923/3930] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:17:54.005022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:54.009564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:54.016402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.018578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.019930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.021029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.048257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:54.058043 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-197de373-b427-40b5-9e83-0626e2b57952 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1313 microversion: 2.1 time: 0.359157 Feb 12 21:17:54.070874 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2008/3931] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:54.176622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:54.181863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:54.184692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.185146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.188407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.191696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.224559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:54.248923 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9514569d-aaf6-424e-be7d-a34daa833fd1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1506 microversion: 2.1 time: 0.247630 Feb 12 21:17:54.249120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:17:54.249870 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1924/3932] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:53 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:54.414336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-11eb5bdb-b3e9-40a1-b1a0-80531cbd4c31 req-f8b48b4e-ace2-44f1-b737-6bf1ebf4337f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43260354-ea4d-4384-9956-3ded0eb6b91c", "name": "network-vif-unplugged", "status": "completed", "tag": "2cf67411-9b4d-404c-9292-87f1a03fd2b1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:54.415798 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:54.415798 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:17:54.423518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-11eb5bdb-b3e9-40a1-b1a0-80531cbd4c31 req-f8b48b4e-ace2-44f1-b737-6bf1ebf4337f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.423973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-11eb5bdb-b3e9-40a1-b1a0-80531cbd4c31 req-f8b48b4e-ace2-44f1-b737-6bf1ebf4337f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.435860 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-11eb5bdb-b3e9-40a1-b1a0-80531cbd4c31 req-f8b48b4e-ace2-44f1-b737-6bf1ebf4337f service nova] Creating event network-vif-unplugged:2cf67411-9b4d-404c-9292-87f1a03fd2b1 for instance 43260354-ea4d-4384-9956-3ded0eb6b91c on nch1-master-1 Feb 12 21:17:54.440980 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-11eb5bdb-b3e9-40a1-b1a0-80531cbd4c31 req-f8b48b4e-ace2-44f1-b737-6bf1ebf4337f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030180 Feb 12 21:17:54.441649 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1925/3933] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:54.488691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:54.489433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:54.496523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.496977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.498666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.498666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.510185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be1b6001-2810-4424-aaa0-b55d4bca878a tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "DELETE /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 204 len: 0 microversion: 2.1 time: 0.339453 Feb 12 21:17:54.511038 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2009/3934] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:17:54 2022] DELETE /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:17:54.520423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:54.521132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:54.527653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.528141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.528928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:54.529425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:54.685344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:54.693465 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-134eb65f-d569-4253-a64e-2d1a3486593d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.208638 Feb 12 21:17:54.697675 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1926/3935] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:54 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:54.729081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:54.738238 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d94190b-cc1e-49ab-b1cf-f5394b304a54 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1714 microversion: 2.1 time: 0.221860 Feb 12 21:17:54.740881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2010/3936] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:54 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1714 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:55.007756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:55.008425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:55.014784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.015306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.016124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.016560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.078436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:55.079695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:55.084396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:55.089728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.095529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.095529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.095529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.101583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:55.105887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:55.108246 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5f3db5e-cec0-4333-965a-4653f7d6e236 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.104729 Feb 12 21:17:55.109434 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1927/3937] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:55 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:55.256166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:55.257459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:55.267251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.270751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.271738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.273185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.292565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:55.304742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-489dc9b4-7087-4780-a430-bc3d9ed18426 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1498 microversion: 2.1 time: 0.229722 Feb 12 21:17:55.317790 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2011/3938] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:55 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:55.325244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:55.326297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:55.336215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.336960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.338854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.339553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.386958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lazy-loading 'flavor' on Instance uuid c488ea90-1cee-4992-9fa0-7290df83f23d {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:17:55.469228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:55.480512 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e3b9795d-efc3-4b8e-8826-a045b6feeb42 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 200 len: 1509 microversion: 2.1 time: 0.228012 Feb 12 21:17:55.513064 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1928/3939] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:55 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:55.527573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:55.528437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:55.536094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.536849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.538624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.539817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.607487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:17:55.623805 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.compute.api [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Working on deleting snapshot 82a942f4-531e-47a0-935a-45bdf148d1be from shelved instance... Feb 12 21:17:55.686940 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc741fef-61fe-4fe4-b3c4-e731f270e464 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "POST /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d/action" status: 200 len: 32 microversion: 2.1 time: 0.367043 Feb 12 21:17:55.689518 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2012/3940] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:17:55 2022] POST /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d/action => generated 32 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:17:55.708126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:55.708999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:55.723225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.723694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:55.724580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:55.725221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.108992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:56.121604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7efd8c5c-f52d-4841-9522-4b859dd922b0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.426857 Feb 12 21:17:56.122790 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2013/3941] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:55 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:56.138359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:56.139165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:56.145675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.146675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.148050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.148815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.488534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:56.492038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-724c5606-24ad-41ce-a667-bc361d37c503 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.367233 Feb 12 21:17:56.517583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2014/3942] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:56 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:56.519481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:56.520062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:56.537038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.537540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.538389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.538825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.811087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:56.821447 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d10b27f5-4295-4a44-8d37-0e36823d7523 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1714 microversion: 2.1 time: 0.305525 Feb 12 21:17:56.826779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2015/3943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:56 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1714 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:56.843875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:56.844502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:56.853292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.853991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.854953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.855551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.930964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:56.939739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:56.941634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:56.943742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1571899e-f5df-4715-ab29-9af8074bc3ad tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.105681 Feb 12 21:17:56.944424 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2016/3944] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:56 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:56.953283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b2cfa249-7d30-405a-888a-0ec7c12c3b5e req-9c4a4f91-f254-4354-9a9b-94d7bdfb71b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-plugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:56.954918 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:56.954918 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:56.973156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b2cfa249-7d30-405a-888a-0ec7c12c3b5e req-9c4a4f91-f254-4354-9a9b-94d7bdfb71b8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:56.973908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b2cfa249-7d30-405a-888a-0ec7c12c3b5e req-9c4a4f91-f254-4354-9a9b-94d7bdfb71b8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:56.989564 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b2cfa249-7d30-405a-888a-0ec7c12c3b5e req-9c4a4f91-f254-4354-9a9b-94d7bdfb71b8 service nova] Creating event network-vif-plugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:17:56.997724 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b2cfa249-7d30-405a-888a-0ec7c12c3b5e req-9c4a4f91-f254-4354-9a9b-94d7bdfb71b8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051734 Feb 12 21:17:56.998659 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2017/3945] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:57.140294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:57.141006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:57.151582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:57.152617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:57.153797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:57.154591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:57.376171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:57.400287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a33b85ec-d367-4650-b369-3f20849b4030 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.264625 Feb 12 21:17:57.410938 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2018/3946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:57 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:57.493518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Doing local delete in cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=141726) _delete /opt/stack/nova/nova/compute/api.py:2459}} Feb 12 21:17:57.494617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:57.495312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:57.495856 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.compute.api [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Feb 12 21:17:57.500018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] deallocate_for_instance() {{(pid=141726) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1790}} Feb 12 21:17:57.508911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:57.509571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:57.524992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:57.526583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:57.529203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:57.531217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.296281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:58.309916 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cae284ff-cb2d-4d59-8399-431bc3617ec1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1363 microversion: 2.1 time: 0.803326 Feb 12 21:17:58.309916 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2019/3947] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:57 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1363 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:17:58.316064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7348febf-34e1-45eb-bac1-817a293ae519 req-04ef47d1-7e67-41da-a76f-e035321c8785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bcdf4e-680f-4f72-a170-6bc26614f067", "name": "network-vif-deleted", "tag": "f91629a6-c2b4-4bc9-b4ab-82ef49b98450"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:17:58.317978 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:17:58.317978 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:17:58.334083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7348febf-34e1-45eb-bac1-817a293ae519 req-04ef47d1-7e67-41da-a76f-e035321c8785 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.334538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7348febf-34e1-45eb-bac1-817a293ae519 req-04ef47d1-7e67-41da-a76f-e035321c8785 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.348404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7348febf-34e1-45eb-bac1-817a293ae519 req-04ef47d1-7e67-41da-a76f-e035321c8785 service nova] Creating event network-vif-deleted:f91629a6-c2b4-4bc9-b4ab-82ef49b98450 for instance 30bcdf4e-680f-4f72-a170-6bc26614f067 on nch2-master-1 Feb 12 21:17:58.355182 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7348febf-34e1-45eb-bac1-817a293ae519 req-04ef47d1-7e67-41da-a76f-e035321c8785 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043845 Feb 12 21:17:58.356403 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2020/3948] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:58.362064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:58.362849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:58.372183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.372864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.373916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.374518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.419602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.420126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.420657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lazy-loading 'fault' on Instance uuid 30bcdf4e-680f-4f72-a170-6bc26614f067 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:17:58.480196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b20374617ab42cda524d241b44b43d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49299cdcee8d47d1b73297ccf7e09ef6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:58.491909 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2172c18-ef43-49e5-b2e1-70d9ff9e81f0 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 200 len: 1367 microversion: 2.1 time: 0.134052 Feb 12 21:17:58.494576 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2021/3949] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:58 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 1367 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:58.500138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:58.500935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:58.509864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.515212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.515212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.515212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.622185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:58.634147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:58.636115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:58.637391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-809e563c-2913-41ab-84c8-96016c4dc11f tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.141001 Feb 12 21:17:58.638342 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2022/3950] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:58 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:17:58.669512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:58.670172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:58.686312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.690426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.691595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:58.692063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:58.709243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Updating instance_info_cache with network_info: [] {{(pid=141726) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:17:58.957680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:58.966261 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a489fdf-acc9-44cf-ab75-8b1b854d4e6f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.310845 Feb 12 21:17:58.967090 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2023/3951] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:58 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:59.326776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.327607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:59.334002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.334823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.335993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.336437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.497299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:17:59.506437 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-afad2d92-204c-4731-bbc3-38daf402803c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1550 microversion: 2.1 time: 0.184926 Feb 12 21:17:59.507154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2024/3952] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:59 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:17:59.511833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.512440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] [instance: 30bcdf4e-680f-4f72-a170-6bc26614f067] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:59.519211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.519680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.520489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.520991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.538353 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] HTTP exception thrown: Instance 30bcdf4e-680f-4f72-a170-6bc26614f067 could not be found. Feb 12 21:17:59.538353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Returning 404 to user: Instance 30bcdf4e-680f-4f72-a170-6bc26614f067 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:59.538353 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a933b3c0-b50b-412e-8e90-c8f97bc65f18 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067" status: 404 len: 111 microversion: 2.1 time: 0.028993 Feb 12 21:17:59.538353 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2025/3953] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:59 2022] GET /compute/v2.1/servers/30bcdf4e-680f-4f72-a170-6bc26614f067 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:17:59.542795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.543287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:59.549074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.549572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.550363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.550804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.647455 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eda0183f-d597-4b53-8c72-5ab1caece0a1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108084 Feb 12 21:17:59.648902 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2026/3954] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:17:59 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:17:59.655946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-582b4525-988b-4020-84b4-d881105f9e67 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] Calling method '.version_select at 0x7fa9040d3940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.725837 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28ee504e-3f64-4dc5-99e2-69766402bca7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 204 len: 0 microversion: 2.1 time: 4.210212 Feb 12 21:17:59.726735 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1929/3955] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:17:55 2022] DELETE /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 0 bytes in 4212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:17:59.732084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.732807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:59.738980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.739430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.740591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.741929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.757415 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-582b4525-988b-4020-84b4-d881105f9e67 tempest-ServersTestManualDisk-1528850345 tempest-ServersTestManualDisk-1528850345-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614800946" status: 202 len: 0 microversion: 2.1 time: 0.106485 Feb 12 21:17:59.759025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2027/3956] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614800946 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:17:59.764753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.765575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:59.775034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.776270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.781142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.781847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.806027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 43260354-ea4d-4384-9956-3ded0eb6b91c could not be found. Feb 12 21:17:59.806778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 43260354-ea4d-4384-9956-3ded0eb6b91c could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:17:59.807778 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c868cb83-ae5e-46dd-9268-4e99330a9b99 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 404 len: 111 microversion: 2.1 time: 0.047537 Feb 12 21:17:59.808431 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2028/3957] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:59 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:17:59.984949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:17:59.985916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:17:59.993393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.994295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:17:59.995234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:17:59.995857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:00.171090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:00.176620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:00.178197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:00.179419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9d4db79-5b57-42cc-9f18-c214e29e8800 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.451569 Feb 12 21:18:00.194923 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1930/3958] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:17:59 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:00.199965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-219227085", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:00.300412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:18:00.391044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:00.404141 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1c7c8d4-0f88-412b-94a0-20da7fe11134 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.421564 Feb 12 21:18:00.406022 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2029/3959] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:17:59 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:00.448294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-94fd8012-1f1c-4fdb-9aa7-3075a8e68b8e req-0f47ae6f-e565-4ac7-a09c-b8187542b897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43260354-ea4d-4384-9956-3ded0eb6b91c", "name": "network-vif-deleted", "tag": "2cf67411-9b4d-404c-9292-87f1a03fd2b1"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:00.451152 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:00.451152 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:18:00.465934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-94fd8012-1f1c-4fdb-9aa7-3075a8e68b8e req-0f47ae6f-e565-4ac7-a09c-b8187542b897 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:00.469610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-94fd8012-1f1c-4fdb-9aa7-3075a8e68b8e req-0f47ae6f-e565-4ac7-a09c-b8187542b897 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:00.495652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.server_external_events [req-94fd8012-1f1c-4fdb-9aa7-3075a8e68b8e req-0f47ae6f-e565-4ac7-a09c-b8187542b897 service nova] Unable to find a host for instance 43260354-ea4d-4384-9956-3ded0eb6b91c. Dropping event network-vif-deleted {{(pid=141727) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 21:18:00.497129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-94fd8012-1f1c-4fdb-9aa7-3075a8e68b8e req-0f47ae6f-e565-4ac7-a09c-b8187542b897 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053252 Feb 12 21:18:00.498306 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2030/3960] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 12 21:18:01.049941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:01.050447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:01.051710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:01.051710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:01.052091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:01.065671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.066391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.067610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.068355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.088741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:18:01.095326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:18:01.110747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:18:01.114236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:18:01.216776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:01.217423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:01.230724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.240428 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-84107280-6d4c-4e17-bae1-3c3078c89d3c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043103 Feb 12 21:18:01.243457 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1931/3961] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:18:01.244518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.251274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.253983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.254409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2f4693b-3adf-4bb6-9ba1-67cd1ad6d2f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:01.258032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2f4693b-3adf-4bb6-9ba1-67cd1ad6d2f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:01.427237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:01.436412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:01.438210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:01.442364 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df277952-8417-442d-8a19-b104fe672db8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.229822 Feb 12 21:18:01.448348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2f4693b-3adf-4bb6-9ba1-67cd1ad6d2f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:01.453997 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2031/3962] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:01 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:01.461642 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2f4693b-3adf-4bb6-9ba1-67cd1ad6d2f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1214 microversion: 2.1 time: 0.208198 Feb 12 21:18:01.461642 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1932/3963] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:01 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:01.462303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:01.463321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:01.471147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.472046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.473811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.474462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.618615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:01.619472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:01.636691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.638724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.640967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:01.646655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:01.791440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:01.800649 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8dbc3b6c-1ed9-48b4-947b-92db1e895ff8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.344970 Feb 12 21:18:01.803285 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2032/3964] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:01 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:01.952235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:01.966733 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff016e84-6b32-45b2-9d17-b3d9e244a103 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1550 microversion: 2.1 time: 0.352700 Feb 12 21:18:01.969000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1933/3965] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1550 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:01.986511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:01.987434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:01.998861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.001657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.001657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.001657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.361488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:02.372447 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-590a35fc-8a5c-48f5-b50e-3a2816786286 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1550 microversion: 2.1 time: 0.389533 Feb 12 21:18:02.373648 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2033/3966] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1550 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:02.468423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:02.469191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:02.481824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:02.482335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.482584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:02.482777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.483592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.484034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.492591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.499594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.501201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.505567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.653091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:02.664947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:02.666586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:02.679094 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6d5734c-e1b8-4606-b134-d383e9991182 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.218082 Feb 12 21:18:02.689975 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1934/3967] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:02 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:02.698753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b4a6afc9-4264-47e2-9ed1-147ff06df1b7 req-3999d5b9-54fb-4ecd-9ff5-7905fbbe37e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:02.700703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:02.701291 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:02.701291 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:02.723594 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a569318-3e60-45c5-9589-e1a5ee3b4d5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1218 microversion: 2.1 time: 0.237816 Feb 12 21:18:02.731106 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2034/3968] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:02 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1218 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:02.731277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b4a6afc9-4264-47e2-9ed1-147ff06df1b7 req-3999d5b9-54fb-4ecd-9ff5-7905fbbe37e7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.731277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b4a6afc9-4264-47e2-9ed1-147ff06df1b7 req-3999d5b9-54fb-4ecd-9ff5-7905fbbe37e7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.761578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b4a6afc9-4264-47e2-9ed1-147ff06df1b7 req-3999d5b9-54fb-4ecd-9ff5-7905fbbe37e7 service nova] Creating event network-changed:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:18:02.773136 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b4a6afc9-4264-47e2-9ed1-147ff06df1b7 req-3999d5b9-54fb-4ecd-9ff5-7905fbbe37e7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080878 Feb 12 21:18:02.777939 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1935/3969] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:02.818569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:02.819525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:02.832011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.832822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:02.834055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:02.834683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.392186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:03.393479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:03.402155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:03.403113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.404738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:03.405346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.565219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:03.575378 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e676b4df-9c32-4ce9-af23-2106d2dbb919 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.760314 Feb 12 21:18:03.581940 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2035/3970] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:02 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:03.692702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:03.701911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:03.703223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:03.720913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:03.721324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bcd729f3-871f-481a-9add-3e9aa17e303a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1550 microversion: 2.1 time: 0.333337 Feb 12 21:18:03.734057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.734186 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1936/3971] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:03 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1550 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:03.734285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:03.734285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.755067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:03.768851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:03.782318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:03.782876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.786340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:03.786867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:03.993120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:04.006197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:04.007631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:04.015742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:04.018641 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b6047be1-81e5-4432-9fbb-865cc8d305a6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1274 microversion: 2.1 time: 0.278200 Feb 12 21:18:04.021333 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1937/3972] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:03 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:04.030128 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a7c396c-81e6-4d26-aeef-fa819b9ba59d tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.322096 Feb 12 21:18:04.041276 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2036/3973] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:03 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:04.605560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:04.606574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:04.622227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:04.623101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:04.624328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:04.625003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:04.741750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:04.743010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:04.758128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:04.761776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:04.766416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:04.766895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:05.184657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:05.192893 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0459ac94-288c-4415-8587-dede237f965c tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.591290 Feb 12 21:18:05.202832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1938/3974] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:04 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:05.210633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:05.212222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:05.221868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:05.222641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:05.224876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:05.226120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:05.308981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:05.318821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:05.321897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:05.323390 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9065dd7d-154f-43c3-8fce-521b563d2edb tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.119257 Feb 12 21:18:05.331655 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1939/3975] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:05 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:05.339218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:05.342583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:05.343516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:05.351729 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f050335-fe20-48db-b531-6ffb3d717762 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1550 microversion: 2.1 time: 0.613832 Feb 12 21:18:05.352976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:05.353708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:05.354789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:05.355654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:05.362319 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2037/3976] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:04 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1550 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:05.767167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:05.777383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-19c6e142-6338-484c-bfba-de99f32391c8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.442588 Feb 12 21:18:05.787394 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1940/3977] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:05 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:06.214701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:06.215407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:06.227761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.233084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.233084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.233084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.347524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:06.348508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:06.363224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.369438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.369438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.370186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.503441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:06.511715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:06.513522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:06.514847 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2adcd7c3-30f3-4e33-8863-eab66a9148c8 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.172256 Feb 12 21:18:06.515951 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1941/3978] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:06 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:06.520674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:06.521525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:06.529301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.536683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.536683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.536683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.655669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:06.668209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b75f093-b6f8-4f60-9a45-a2a5051f1a3f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.457201 Feb 12 21:18:06.673435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2038/3979] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:06 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:06.798039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:06.798817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:06.805547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:06.807882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.808536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.809740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.810960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.814681 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15c1b272-8cef-42d3-a37c-ec07495209fe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.297513 Feb 12 21:18:06.815282 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1942/3980] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:06 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:06.833763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:06.834386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:06.844419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.844886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:06.845727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:06.857111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.100321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:07.111209 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb663349-88bd-49c6-a233-f629b8618547 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.281908 Feb 12 21:18:07.111815 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1943/3981] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:06 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:07.119025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8be89171-3d34-4af3-ac2e-84dbcea8389c req-487add7d-8e16-4a20-a73e-773e2e74405b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e7ee65-5b25-44eb-85b6-3eadf4c45aeb", "tag": "83fe6fe2-518e-409e-8357-3935895b1c6c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:07.123763 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:07.123763 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:07.143264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8be89171-3d34-4af3-ac2e-84dbcea8389c req-487add7d-8e16-4a20-a73e-773e2e74405b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.148143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8be89171-3d34-4af3-ac2e-84dbcea8389c req-487add7d-8e16-4a20-a73e-773e2e74405b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.174737 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8be89171-3d34-4af3-ac2e-84dbcea8389c req-487add7d-8e16-4a20-a73e-773e2e74405b service nova] Creating event network-changed:83fe6fe2-518e-409e-8357-3935895b1c6c for instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb on nch2-master-1 Feb 12 21:18:07.189288 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8be89171-3d34-4af3-ac2e-84dbcea8389c req-487add7d-8e16-4a20-a73e-773e2e74405b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072114 Feb 12 21:18:07.191945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1944/3982] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:07.212336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1892126086"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:07.214278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:07.226538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.232609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.232609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.232609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.278518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:07.290259 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a334bf4c-a3f6-436b-8d66-d9a6961b5530 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.498897 Feb 12 21:18:07.290858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2039/3983] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:06 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:07.538041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:07.538875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:07.559037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.559037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.559037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.559037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.689751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:07.719296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:07.727792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:07.729087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47f1faab-05eb-466b-88e9-582c065aa2db tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.195810 Feb 12 21:18:07.744038 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2040/3984] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:07 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:07.762808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:07.763991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:07.774355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.775261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:07.776429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:07.777460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:08.107634 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1fa49438-8abf-4c91-85f7-a17307f27f52 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.913849 Feb 12 21:18:08.109463 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1945/3985] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:18:07 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Feb 12 21:18:08.123516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:08.141710 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-59991cc3-997c-41f3-8869-18945f61b1c6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.389440 Feb 12 21:18:08.149322 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2041/3986] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:07 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:08.308934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:08.309998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:08.327532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:08.327989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:08.329291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:08.334356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:08.749206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:08.750585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:08.770243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:08.770243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:08.770243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:08.770243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:08.965058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:08.975200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:08.978349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:08.979717 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0671b3fc-e823-4b3f-9679-4c070f5d9138 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.235548 Feb 12 21:18:08.982538 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2042/3987] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:08 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:18:08.983670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:08.992451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7886d518-35ec-4bb9-b6ec-8a51ab013d7b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.688604 Feb 12 21:18:08.992966 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1946/3988] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:08 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:09.168572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:09.169922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:09.185964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:09.188043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:09.193408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:09.195496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:09.468917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:09.495547 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a1dc23b8-e44d-4581-bd3c-0492c1dc46b9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.332538 Feb 12 21:18:09.496462 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2043/3989] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:09 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:10.000886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:10.001583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:10.010826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:10.015809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:10.018304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:10.018759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:10.019563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:10.020002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:10.032518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:10.036102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:10.040452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:10.041314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:10.164019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:10.179605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:10.182458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:10.186809 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36509680-8815-482a-ba2d-985173deecd6 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.188823 Feb 12 21:18:10.191491 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1947/3990] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:09 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:10.467939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:10.484216 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-193345cc-addc-4785-a25b-8894304a9814 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.478010 Feb 12 21:18:10.485187 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2044/3991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:10 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:10.513807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:10.514499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:10.523901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:10.524866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:10.528365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:10.530165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:10.777836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:10.790630 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a216772-6b33-4a7d-9570-73c9ab315c65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.278357 Feb 12 21:18:10.791508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1948/3992] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:10 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:11.211734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:11.212476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:11.264186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:11.265726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:11.270918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:11.286704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:11.467547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:11.478772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:11.480734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:11.482904 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0bbb265a-3d2d-47a9-9b82-4a0a89f8ac35 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.279337 Feb 12 21:18:11.483724 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2045/3993] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:11 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:11.511905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:11.514736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:11.521317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:11.524161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:11.525599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:11.526208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:11.743535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:11.756468 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61b6478f-df3f-4c07-af28-8f8c1226ef36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.256537 Feb 12 21:18:11.758529 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1949/3994] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:11 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:11.809147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:11.810022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:11.817462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:11.817950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:11.818835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:11.819970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:12.023906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:12.035362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a331833-a078-46a6-a5dd-bf74add5431d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.229894 Feb 12 21:18:12.036824 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2046/3995] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:11 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:12.503898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:12.509768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:12.517039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:12.517717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:12.518418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:12.519086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:12.686534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:12.698393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:12.702485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:12.710446 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e08ca40-894a-4f84-8c5f-ac150b5fe4a4 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.210169 Feb 12 21:18:12.711040 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1950/3996] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:12 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:12.775153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:12.776388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:12.791483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-856090e5-06b6-45be-a76e-05884150606d req-aef0099c-7c19-4173-9151-1a3b17feb88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e7ee65-5b25-44eb-85b6-3eadf4c45aeb", "name": "network-vif-plugged", "status": "completed", "tag": "83fe6fe2-518e-409e-8357-3935895b1c6c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:12.793335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:12.793827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:12.794142 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:12.794142 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:12.794634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:12.795259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:12.802670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-856090e5-06b6-45be-a76e-05884150606d req-aef0099c-7c19-4173-9151-1a3b17feb88d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:12.803444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-856090e5-06b6-45be-a76e-05884150606d req-aef0099c-7c19-4173-9151-1a3b17feb88d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:12.818638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-856090e5-06b6-45be-a76e-05884150606d req-aef0099c-7c19-4173-9151-1a3b17feb88d service nova] Creating event network-vif-plugged:83fe6fe2-518e-409e-8357-3935895b1c6c for instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb on nch2-master-1 Feb 12 21:18:12.856192 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-856090e5-06b6-45be-a76e-05884150606d req-aef0099c-7c19-4173-9151-1a3b17feb88d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069466 Feb 12 21:18:12.872107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1951/3997] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:13.055615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:13.056402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:13.111849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:13.112399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:13.118484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:13.119835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:13.307611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:13.315561 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0a523ff9-e4ca-40e8-bf4c-2279a2d48bf2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.544187 Feb 12 21:18:13.323120 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2047/3998] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:12 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:13.712014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:13.720021 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a780ee4-b880-4208-a70a-15becfbf7fa7 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.671394 Feb 12 21:18:13.720928 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1952/3999] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:13 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:13.735161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:13.740744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:13.743173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:13.743693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:13.744452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:13.744892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:13.921791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:13.937794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:13.939466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:13.940709 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a2b1d333-09c6-4b62-be24-916baa9fc627 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1366 microversion: 2.47 time: 0.209322 Feb 12 21:18:13.952757 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2048/4000] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:13 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:14.333331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:14.334250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:14.345615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:14.349774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:14.354590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:14.355091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:14.643163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:14.670359 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a408b136-187b-4652-9f4e-7af4a8476650 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1314 microversion: 2.1 time: 0.341921 Feb 12 21:18:14.674199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1953/4001] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:14 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:14.741312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:14.742929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:14.758577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:14.759322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:14.760383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:14.760834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:14.879140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-88030d65-665f-4db7-be96-c8f6f21903ac req-f8bb8f0c-f8ca-4624-8774-94258462fefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-plugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:14.885902 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:14.885902 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:14.908230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-88030d65-665f-4db7-be96-c8f6f21903ac req-f8bb8f0c-f8ca-4624-8774-94258462fefe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:14.908986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-88030d65-665f-4db7-be96-c8f6f21903ac req-f8bb8f0c-f8ca-4624-8774-94258462fefe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:14.923057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-88030d65-665f-4db7-be96-c8f6f21903ac req-f8bb8f0c-f8ca-4624-8774-94258462fefe service nova] Creating event network-vif-plugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:18:14.929513 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-88030d65-665f-4db7-be96-c8f6f21903ac req-f8bb8f0c-f8ca-4624-8774-94258462fefe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054978 Feb 12 21:18:14.931876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1954/4002] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:18:14.963142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:14.969073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:14.981407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:14.989004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:14.992982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:15.000150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:15.085322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:15.100020 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-23769c94-2032-4024-92a9-45caa43943f0 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.363657 Feb 12 21:18:15.102265 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2049/4003] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:14 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:15.139548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:15.151331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:15.153956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:15.156247 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43ff1370-6a90-4faf-95b8-51e8f9bf3de9 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1372 microversion: 2.47 time: 0.200002 Feb 12 21:18:15.169251 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1955/4004] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:14 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:18:15.690482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:15.691354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:15.718267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:15.719620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:15.721900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:15.723008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:15.831067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2033195462", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "19170c93-d9ce-4497-9280-91aac6f17f7b"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:15.997575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:16.008563 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3402f86-22b0-41a6-86d6-cc2657b3870d tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1500 microversion: 2.1 time: 0.321933 Feb 12 21:18:16.021016 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1956/4005] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:15 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1500 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:16.026983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6b0af4f6-68aa-4919-b99b-133746625400 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:16.035817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b0af4f6-68aa-4919-b99b-133746625400 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.036537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b0af4f6-68aa-4919-b99b-133746625400 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:16.063899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6b0af4f6-68aa-4919-b99b-133746625400 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Going to try to stop instance {{(pid=141726) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:18:16.255939 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6b0af4f6-68aa-4919-b99b-133746625400 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.232975 Feb 12 21:18:16.256765 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1957/4006] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:18:16 2022] POST /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:18:16.262747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:16.263920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:16.270927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.271634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:16.273198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.273691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:16.518744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] validate_networks() for [('19170c93-d9ce-4497-9280-91aac6f17f7b', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:18:16.693184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:16.711708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86a6eaa2-6a74-493e-99fd-f7950c7548d8 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.452374 Feb 12 21:18:16.719081 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1958/4007] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:16 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:16.729120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:16.730276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:16.739232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.740376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:16.742374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.743413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:16.911906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:16.929170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:16.930901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:16.936407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-12b1194b-ebc1-4583-b341-35b1ae5fb6be tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1372 microversion: 2.47 time: 0.215284 Feb 12 21:18:16.953920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1959/4008] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:16 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:16.972832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:16.974876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:16.989066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.993092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:16.994325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:16.994964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:17.400064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:17.400976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:17.401966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:17.402548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:17.403120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:17.451891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:17.461848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:17.464742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:17.465227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:17.530246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Getting quotas for project cf7e0df130604d2b9dab6a7fb331f5c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:18:17.552004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Getting quotas for user c2d612e20334459eb9f7b2cdee9320bc and project cf7e0df130604d2b9dab6a7fb331f5c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:18:17.610341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:18:17.613172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:18:17.730955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:17.744475 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d92cc6c-5521-41b0-83f4-b2c3aedd6ec8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.789052 Feb 12 21:18:17.747657 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1960/4009] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:16 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:17.755808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:17.758746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:17.774953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:17.776259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:17.779028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:17.780031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:17.874050 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b825fe56-44e1-42ca-a37d-28b22380ed7c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281584 Feb 12 21:18:17.875258 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2050/4010] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:18:17.888339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19f46b90-e4d5-465a-8649-6ef7b604ebbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:17.891117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-19f46b90-e4d5-465a-8649-6ef7b604ebbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:18.163280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.174721 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ddb9c835-5c6c-43cb-9bfa-3821cbb4b16f tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.427352 Feb 12 21:18:18.189775 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1961/4011] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:17 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:18.195587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:18.197712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:18.213814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.217693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.221011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.221776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.362974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.374932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.378132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.379580 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4cbef5c7-eb4b-4ab6-bcf9-f5a750e0a947 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1357 microversion: 2.47 time: 0.188523 Feb 12 21:18:18.380178 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1962/4012] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:18 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:18.400165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:18.404390 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:18.404390 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:18.405968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.407021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Searching by: {'deleted': False, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:18:18.413155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.413788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.414717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.415276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.573714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-19f46b90-e4d5-465a-8649-6ef7b604ebbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.598969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19f46b90-e4d5-465a-8649-6ef7b604ebbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1218 microversion: 2.1 time: 0.714453 Feb 12 21:18:18.604950 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2051/4013] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:17 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1218 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:18.618559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:18:18.742629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.763294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:18.763843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.764511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.764636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:18.778885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.787165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.790770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.794794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.795597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:18.800421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.878582 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-308adf66-41ad-4973-a5e9-959603d1144c tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.482774 Feb 12 21:18:18.880067 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1963/4014] 10.222.0.31 () {60 vars in 1186 bytes} [Sat Feb 12 21:18:18 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:18.916346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:18.918008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:18.935709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.938638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.940326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:18.940812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:18.974428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:18:19.136263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:19.144918 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e7e8823-e98e-409d-b92a-b089afcc8354 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.386749 Feb 12 21:18:19.149920 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2052/4015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:18 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:19.194686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:19.195205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:19.213831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:19.215945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:19.218436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:19.220299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:19.286657 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c0e2e11e-4ed7-44e3-8c24-6ff65be252ca tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "DELETE /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 204 len: 0 microversion: 2.47 time: 0.386045 Feb 12 21:18:19.288463 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1964/4016] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:18:18 2022] DELETE /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:18:19.300027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:19.301214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:19.322648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:19.327242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:19.327242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:19.327242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:19.504771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:19.517396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:19.520439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:19.522878 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4cfd0ea5-112f-4f9f-8340-6c2aab279716 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1363 microversion: 2.47 time: 0.230168 Feb 12 21:18:19.525538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1965/4017] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:19 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:19.558051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:19.573397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c4da878-091b-41e5-9620-029f1efe0a9e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.383835 Feb 12 21:18:19.574580 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2053/4018] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:19 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:19.619765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:19.620627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:19.641806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:19.643907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:19.648467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:19.651676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:19.827754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:19.837330 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6929b1aa-afe8-4ead-9205-599d7d071766 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1222 microversion: 2.1 time: 0.224938 Feb 12 21:18:19.838296 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1966/4019] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:19 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:20.169644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:20.169644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:20.176892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.177403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.178210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.179438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.357783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:20.367264 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0defa962-5a57-499e-9834-e5ba60dbf749 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.204822 Feb 12 21:18:20.367831 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2054/4020] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:20 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:20.544351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:20.545437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:20.551572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.552025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.552913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.553916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.591439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:20.592305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:20.599714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.600212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.601027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.601492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.623729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:20.632361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:20.642505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:20.644325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ede4b742-2dd2-406e-a463-a0e68cb9e993 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1363 microversion: 2.47 time: 0.106477 Feb 12 21:18:20.644773 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1967/4021] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:20 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1363 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:20.794684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:20.803051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c4d30ebe-9167-4b6b-a1a7-b0d833afd6c9 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.216138 Feb 12 21:18:20.805585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2055/4022] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:20 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:20.854967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:20.859185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:20.870598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.871051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:20.871844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:20.872280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.194261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:21.205701 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-07279644-22b1-40de-a753-42b223165770 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1270 microversion: 2.1 time: 0.352965 Feb 12 21:18:21.206568 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1968/4023] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:20 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1270 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:21.383938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:21.385053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:21.393817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.402232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.405696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.408976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.664658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:21.665711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:21.680664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.686087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.692120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.692975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.823883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.831696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.833901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lazy-loading 'fault' on Instance uuid 13f21561-a428-49de-b848-0edd99a68b4c {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:18:21.909974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:21.921217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:21.923042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:21.925220 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7f57ee04-7685-4d8c-86c7-1d6fd73b3e90 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 200 len: 1368 microversion: 2.47 time: 0.264390 Feb 12 21:18:21.926378 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1969/4024] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:21 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:18:21.931590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:21.932525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:21.938969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.939841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:21.941014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:21.941844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:22.204956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:22.218225 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-28bf307d-6f21-4371-98cf-17c667caf46c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.833909 Feb 12 21:18:22.219676 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2056/4025] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:21 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:22.227328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:22.228151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:22.254393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:22.254852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:22.261270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:22.262851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:22.274838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:22.292994 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1f3d7bec-d188-41d6-8aa7-2da70ca911fd tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.365432 Feb 12 21:18:22.293634 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1970/4026] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:21 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:22.500029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:22.510296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e1d8e7a4-cb58-4234-bd73-5c80d03299b9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1276 microversion: 2.1 time: 0.289294 Feb 12 21:18:22.511379 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2057/4027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:22 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:22.946214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:22.947399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 13f21561-a428-49de-b848-0edd99a68b4c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:22.957510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:22.959262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:22.960992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:22.962427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.021156 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] HTTP exception thrown: Instance 13f21561-a428-49de-b848-0edd99a68b4c could not be found. Feb 12 21:18:23.022633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Returning 404 to user: Instance 13f21561-a428-49de-b848-0edd99a68b4c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:18:23.026451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-26c3c12f-28f9-4877-a78e-9789d723e3fa tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c" status: 404 len: 111 microversion: 2.47 time: 0.083926 Feb 12 21:18:23.028881 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1971/4028] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:22 2022] GET /compute/v2.1/servers/13f21561-a428-49de-b848-0edd99a68b4c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:18:23.035039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:23.035773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:23.045997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.046739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.047783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.049537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.119187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:18:23.238552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:23.239549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:23.253111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.253843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.254894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.269748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.527248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc24bcaf-911c-4116-a5e3-347562cdd854 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "DELETE /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1" status: 204 len: 0 microversion: 2.47 time: 0.495516 Feb 12 21:18:23.531908 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2058/4029] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:18:23 2022] DELETE /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:18:23.539328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:23.540916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:23.559284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.560823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.562859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.563644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.864153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:23.885266 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3a74c3d-0570-4be2-a8c1-571a0e22eb8b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.648458 Feb 12 21:18:23.887579 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1972/4030] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:23 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:23.893729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:23.894721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:23.917163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.917682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:23.919532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:23.919977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:24.263904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:24.276801 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1aad4227-9e7d-4c2d-a881-01f4c19118a6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.387481 Feb 12 21:18:24.284783 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1973/4031] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:23 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:24.300635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:24.301276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:24.320500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:24.323606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:24.327718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:24.328597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:24.433085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:24.446831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:24.458476 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4b881b23-d134-4cbf-8cc7-3c37bc1d85ba tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.923202 Feb 12 21:18:24.461697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2059/4032] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:23 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:24.468215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:24.472017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:24.474174 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5295de6f-3fe6-4257-90a7-29760d91bb86 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1" status: 200 len: 1362 microversion: 2.47 time: 0.188078 Feb 12 21:18:24.478767 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1974/4033] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:24 2022] GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:24.904658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:24.905965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:24.916921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:24.917519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:24.919750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:24.920791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.485043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:25.508337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13e2d4c8-0299-4e88-b38b-b963a0f96b4c tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.601378 Feb 12 21:18:25.511663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2060/4034] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:24 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:25.532804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:25.535188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:25.546045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.546964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.548047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.548668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.644137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Calling method '.version_select at 0x7fa8fe5485e0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:25.648309 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:25.648309 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:25.650887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.651516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.666678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.667398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.680227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.680925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.688138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78fa62a8-d2bd-459d-acbe-75ee5093ab51 tempest-PortsAdminExtendedAttrsTestJSON-61573626 tempest-PortsAdminExtendedAttrsTestJSON-61573626-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.718350 Feb 12 21:18:25.689245 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1975/4035] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:18:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:25.694721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:25.696113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:25.708458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.709199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.711119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:25.711747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:25.971241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:25.986542 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-74aafbc2-942c-4e70-9627-f0cc0d1a4537 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.295829 Feb 12 21:18:25.987581 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1976/4036] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:25 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:25.998564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:25.999196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:26.014694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:26.015160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:26.020337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:26.044690 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c743254b-b0fe-433f-9526-c155a5d92bce tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.516068 Feb 12 21:18:26.049770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:26.050358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:26.053720 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2061/4037] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:25 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:26.061123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d8bbf5be-3a0b-4ec4-b950-c6e815e5ea5e req-f84bf436-0979-4d52-92d3-cd70bfb40485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0f23fe-5df2-49f4-85af-3e16dabe1ca5", "tag": "34cd3a96-20f0-4da5-9fc7-b28ab17e9dda"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:26.088705 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:26.088705 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:18:26.106176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d8bbf5be-3a0b-4ec4-b950-c6e815e5ea5e req-f84bf436-0979-4d52-92d3-cd70bfb40485 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:26.112597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d8bbf5be-3a0b-4ec4-b950-c6e815e5ea5e req-f84bf436-0979-4d52-92d3-cd70bfb40485 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:26.138962 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d8bbf5be-3a0b-4ec4-b950-c6e815e5ea5e req-f84bf436-0979-4d52-92d3-cd70bfb40485 service nova] Creating event network-changed:34cd3a96-20f0-4da5-9fc7-b28ab17e9dda for instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 on nch1-master-1 Feb 12 21:18:26.146440 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d8bbf5be-3a0b-4ec4-b950-c6e815e5ea5e req-f84bf436-0979-4d52-92d3-cd70bfb40485 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091165 Feb 12 21:18:26.150367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:26.150367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:26.150367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lazy-loading 'fault' on Instance uuid 813fd1da-ee32-4a5e-8437-55b1ded639c1 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:18:26.150992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2062/4038] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:26.204045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:26.215138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:26.217242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f076063f926f48028edb9ec8e61acdf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6281d1c3f6741828c12de21ad0cf52a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:26.218717 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fdb0190e-5e3d-430a-936d-b7b3675ca574 tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1" status: 200 len: 1367 microversion: 2.47 time: 0.229907 Feb 12 21:18:26.219508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1977/4039] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:25 2022] GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:18:26.530556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:26.531364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:26.539774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:26.540532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:26.545253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:26.545253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.010255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:27.011281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:27.018780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:27.019312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.020685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:27.021226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.125249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:27.136430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d06faee8-4a3c-4d15-b40b-169c90df252f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.609855 Feb 12 21:18:27.138532 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2063/4040] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:26 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:27.144347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:27.145195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:27.157029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:27.158404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.160014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:27.160709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.261971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:27.271530 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6b6fe1a-394e-4eca-a73a-7bf517949605 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.268708 Feb 12 21:18:27.273872 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1978/4041] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:27 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:27.278894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:27.279906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] [instance: 813fd1da-ee32-4a5e-8437-55b1ded639c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:27.287430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:27.289189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.295191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:27.295191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:27.311263 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] HTTP exception thrown: Instance 813fd1da-ee32-4a5e-8437-55b1ded639c1 could not be found. Feb 12 21:18:27.312349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] Returning 404 to user: Instance 813fd1da-ee32-4a5e-8437-55b1ded639c1 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:18:27.313477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df849dee-390b-4f33-b14d-86295f98e16a tempest-ServerShowV247Test-1072946073 tempest-ServerShowV247Test-1072946073-project] 10.222.0.31 "GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1" status: 404 len: 111 microversion: 2.47 time: 0.038288 Feb 12 21:18:27.315107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1979/4042] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:18:27 2022] GET /compute/v2.1/servers/813fd1da-ee32-4a5e-8437-55b1ded639c1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:18:28.050205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:28.059761 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0636c3f-72d0-4f78-ab0a-6175bf773d67 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.919833 Feb 12 21:18:28.062208 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2064/4043] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:27 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:28.153800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:28.155130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:28.167403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:28.168115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:28.169086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:28.169866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:28.296443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:28.298191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:28.323054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:28.325503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:28.332140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:28.337822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:28.876082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:28.887896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5e27a6fe-a375-4788-afbf-0d1274f2812a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.598649 Feb 12 21:18:28.901525 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2065/4044] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:28 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:29.082211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:29.083166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:29.108313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:29.121450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:29.123213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:29.130910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:29.407567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:29.416417 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e812094b-e3d5-4575-9563-46beeed1b2a0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 1.266180 Feb 12 21:18:29.422201 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1980/4045] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:28 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:29.505782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:29.517832 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c489b95a-38f5-4af7-b608-973498e5436e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.441720 Feb 12 21:18:29.523231 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2066/4046] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:29 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:29.926761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:29.928089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:29.973824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:29.975975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:29.980702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:29.982179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:30.438823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:30.439987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:30.465885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:30.467313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:30.469307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:30.472369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:30.487878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:30.497182 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d4c65956-d620-4d14-8f95-db67e2537486 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.593963 Feb 12 21:18:30.518671 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1981/4047] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:29 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:30.543877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:30.544426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:30.558145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:30.558610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:30.564551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:30.564551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:30.868766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:30.871999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:30.881823 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-83afbe6b-9867-42d7-a322-5d8f8c60aeac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.446047 Feb 12 21:18:30.892305 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9fd8015c-d4ad-4a8c-8177-fc27550218c7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.355983 Feb 12 21:18:30.892556 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2067/4048] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:30 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:30.892666 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1982/4049] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:30 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:31.516381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:31.517262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:31.531876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:31.532346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:31.533169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:31.539238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:31.900586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:31.901957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:31.931652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:31.934208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:31.935304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:31.937585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:32.150595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:32.159606 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9bb0f525-c05f-4274-8986-5d25116e5a89 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1484 microversion: 2.1 time: 0.649175 Feb 12 21:18:32.171594 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2068/4050] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:31 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1484 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:32.180127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:32.180890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:32.188701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:32.189271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:32.191073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:32.191647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:32.363835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:32.384120 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f9a4cc0f-c0b9-4d3f-bc21-11ab57362bb8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.200032 Feb 12 21:18:32.384120 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2069/4051] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:32 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:32.398052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:32.407475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:32.422016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:32.425504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:32.428241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:32.429149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:32.517895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:32.529187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab64f184-4af0-44cb-81c9-20bd6aece3b8 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.632475 Feb 12 21:18:32.530173 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1983/4052] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:31 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:32.783297 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5e60ae0e-4551-4cd6-8560-a3c4b206935e tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "POST /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d/action" status: 202 len: 0 microversion: 2.1 time: 0.407775 Feb 12 21:18:32.783937 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2070/4053] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:18:32 2022] POST /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:18:32.793130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:32.794073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:32.802841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:32.804340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:32.807623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:32.808238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:33.335138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:33.342597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebe190e1-1a23-4b85-8ca9-2f7c02f16f15 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1492 microversion: 2.1 time: 0.553483 Feb 12 21:18:33.343177 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1984/4054] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:32 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1492 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:33.393969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:33.395190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:33.401596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:33.402120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:33.403021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:33.404105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:33.547990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:33.548753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:33.558074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:33.563689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:33.569241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:33.569241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:33.852944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:33.864700 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-40c6fd73-c963-4a1a-9051-6d29510805d7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.475255 Feb 12 21:18:33.865326 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2071/4055] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:33 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:33.935817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:33.936694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:33.947539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:33.949005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:33.950575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:33.952531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:34.130073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:34.145456 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-199bb83f-8848-4074-9ffc-b34950949a08 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.601813 Feb 12 21:18:34.148096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1985/4056] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:33 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:34.181494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:34.189942 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-99926f38-6d75-47a3-8ee1-d698313671bb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.258184 Feb 12 21:18:34.194910 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2072/4057] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:33 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:34.360193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:34.360862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:34.375447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:34.375976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:34.376805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:34.377255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:34.476287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-063e737a-7768-49d4-82e4-6631de811f24 req-8080336e-cfbd-405e-bc29-2a5f27ec0bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0f23fe-5df2-49f4-85af-3e16dabe1ca5", "name": "network-vif-plugged", "status": "completed", "tag": "34cd3a96-20f0-4da5-9fc7-b28ab17e9dda"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:34.478306 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:34.478306 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:18:34.487735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-063e737a-7768-49d4-82e4-6631de811f24 req-8080336e-cfbd-405e-bc29-2a5f27ec0bf6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:34.488523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-063e737a-7768-49d4-82e4-6631de811f24 req-8080336e-cfbd-405e-bc29-2a5f27ec0bf6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:34.506703 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-063e737a-7768-49d4-82e4-6631de811f24 req-8080336e-cfbd-405e-bc29-2a5f27ec0bf6 service nova] Creating event network-vif-plugged:34cd3a96-20f0-4da5-9fc7-b28ab17e9dda for instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 on nch1-master-1 Feb 12 21:18:34.513619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-063e737a-7768-49d4-82e4-6631de811f24 req-8080336e-cfbd-405e-bc29-2a5f27ec0bf6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041505 Feb 12 21:18:34.514620 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2073/4058] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:18:34.781090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:34.797460 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7606588-0c90-482b-be37-5fda679851d5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1492 microversion: 2.1 time: 0.441033 Feb 12 21:18:34.799889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1986/4059] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:34 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1492 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:34.885097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:34.886936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:34.896054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:34.897414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:34.899538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:34.900245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.140545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:35.152511 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f028e8a9-15f3-40c6-a642-46274e0cc7f7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1318 microversion: 2.1 time: 0.274327 Feb 12 21:18:35.153771 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2074/4060] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:34 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:35.164705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:35.165185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:35.182230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:35.182699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.183512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:35.183986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.214236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:35.214861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:35.229448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:35.229970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.230786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:35.231235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.448021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:35.455683 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9c1b784-3bfc-4ce4-ba58-74b7ebc9b64f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.245117 Feb 12 21:18:35.456300 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2075/4061] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:35.475494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:35.483139 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c84bec01-0852-410d-bca9-32c4fcfc5dd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.323136 Feb 12 21:18:35.483756 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1987/4062] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:35 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:35.493517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-751785826"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:35.494906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:35.501289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:35.501801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.502606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:35.503065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:35.662736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1000676476", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:35.770572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:18:36.359359 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c118b6be-86b2-46ba-a20c-f0d542cec11d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.873657 Feb 12 21:18:36.360482 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1988/4063] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:18:35 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Feb 12 21:18:36.384014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:36.385008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:36.399917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.401570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.411716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.411716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.412276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:36.412276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:36.412276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:36.412276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:36.412276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:36.418823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.419386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.420582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.421047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.438736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:18:36.444614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:18:36.462107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:18:36.464765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:18:36.604051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4103e9aa-7f36-4c5c-83b5-76178302d6a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145747 Feb 12 21:18:36.605290 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2076/4064] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:18:36.616866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:36.617807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:36.626295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.627073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.628164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.628841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.852470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:36.866306 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2328e4cf-5b3f-4cdb-86ee-cc70d5511959 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1492 microversion: 2.1 time: 0.503964 Feb 12 21:18:36.867321 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1989/4065] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:36 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1492 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:36.872820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:36.873838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:36.883764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.884605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.885786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:36.886342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:36.918728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:36.934775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2958996-0106-490a-862b-a51d686c897e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1508 microversion: 2.1 time: 0.322259 Feb 12 21:18:36.935700 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2077/4066] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:36 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:36.954205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cf9562cc-f21d-4ad4-a001-7bf12af0d224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:36.957606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cf9562cc-f21d-4ad4-a001-7bf12af0d224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:37.035256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cf9562cc-f21d-4ad4-a001-7bf12af0d224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:37.043611 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cf9562cc-f21d-4ad4-a001-7bf12af0d224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1193 microversion: 2.1 time: 0.094376 Feb 12 21:18:37.044280 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2078/4067] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:36 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:37.049161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:37.050028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:37.059766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.060264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.061498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.062240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.152956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:37.160187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90239c35-3bbd-4630-bd48-8533690abd7a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.290761 Feb 12 21:18:37.161164 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1990/4068] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:36 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:37.538662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:37.547941 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50d6a93f-68ec-4097-b90b-7e36a48a77f6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1508 microversion: 2.1 time: 0.502613 Feb 12 21:18:37.548837 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2079/4069] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:37 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1508 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:37.572616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:37.576323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:37.594681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.595142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.595930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.596584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.715297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:37.715729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:37.716380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:37.717511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:37.717953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:37.883939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:37.884588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:37.891892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.892340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.893165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.893635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.938565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:37.948055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.948812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.953261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:37.953261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:37.986259 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-02065b84-5119-46fa-a149-797ef2b0f16f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "POST /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5/action" status: 202 len: 1110 microversion: 2.1 time: 0.424850 Feb 12 21:18:37.988839 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1991/4070] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:18:37 2022] POST /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5/action => generated 1110 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 12 21:18:38.003801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:38.005236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:38.016806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.017754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.019950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.025640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.235915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:38.248841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-800e08fe-8c51-4230-a62d-2e5c8b04a4d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.250012 Feb 12 21:18:38.249502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1992/4071] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:37 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:38.256866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:38.258069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:38.288439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.288785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.293101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.293755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.417261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:38.429802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:38.430317 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-55b501e1-ce27-4b17-9ad8-ef94cbe1e3d4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1498 microversion: 2.1 time: 0.550880 Feb 12 21:18:38.430916 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2080/4072] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:37 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1498 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:38.448073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:38.448749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:38.459711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.463328 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6cb745c0-5812-43e7-b9e9-4bb60eb9006f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1197 microversion: 2.1 time: 0.212525 Feb 12 21:18:38.466261 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1993/4073] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:38 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:38.476362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.476362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.476362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.487907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a66270d6-c714-4b4d-9a4c-475b12532c17 req-3571069a-1faf-4bcd-9d1a-4eb8fc992066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-unplugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:38.487907 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:38.487907 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:38.510215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a66270d6-c714-4b4d-9a4c-475b12532c17 req-3571069a-1faf-4bcd-9d1a-4eb8fc992066 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.510817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a66270d6-c714-4b4d-9a4c-475b12532c17 req-3571069a-1faf-4bcd-9d1a-4eb8fc992066 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.545284 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a66270d6-c714-4b4d-9a4c-475b12532c17 req-3571069a-1faf-4bcd-9d1a-4eb8fc992066 service nova] Creating event network-vif-unplugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:18:38.550735 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a66270d6-c714-4b4d-9a4c-475b12532c17 req-3571069a-1faf-4bcd-9d1a-4eb8fc992066 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082325 Feb 12 21:18:38.551609 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1994/4074] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:38.558464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:38.561630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:38.569858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.570469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.571274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:38.571719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:38.601262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:18:38.774978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:38.784550 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b16789f3-a000-4cc1-810b-b7e22e8445f3 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.352594 Feb 12 21:18:38.785535 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2081/4075] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:38 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:39.058047 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-439c6536-793b-4a6f-a181-195b0fb7a8eb tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 204 len: 0 microversion: 2.1 time: 0.504489 Feb 12 21:18:39.067551 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1995/4076] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:18:38 2022] DELETE /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:18:39.075136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:39.076055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:39.083935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.085622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.086688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.087353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.279854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:39.280880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:39.291041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.291808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.292920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.293561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.462479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:39.474056 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c14bd4a-f93d-4ae3-a49b-09c4b51efea4 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.408416 Feb 12 21:18:39.476465 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2082/4077] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:39 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:39.489409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:39.490921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:39.503308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.504135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.507461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.508344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.623986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:39.635813 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6da711a-cd4a-4269-be8b-51b64fe0c531 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1253 microversion: 2.1 time: 0.150225 Feb 12 21:18:39.639380 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2083/4078] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:39 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1253 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:39.802128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:39.802840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:39.810003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.810467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.811280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:39.811724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:39.927053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:39.938654 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e84b6ff-5b7f-4643-bd00-d849e41a8661 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.663444 Feb 12 21:18:39.940786 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1996/4079] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:39 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:40.125447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:40.142089 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a55cf6d2-46e0-41d5-98b2-185a2eb530f2 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.343617 Feb 12 21:18:40.144578 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2084/4080] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:39 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:40.492703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:40.495498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:40.510620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:40.511885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:40.513910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:40.514589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:40.656201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:40.656897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:40.671098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:40.671861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:40.672846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:40.673474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:40.864735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:40.943735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-af4e446b-15ed-4ce4-a157-f029ce3e7921 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1251 microversion: 2.1 time: 0.291086 Feb 12 21:18:40.954786 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2085/4081] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:40 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1251 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:40.968976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:40.983152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:40.995867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:40.996682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:40.999276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:41.008669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:41.109548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:41.128971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76003ccc-9b01-4b4f-aeaa-08e9bf515a4a tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.640762 Feb 12 21:18:41.142115 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1997/4082] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:40 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:41.162931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:41.166260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:41.182622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:41.183675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:41.184910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:41.185600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:41.478933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:41.486806 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-67058c59-56c3-4a22-ac88-c0965f0c9d0b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.531033 Feb 12 21:18:41.498604 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2086/4083] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:40 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:41.815258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:41.826953 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30df77b9-2bfd-462f-9b39-8899e5719d90 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1510 microversion: 2.1 time: 0.671226 Feb 12 21:18:41.830071 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1998/4084] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:41 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1510 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:41.969251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:41.971306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:41.997741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:41.998352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:42.002641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:42.003249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:42.153713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:42.155526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:42.177824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:42.179291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:42.193217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:42.193217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:42.515529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:42.538648 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a6d7ad86-b221-4153-adeb-e410c1baf2ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.571250 Feb 12 21:18:42.553833 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2087/4085] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:41 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:42.578556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e31fbc8a-546f-4714-be12-7aac2b185590 req-ad3aa4c7-0ec1-4fc3-8ee5-503ec1c44866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-plugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:42.578556 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:42.578556 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:18:42.601916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e31fbc8a-546f-4714-be12-7aac2b185590 req-ad3aa4c7-0ec1-4fc3-8ee5-503ec1c44866 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:42.602372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e31fbc8a-546f-4714-be12-7aac2b185590 req-ad3aa4c7-0ec1-4fc3-8ee5-503ec1c44866 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:42.643302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e31fbc8a-546f-4714-be12-7aac2b185590 req-ad3aa4c7-0ec1-4fc3-8ee5-503ec1c44866 service nova] Creating event network-vif-plugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:18:42.652392 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e31fbc8a-546f-4714-be12-7aac2b185590 req-ad3aa4c7-0ec1-4fc3-8ee5-503ec1c44866 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087278 Feb 12 21:18:42.652392 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2088/4086] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:42.658199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:42.658912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:42.691905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:42.692764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:42.695042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:42.702821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.079141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:43.088264 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-29f34202-6f71-4832-a287-63eaf0d10293 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1504 microversion: 2.1 time: 0.944004 Feb 12 21:18:43.091003 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 1999/4087] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:42 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1504 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:43.106282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:43.107265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:43.115855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:43.118803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.119874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:43.120540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.210175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:43.223994 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe0b3107-6085-4140-b5f6-5d43ec008c98 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.570431 Feb 12 21:18:43.229996 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2089/4088] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:42 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:43.555491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:43.556107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:43.558784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:43.571939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:43.572398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.573211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:43.573675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.574141 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b71b02a7-d0ae-4ced-89f5-08fcd52f59d6 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1487 microversion: 2.1 time: 0.470888 Feb 12 21:18:43.575013 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2000/4089] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:43 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1487 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:43.595218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:43.601222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:43.617837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:43.618695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.619754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:43.620495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:43.675645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:18:43.959223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:43.968680 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50681157-ed95-4b0e-aaba-414b74fefd2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.418200 Feb 12 21:18:43.969260 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2090/4090] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:43 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:44.097848 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f13e9a71-9414-4ffb-8afc-e41c8e8ab710 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 204 len: 0 microversion: 2.1 time: 0.509024 Feb 12 21:18:44.099641 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2001/4091] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:18:43 2022] DELETE /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:18:44.107872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:44.108487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:44.109763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:44.110716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:44.120782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:44.123313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:44.124403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:44.128014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:44.128563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:44.129015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:44.129430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:44.129880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:44.647234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:44.657932 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5fa41ec7-2dea-42f3-bb2a-6f754bb8f10d tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1462 microversion: 2.1 time: 0.553644 Feb 12 21:18:44.660132 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2091/4092] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:44 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1462 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:44.673555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:44.674573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:44.681891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:44.682618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:44.683593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:44.684189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:44.971482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:44.990573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64b61e91-fa67-424c-9e50-7b9eb92b474b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1493 microversion: 2.1 time: 0.885793 Feb 12 21:18:44.991863 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2002/4093] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:44 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1493 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:45.002754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-40be19da-2c03-459d-9fde-99fcc946df49 req-6450322e-ee26-4f74-81e3-aea0367ce0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c488ea90-1cee-4992-9fa0-7290df83f23d", "name": "network-vif-deleted", "tag": "98cca7e1-4777-4b0c-ad16-c0516fe1d47e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:45.004934 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:45.004934 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:45.045151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-40be19da-2c03-459d-9fde-99fcc946df49 req-6450322e-ee26-4f74-81e3-aea0367ce0d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.047728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-40be19da-2c03-459d-9fde-99fcc946df49 req-6450322e-ee26-4f74-81e3-aea0367ce0d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.083538 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-40be19da-2c03-459d-9fde-99fcc946df49 req-6450322e-ee26-4f74-81e3-aea0367ce0d1 service nova] Creating event network-vif-deleted:98cca7e1-4777-4b0c-ad16-c0516fe1d47e for instance c488ea90-1cee-4992-9fa0-7290df83f23d on nch1-master-1 Feb 12 21:18:45.096895 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-40be19da-2c03-459d-9fde-99fcc946df49 req-6450322e-ee26-4f74-81e3-aea0367ce0d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103384 Feb 12 21:18:45.097865 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2003/4094] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:45.114459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5b1910af-7458-4a79-b60f-0f9e5cb2c54f req-63046cb8-7239-41d9-9d0a-bdf79ed70325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265e978d-6902-435c-9dc8-2977135fa92a", "tag": "38352d0d-4c76-4e91-9225-8c4272270ad6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:45.114459 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:45.114459 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:45.137670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5b1910af-7458-4a79-b60f-0f9e5cb2c54f req-63046cb8-7239-41d9-9d0a-bdf79ed70325 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.143128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5b1910af-7458-4a79-b60f-0f9e5cb2c54f req-63046cb8-7239-41d9-9d0a-bdf79ed70325 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.160541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:45.169018 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5b1910af-7458-4a79-b60f-0f9e5cb2c54f req-63046cb8-7239-41d9-9d0a-bdf79ed70325 service nova] Creating event network-changed:38352d0d-4c76-4e91-9225-8c4272270ad6 for instance 265e978d-6902-435c-9dc8-2977135fa92a on nch2-master-1 Feb 12 21:18:45.174885 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba71e7e5-2f5d-4dce-ba14-515cef3212f1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.513535 Feb 12 21:18:45.176049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2092/4095] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:44 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:45.187316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:45.189526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:45.191187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5b1910af-7458-4a79-b60f-0f9e5cb2c54f req-63046cb8-7239-41d9-9d0a-bdf79ed70325 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089600 Feb 12 21:18:45.192097 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2004/4096] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:45.198787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.199487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.206077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.206077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.662892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:45.673807 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e915942e-d590-429f-830e-c3e6b11a5d97 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.496101 Feb 12 21:18:45.684819 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2093/4097] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:45 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:45.687516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:45.688215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:45.701303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.701803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.706075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.706536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.794880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:45.795339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:45.795804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lazy-loading 'fault' on Instance uuid c488ea90-1cee-4992-9fa0-7290df83f23d {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:18:45.969624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:45.973991 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-729d200f-f269-4cef-a6ea-c0428015e462 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 200 len: 1303 microversion: 2.1 time: 0.297605 Feb 12 21:18:45.979013 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2005/4098] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:45 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 1303 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:46.009968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:46.010709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:46.027737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:46.028645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:46.030459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:46.032796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:46.197526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:46.199457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:46.213740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:46.216146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:46.218306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:46.218959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:46.452828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:46.475559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-795e6663-379c-493b-a37d-2e0378fe60f1 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1493 microversion: 2.1 time: 0.468743 Feb 12 21:18:46.476485 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2094/4099] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:46 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:46.626892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:46.634291 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-02e25ecc-0cef-44fa-a765-475e627c8cf1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.444983 Feb 12 21:18:46.644096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2006/4100] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:46 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:46.700837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:46.704187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:46.746765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:46.752065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:46.753712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:46.754204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:46.996430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:46.997314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: c488ea90-1cee-4992-9fa0-7290df83f23d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:47.007077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.007522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.008584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.009041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.066942 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] HTTP exception thrown: Instance c488ea90-1cee-4992-9fa0-7290df83f23d could not be found. Feb 12 21:18:47.067585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Returning 404 to user: Instance c488ea90-1cee-4992-9fa0-7290df83f23d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:18:47.068525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b1ee551-6943-473e-ab0f-f48c96a109e6 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d" status: 404 len: 111 microversion: 2.1 time: 0.076549 Feb 12 21:18:47.069186 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2007/4101] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:46 2022] GET /compute/v2.1/servers/c488ea90-1cee-4992-9fa0-7290df83f23d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:18:47.080775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:47.080775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:47.088361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.089288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.094419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.096383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.134850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:47.145301 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b34064e-688e-4ec4-8d69-eb612a92a58b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.454967 Feb 12 21:18:47.149148 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2095/4102] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:46 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:47.210402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:18:47.263166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-8cf3b8d8-d9b3-4064-8dd8-d2dd3953b074 req-2d21f41c-9998-4f02-9954-9be4a76c13c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e7ee65-5b25-44eb-85b6-3eadf4c45aeb", "name": "network-vif-deleted", "tag": "83fe6fe2-518e-409e-8357-3935895b1c6c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:47.265217 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:47.265217 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:18:47.314432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8cf3b8d8-d9b3-4064-8dd8-d2dd3953b074 req-2d21f41c-9998-4f02-9954-9be4a76c13c1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.316918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8cf3b8d8-d9b3-4064-8dd8-d2dd3953b074 req-2d21f41c-9998-4f02-9954-9be4a76c13c1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.375086 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-8cf3b8d8-d9b3-4064-8dd8-d2dd3953b074 req-2d21f41c-9998-4f02-9954-9be4a76c13c1 service nova] Creating event network-vif-deleted:83fe6fe2-518e-409e-8357-3935895b1c6c for instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb on nch2-master-1 Feb 12 21:18:47.389080 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-8cf3b8d8-d9b3-4064-8dd8-d2dd3953b074 req-2d21f41c-9998-4f02-9954-9be4a76c13c1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127673 Feb 12 21:18:47.389080 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2096/4103] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:18:47.496844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:47.498421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:47.512583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.512583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.512583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.512583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.664560 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71ec6a21-0b37-4678-a06b-2ce4a9c4ee65 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "DELETE /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 204 len: 0 microversion: 2.1 time: 0.590106 Feb 12 21:18:47.665171 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2008/4104] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:18:47 2022] DELETE /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:18:47.673855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:47.673855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:47.689805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.692259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.694034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.695617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.749676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:47.766042 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-15385934-78e3-40f1-bf0a-d0bcf0a63e5f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 200 len: 1286 microversion: 2.1 time: 0.277036 Feb 12 21:18:47.772639 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2097/4105] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:47 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 1286 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:47.789147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:47.792821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:47.812205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.814200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:47.817924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:47.822429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:48.413305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:48.424751 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7514f4c-217c-453b-b7ca-dbb52198898a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.758310 Feb 12 21:18:48.426251 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2009/4106] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:47 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:48.436515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:48.437751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:48.447996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:48.448670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:48.451704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:48.452334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:48.556732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:48.577511 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2054c991-4734-4c46-b262-ce0878cf3284 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1491 microversion: 2.1 time: 0.802085 Feb 12 21:18:48.579818 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2098/4107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:47 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1491 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:48.627142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:48.637031 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9bbbd884-8fa3-4cab-bb90-475899dae7f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.209571 Feb 12 21:18:48.648343 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2010/4108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:48 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:48.854922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:48.856468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:48.887138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:48.888589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:48.890151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:48.891013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:48.915486 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb could not be found. Feb 12 21:18:48.916282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:18:48.917490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d27697cd-9e7d-4360-8d09-595d9272b700 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 404 len: 111 microversion: 2.1 time: 0.084651 Feb 12 21:18:48.919028 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2099/4109] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:48 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:18:49.105587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1687625892", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2a37ce5d-ea03-44d4-9654-27bdafea49d9"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:49.160284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] validate_networks() for [('2a37ce5d-ea03-44d4-9654-27bdafea49d9', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:18:49.445598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:49.450190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:49.471100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:49.471100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:49.471396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:49.475551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:49.679413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:49.703460 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8efc748d-a5be-4237-aa9b-bb0b1a1efb4c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.263720 Feb 12 21:18:49.718565 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2100/4110] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:49 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:49.724812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:49.733930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:49.747103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:49.749243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:49.750372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:49.752365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.118220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:50.131737 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de83dd29-33d9-4f7e-9081-4b1597538dd2 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1491 microversion: 2.1 time: 0.409222 Feb 12 21:18:50.132796 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2101/4111] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:49 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1491 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:50.150224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:50.153624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:50.168108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.168568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.169396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.169858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.172850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:50.173343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:50.173810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:50.174225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:50.174636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:50.188551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.189334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.190573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.191552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.220472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:18:50.223876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Getting quotas for user 7af0023ef6e54079aa852f3d20e829f0 and project e88ed10d0c57403dbc48251e998fbd1a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:18:50.239530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:18:50.244330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:18:50.519639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de93cc77-06bb-4b7c-92cb-c2107b2cd671 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418152 Feb 12 21:18:50.520566 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2011/4112] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:18:50.526398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-27f8fdb9-4ab1-49d8-bdb4-2d227ec94f97 req-1efe5704-2eb0-4679-8b42-16227a026412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265e978d-6902-435c-9dc8-2977135fa92a", "name": "network-vif-plugged", "status": "completed", "tag": "38352d0d-4c76-4e91-9225-8c4272270ad6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:50.532365 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:50.532365 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:18:50.564279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-27f8fdb9-4ab1-49d8-bdb4-2d227ec94f97 req-1efe5704-2eb0-4679-8b42-16227a026412 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.565144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-27f8fdb9-4ab1-49d8-bdb4-2d227ec94f97 req-1efe5704-2eb0-4679-8b42-16227a026412 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.590550 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-27f8fdb9-4ab1-49d8-bdb4-2d227ec94f97 req-1efe5704-2eb0-4679-8b42-16227a026412 service nova] Creating event network-vif-plugged:38352d0d-4c76-4e91-9225-8c4272270ad6 for instance 265e978d-6902-435c-9dc8-2977135fa92a on nch2-master-1 Feb 12 21:18:50.605970 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-27f8fdb9-4ab1-49d8-bdb4-2d227ec94f97 req-1efe5704-2eb0-4679-8b42-16227a026412 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078078 Feb 12 21:18:50.611696 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2012/4113] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:50.632312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d548c896-17cc-4f90-8806-0200b5540bd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:50.633025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d548c896-17cc-4f90-8806-0200b5540bd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:50.725507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:50.740949 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-055a2bcc-e2e6-4e0a-8a17-b04a313cb8d6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.602486 Feb 12 21:18:50.744560 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2102/4114] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:50 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:50.754416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:50.760486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:50.772950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.773468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.778512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:50.779233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:50.910633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d548c896-17cc-4f90-8806-0200b5540bd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:50.925879 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d548c896-17cc-4f90-8806-0200b5540bd9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1215 microversion: 2.1 time: 0.311144 Feb 12 21:18:50.926667 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2013/4115] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:50 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:51.149940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:51.150813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:51.167199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:51.167663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:51.170361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:51.170361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:51.620841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:51.628561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8fffc1ba-359a-4295-889c-523e455e2649 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1491 microversion: 2.1 time: 0.482846 Feb 12 21:18:51.632635 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2014/4116] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:51 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1491 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:51.750250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:51.764480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:51.764480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:51.765070 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bef9e2f2-0dc3-4a21-a2e9-aba417f54101 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 1.019788 Feb 12 21:18:51.765070 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2103/4117] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:50 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:51.772624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:51.773071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:51.773934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:51.774357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:51.944849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:51.945109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:51.955704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:51.956320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:51.958599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:51.959789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.137091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:52.180579 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-791f4fa3-2314-40da-8a95-1eb68a1f8697 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1219 microversion: 2.1 time: 0.240074 Feb 12 21:18:52.182847 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2104/4118] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:51 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:52.216702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3a1b901b-f16b-4a9c-a189-a68de68f434d req-ea8ff11b-a750-40d9-884a-09a76d0596a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714a1949-e3c7-4d02-9972-0d3aa74311af", "name": "network-vif-deleted", "tag": "05bf65a0-d7cd-46e3-8256-7885b95b7048"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:52.221950 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:18:52.221950 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:18:52.247009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3a1b901b-f16b-4a9c-a189-a68de68f434d req-ea8ff11b-a750-40d9-884a-09a76d0596a8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:52.250432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3a1b901b-f16b-4a9c-a189-a68de68f434d req-ea8ff11b-a750-40d9-884a-09a76d0596a8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.296315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3a1b901b-f16b-4a9c-a189-a68de68f434d req-ea8ff11b-a750-40d9-884a-09a76d0596a8 service nova] Creating event network-vif-deleted:05bf65a0-d7cd-46e3-8256-7885b95b7048 for instance 714a1949-e3c7-4d02-9972-0d3aa74311af on nch1-master-1 Feb 12 21:18:52.322425 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3a1b901b-f16b-4a9c-a189-a68de68f434d req-ea8ff11b-a750-40d9-884a-09a76d0596a8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103788 Feb 12 21:18:52.322425 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2105/4119] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:18:52.468425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:52.479224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8673919b-42c8-4d30-a0fe-a37ceff96e72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1293 microversion: 2.1 time: 0.723541 Feb 12 21:18:52.482407 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2015/4120] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:51 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1293 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:52.658001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:52.659093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:52.687913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:52.688742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.690111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:52.690885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.780065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:52.780933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:52.795037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:52.795820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.799225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:52.799356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.854824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:52.862433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:52.863338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lazy-loading 'fault' on Instance uuid 714a1949-e3c7-4d02-9972-0d3aa74311af {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:18:52.936239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b2541501314a6991b5b4e81289c117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '036d2491a97d486eb196e0cdafa05500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:52.950338 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b8134e94-c9f6-4311-809f-5e5c0d07ef67 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 200 len: 1304 microversion: 2.1 time: 0.305477 Feb 12 21:18:52.961087 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2106/4121] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:52 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 1304 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:53.199283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:53.205942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:53.210712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:53.211555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:53.218466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:53.219235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:53.373592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:53.382342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:53.382779 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d2c096d0-beb4-485b-9326-3da2f74f0788 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.606649 Feb 12 21:18:53.387096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2016/4122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:52 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:53.398267 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-09ca9344-3cec-40f1-bf9b-73c8a30f197f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1267 microversion: 2.1 time: 0.202719 Feb 12 21:18:53.402027 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2107/4123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:53 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:53.497782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:53.498694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:53.508875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:53.515926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:53.517043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:53.517680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:53.973777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:53.974491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] [instance: 714a1949-e3c7-4d02-9972-0d3aa74311af] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:53.989631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:53.991840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:53.992953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:53.993222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:54.047369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] HTTP exception thrown: Instance 714a1949-e3c7-4d02-9972-0d3aa74311af could not be found. Feb 12 21:18:54.049227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] Returning 404 to user: Instance 714a1949-e3c7-4d02-9972-0d3aa74311af could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:18:54.052253 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fa23ba6-fc5c-44d4-84ea-67a84226aff5 tempest-ServerRescueTestJSON-48748388 tempest-ServerRescueTestJSON-48748388-project] 10.222.0.31 "GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af" status: 404 len: 111 microversion: 2.1 time: 0.082521 Feb 12 21:18:54.055983 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2108/4124] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:53 2022] GET /compute/v2.1/servers/714a1949-e3c7-4d02-9972-0d3aa74311af => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:18:54.403845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:54.405517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:54.422385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:54.423504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:54.428750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:54.428750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:54.844816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:54.855474 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9c8d496-2f85-409f-a2e8-9799c74f2e59 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.459271 Feb 12 21:18:54.856107 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2109/4125] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:54 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:18:54.861543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:54.861976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:54.869275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:54.869794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:54.870610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:54.871054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:54.966538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:54.979140 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6cf08dd6-8f82-433c-b0f0-fee03ce19905 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1273 microversion: 2.1 time: 0.120112 Feb 12 21:18:54.980037 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2110/4126] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:54 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:55.097651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:55.106094 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-65536df2-b556-44cb-a240-e458dc47a6df tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1472 microversion: 2.1 time: 1.611773 Feb 12 21:18:55.106535 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2017/4127] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:53 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1472 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:55.284788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1408617213", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:55.444607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:18:55.874924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:55.875550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:55.891040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:55.891699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:55.892701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:55.893305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:56.383847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:56.387262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:56.387262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:56.387262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:56.387262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:56.397870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:56.398799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:56.399840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:56.400492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:56.422655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:18:56.430237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:18:56.445545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:18:56.448566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e5f0bff2-ccca-4137-b397-1212abad0f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:18:56.582795 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-769660b3-7805-4397-ac60-10e78dcc02ad tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304057 Feb 12 21:18:56.586971 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2111/4128] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:18:56.618872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:56.620989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:56.645219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:56.647604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:56.648617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:56.657095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:56.777063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:56.788422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a84a19d3-1ac2-4b32-a75e-572bcc583bbe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1273 microversion: 2.1 time: 0.199185 Feb 12 21:18:56.789702 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2112/4129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:56 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:56.795805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65524f17-2b44-410f-b65e-42b3aecee224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:56.796575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65524f17-2b44-410f-b65e-42b3aecee224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e5f0bff2-ccca-4137-b397-1212abad0f68] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:56.863153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65524f17-2b44-410f-b65e-42b3aecee224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e5f0bff2-ccca-4137-b397-1212abad0f68] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:18:57.024416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:57.053745 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8f93059-2286-4776-825c-180525e7d3b3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 1.178371 Feb 12 21:18:57.056523 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2018/4130] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:55 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:57.178376 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65524f17-2b44-410f-b65e-42b3aecee224 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68" status: 204 len: 0 microversion: 2.1 time: 0.386239 Feb 12 21:18:57.179853 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2113/4131] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:18:56 2022] DELETE /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:18:57.189917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-392f9b00-0b69-4131-bc53-3b9b70d4bbda tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:57.190884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-392f9b00-0b69-4131-bc53-3b9b70d4bbda tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e5f0bff2-ccca-4137-b397-1212abad0f68] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:57.309862 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-392f9b00-0b69-4131-bc53-3b9b70d4bbda tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance e5f0bff2-ccca-4137-b397-1212abad0f68 could not be found. Feb 12 21:18:57.314780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-392f9b00-0b69-4131-bc53-3b9b70d4bbda tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance e5f0bff2-ccca-4137-b397-1212abad0f68 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:18:57.320521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-392f9b00-0b69-4131-bc53-3b9b70d4bbda tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68" status: 404 len: 111 microversion: 2.1 time: 0.134330 Feb 12 21:18:57.324700 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2019/4132] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:57 2022] GET /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:18:57.506637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1069741847", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:18:57.639240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:18:57.806941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:57.807480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:57.829964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:57.831379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:57.833015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:57.833772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:58.896047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:18:58.897163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:18:58.897680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:18:58.898189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:18:58.898497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:18:58.915958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:58.916417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:58.917418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:58.917866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:58.942987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:18:58.949175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:18:58.969859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:18:58.975866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:18:59.171541 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f33bc09a-d80b-4d95-9137-48b251d0adbf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671476 Feb 12 21:18:59.172474 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2114/4133] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:18:59.186409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:59.203235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:59.243735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:59.244132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:59.244968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:18:59.255702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:18:59.518526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:59.543683 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60a7cbe4-209a-4853-9b25-19785ffa0c8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 1.739503 Feb 12 21:18:59.548080 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2020/4134] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:57 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:18:59.566123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72a26033-0946-459c-a986-22842e2241af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:18:59.566755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72a26033-0946-459c-a986-22842e2241af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:18:59.864643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:18:59.877626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-444ba18c-cedd-4486-865e-90f92a294063 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.700230 Feb 12 21:18:59.878288 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2115/4135] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:59 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:00.241676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72a26033-0946-459c-a986-22842e2241af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:00.252686 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72a26033-0946-459c-a986-22842e2241af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1221 microversion: 2.1 time: 0.703243 Feb 12 21:19:00.253476 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2021/4136] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:18:59 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1221 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:00.562560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:00.564034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:00.590650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:00.594479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:00.599849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:00.599849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:00.900065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:00.901542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:00.922720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:00.923468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:00.924414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:00.942037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:00.977052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:00.986084 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f948022-f277-40fe-b1aa-ab1da14ffbaa tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.427768 Feb 12 21:19:00.999859 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2116/4137] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:00 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:01.270470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:01.271951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:01.284678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:01.285284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:01.287467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:01.291197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:01.443908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:01.460930 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-34ae8bcf-aa57-4a39-b295-e5dd0a041a72 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1273 microversion: 2.1 time: 0.194041 Feb 12 21:19:01.461793 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2117/4138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:01 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:01.918730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:01.927027 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0dae2673-af6d-438c-b02b-56175a5a5907 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 1.031108 Feb 12 21:19:01.941804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2022/4139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:00 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:02.011418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:02.013803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:02.046091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:02.046993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:02.049081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:02.049889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:02.439497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:02.450152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-245d1957-171e-4d3c-a93f-d738d62abbc7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.445107 Feb 12 21:19:02.450948 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2118/4140] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:02 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:02.478884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:02.481284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:02.486684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:02.487386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:02.488270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:02.488724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:02.604759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:02.616100 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3fbba690-b0f4-42ca-9c9c-271dbb7212bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1291 microversion: 2.1 time: 0.142341 Feb 12 21:19:02.618793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2023/4141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:02 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1291 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:02.945495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:02.946118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:02.961760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:02.962221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:02.963029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:02.963476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:03.136830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-87940e32-83f4-4967-9939-e273acc5f95f req-8b71c04e-7a14-4ba0-936f-5094dfe13a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6db0091-cd0e-4017-8904-3f29a7eb1d8a", "tag": "38508fe6-8e66-469e-98e4-e2de52fcb172"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:03.143488 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:03.143488 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:03.162143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-87940e32-83f4-4967-9939-e273acc5f95f req-8b71c04e-7a14-4ba0-936f-5094dfe13a42 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:03.162975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-87940e32-83f4-4967-9939-e273acc5f95f req-8b71c04e-7a14-4ba0-936f-5094dfe13a42 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:03.184693 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-87940e32-83f4-4967-9939-e273acc5f95f req-8b71c04e-7a14-4ba0-936f-5094dfe13a42 service nova] Creating event network-changed:38508fe6-8e66-469e-98e4-e2de52fcb172 for instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a on nch2-master-1 Feb 12 21:19:03.192840 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-87940e32-83f4-4967-9939-e273acc5f95f req-8b71c04e-7a14-4ba0-936f-5094dfe13a42 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060013 Feb 12 21:19:03.194260 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2024/4142] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:19:03.475665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:03.476029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:03.491484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:03.491944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:03.496260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:03.496716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:03.895965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:03.906956 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcdb6ead-d452-42c5-a086-d26f88b58966 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.965899 Feb 12 21:19:03.908738 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2119/4143] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:02 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:03.925603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:03.926310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:03.941032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:03.943968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:03.944913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:03.946637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:04.073514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:04.086612 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-381d4c2f-fa91-4a9f-9636-3576eaf9bc60 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1279 microversion: 2.1 time: 0.176443 Feb 12 21:19:04.095697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2120/4144] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:03 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:04.157683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:04.174756 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6bf96a72-3808-4eb0-a437-0211c6b2db5a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.706906 Feb 12 21:19:04.175581 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2025/4145] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:03 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:04.778096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:04.779022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:04.793657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:04.794283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:04.799921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:04.800395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:04.929203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:04.930256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:04.937208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:04.938017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:04.939070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:04.940389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:05.487977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:05.499580 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-293fc495-57ad-4095-878c-633d9cd77dba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.729826 Feb 12 21:19:05.500919 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2121/4146] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:04 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:05.507877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:05.508692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:05.516398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:05.517963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:05.519680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:05.520811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:05.669425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:05.681936 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0d51e32-2263-4a1b-9c42-c169caf3a352 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.753198 Feb 12 21:19:05.685697 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2026/4147] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:04 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:05.695332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:05.695958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:05.719403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:05.719865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:05.720674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:05.721112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:06.158310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:06.171500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b554f873-8cbc-4b0c-9d10-a38301c54793 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.666876 Feb 12 21:19:06.172838 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2122/4148] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:05 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:06.518009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:06.519623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:06.527248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:06.528093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:06.529179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:06.529921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:06.673925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:06.682536 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db355b8d-fb21-4118-a2fe-13292f960fb0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.995634 Feb 12 21:19:06.683503 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2027/4149] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:05 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:06.702792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:06.704158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:06.711372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:06.711825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:06.712802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:06.713269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.063471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:07.080278 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-677b7438-cea3-4c39-9b73-f90902d48e1f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.566688 Feb 12 21:19:07.080886 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2123/4150] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:06 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:07.102193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-510772363"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:07.103661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:07.105012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:07.113967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.114421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.116619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.116755 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c817e46-0de2-4631-ae61-42d778fb8e42 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.417440 Feb 12 21:19:07.121055 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2028/4151] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:06 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:07.121203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.189992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:07.190918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:07.203363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.206584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.224613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.226332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.467663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:07.485897 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e41ec743-c82b-4de6-9e13-a8accc22f2ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.290275 Feb 12 21:19:07.485897 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2029/4152] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:07 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:07.704834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:07.708613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:07.729812 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e011a6f-e275-40bb-8255-c645ec534224 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.632120 Feb 12 21:19:07.730651 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2124/4153] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:19:07 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Feb 12 21:19:07.733168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.733663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.739283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:07.740806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.745566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:07.747631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.769345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.769836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:07.776807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:07.780958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:08.082007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:08.092594 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-decd28a8-4147-409e-8d0e-6b37ed3bd5af tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.396225 Feb 12 21:19:08.093279 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2030/4154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:07 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:08.098619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9d778da7-2261-4fdb-b67e-1963a931b97c req-e5f8bc48-175f-41eb-b30f-c8db341da72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3522148-f16e-43ef-973c-6033239d0aad", "tag": "80f6a8a7-4056-45bf-bb8c-ed6b2a0661bb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:08.101163 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:08.101163 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:08.111364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9d778da7-2261-4fdb-b67e-1963a931b97c req-e5f8bc48-175f-41eb-b30f-c8db341da72b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:08.111364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9d778da7-2261-4fdb-b67e-1963a931b97c req-e5f8bc48-175f-41eb-b30f-c8db341da72b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:08.125089 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9d778da7-2261-4fdb-b67e-1963a931b97c req-e5f8bc48-175f-41eb-b30f-c8db341da72b service nova] Creating event network-changed:80f6a8a7-4056-45bf-bb8c-ed6b2a0661bb for instance e3522148-f16e-43ef-973c-6033239d0aad on nch1-master-1 Feb 12 21:19:08.133588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9d778da7-2261-4fdb-b67e-1963a931b97c req-e5f8bc48-175f-41eb-b30f-c8db341da72b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Feb 12 21:19:08.134340 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2031/4155] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:08.145009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:08.145788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:08.153269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:08.153841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:08.154715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:08.155719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:08.210257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:08.222669 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70bd6f73-ff37-4954-b30b-06b6e1b1202a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.487466 Feb 12 21:19:08.225398 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2125/4156] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:07 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:08.494305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:08.495845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:08.504285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:08.508093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:08.511133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:08.512939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:08.602947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:08.611362 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7868d66a-5388-483b-a873-725bf2800682 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.475586 Feb 12 21:19:08.621568 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2032/4157] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:08 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:08.854733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:08.863281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4225a0b6-0735-43a8-b785-0770ac0adc08 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.375053 Feb 12 21:19:08.864289 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2126/4158] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:08 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:09.112225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:09.113762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:09.140096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.140096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.140096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.140096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.243472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:09.243472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:09.254621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.255883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.257924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.259410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.300483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:09.319415 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8d55063b-8302-49d6-a04f-686ec4048b36 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.205252 Feb 12 21:19:09.322521 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2033/4159] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:09 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:09.636187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:09.638187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:09.644858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.645488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.646966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.647725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.798501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:09.812005 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80b2fea0-63b1-4178-94aa-416a934bfb75 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.572768 Feb 12 21:19:09.814419 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2127/4160] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:09 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:09.833180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:09.847101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6e5b1c4-72ad-49d9-9378-3a7049892621 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1515 microversion: 2.1 time: 0.214482 Feb 12 21:19:09.850264 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2034/4161] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:09 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:09.881521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:09.882180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:09.888443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.889417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:09.890394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:09.890826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.065404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:10.075057 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32273965-e400-47f0-a0a2-c8fccba209b8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.198510 Feb 12 21:19:10.075682 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2128/4162] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:09 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:10.126766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-143c4bbd-0677-46b4-b221-1e0191d35663 req-7965abf2-30bd-43c9-88ff-3739280dcf2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6db0091-cd0e-4017-8904-3f29a7eb1d8a", "name": "network-vif-plugged", "status": "completed", "tag": "38508fe6-8e66-469e-98e4-e2de52fcb172"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:10.128291 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:10.128291 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:10.144209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-143c4bbd-0677-46b4-b221-1e0191d35663 req-7965abf2-30bd-43c9-88ff-3739280dcf2d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.144681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-143c4bbd-0677-46b4-b221-1e0191d35663 req-7965abf2-30bd-43c9-88ff-3739280dcf2d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.175543 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-143c4bbd-0677-46b4-b221-1e0191d35663 req-7965abf2-30bd-43c9-88ff-3739280dcf2d service nova] Creating event network-vif-plugged:38508fe6-8e66-469e-98e4-e2de52fcb172 for instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a on nch2-master-1 Feb 12 21:19:10.187744 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-143c4bbd-0677-46b4-b221-1e0191d35663 req-7965abf2-30bd-43c9-88ff-3739280dcf2d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062210 Feb 12 21:19:10.188907 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2035/4163] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:10.340237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:10.340858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:10.358941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.359411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.360218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.364227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.544898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:10.567144 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-66dc8c15-6cd3-48ec-8dd9-e13c4d9c6b2b tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.223794 Feb 12 21:19:10.582888 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2129/4164] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:10 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:10.831305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:10.832124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:10.842695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.843485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.844821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.845403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.865901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:10.866528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:10.874005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.874434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:10.875251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:10.875700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:11.014899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:11.026167 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa99116d-2e38-4ef9-b8ca-217e2cd0f2e5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1687 microversion: 2.1 time: 0.199255 Feb 12 21:19:11.036152 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2036/4165] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:10 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1687 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:11.041554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:11.049106 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6616b76a-4307-40f4-ad88-df479977dd03 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1533 microversion: 2.1 time: 0.187350 Feb 12 21:19:11.049726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2130/4166] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:10 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1533 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:11.091479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:11.096989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:11.098234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:11.098700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:11.100010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:11.100451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:11.266331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:11.273906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-046dd09b-6b5a-4174-a16b-db15e30fa935 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.186029 Feb 12 21:19:11.274489 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2037/4167] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:11 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:11.587055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:11.587691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:11.597401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:11.598468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:11.600802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:11.601270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:11.751105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:11.759074 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b096ea0f-f40c-42b7-a975-aac0fd51935e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1315 microversion: 2.1 time: 0.176674 Feb 12 21:19:11.759715 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2131/4168] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:11 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:12.044513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:12.045506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:12.058283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.061398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.062837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.064901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.067377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:12.068005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:12.076181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.076821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.077828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.078428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.296185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:12.316087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b7347558-691e-4308-95b6-c7bd26839d3b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.241939 Feb 12 21:19:12.316087 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2132/4169] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:12 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:12.316087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ee9d69c7-04e4-4b79-b6aa-1d486d8fbf1b req-22ac9da3-7a5d-4dfd-8626-eb485a44f9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-unplugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:12.316952 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:12.316952 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:12.326571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ee9d69c7-04e4-4b79-b6aa-1d486d8fbf1b req-22ac9da3-7a5d-4dfd-8626-eb485a44f9f8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.327278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ee9d69c7-04e4-4b79-b6aa-1d486d8fbf1b req-22ac9da3-7a5d-4dfd-8626-eb485a44f9f8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.344393 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ee9d69c7-04e4-4b79-b6aa-1d486d8fbf1b req-22ac9da3-7a5d-4dfd-8626-eb485a44f9f8 service nova] Creating event network-vif-unplugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:19:12.352327 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ee9d69c7-04e4-4b79-b6aa-1d486d8fbf1b req-22ac9da3-7a5d-4dfd-8626-eb485a44f9f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042634 Feb 12 21:19:12.353717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2133/4170] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:12.360619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:12.361684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:12.371471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.372279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.373682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.374973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.425659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:12.429388 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21597fe1-db34-48bd-a27f-e5ef52105289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1687 microversion: 2.1 time: 0.388921 Feb 12 21:19:12.433856 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2038/4171] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:12 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1687 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:12.554138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:12.564658 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f16d547d-c3e3-40a6-9f57-682d9f37334b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.209289 Feb 12 21:19:12.589922 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2134/4172] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:12 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:12.779084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:12.781759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:12.790864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.791641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:12.792889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:12.793903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:13.182052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:13.200387 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23788961-43d4-4361-943e-f999b43678f5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1502 microversion: 2.1 time: 0.426074 Feb 12 21:19:13.214379 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2039/4173] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:12 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1502 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:13.222476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:13.223955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:13.235795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:13.235795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:13.235795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:13.235795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:13.265336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lazy-loading 'flavor' on Instance uuid e6db0091-cd0e-4017-8904-3f29a7eb1d8a {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:19:13.323948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:13.329944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:13.339717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:13.340174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:13.341894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:13.342991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:13.720379 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-463833db-4c65-4ca3-b36f-1ddac8659e86 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "POST /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a/action" status: 202 len: 0 microversion: 2.1 time: 0.503057 Feb 12 21:19:13.724585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2135/4174] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:19:13 2022] POST /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:19:13.741049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:13.742178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:13.757103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:13.763892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:13.765263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:13.766306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.040508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:14.053704 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ba144d7a-14d7-4fe3-954b-216f1604b8a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.730780 Feb 12 21:19:14.062998 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2040/4175] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:13 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:14.074002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:14.078462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:14.095018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:14.095982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.096890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:14.098648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.520064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:14.539907 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed861d88-e22c-45e6-8143-475c7dd8f597 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.475347 Feb 12 21:19:14.544631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2041/4176] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:14 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:14.556787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:14.564596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:14.577569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:14.579286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.583814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:14.587365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.856381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:14.867576 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-565e81da-6668-4714-af6f-22b5894f6ee0 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1493 microversion: 2.1 time: 0.321693 Feb 12 21:19:14.870160 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2042/4177] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:14 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1493 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:14.890623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:14.896962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:14.904389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:14.905898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.906884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:14.909448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:14.964486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:19:15.074661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:15.082903 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eebdcfdc-2bed-425a-b964-58f2e429115a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 1.356663 Feb 12 21:19:15.088202 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2136/4178] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:13 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:15.098018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1274d49c-a2c6-4e2c-bd1c-fc3d29838810 req-c247c17f-571f-4011-9cc1-5ba4b416a255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0f23fe-5df2-49f4-85af-3e16dabe1ca5", "name": "network-vif-unplugged", "status": "completed", "tag": "34cd3a96-20f0-4da5-9fc7-b28ab17e9dda"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:15.102309 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:15.102309 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:15.144657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1274d49c-a2c6-4e2c-bd1c-fc3d29838810 req-c247c17f-571f-4011-9cc1-5ba4b416a255 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.145234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1274d49c-a2c6-4e2c-bd1c-fc3d29838810 req-c247c17f-571f-4011-9cc1-5ba4b416a255 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:15.171602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1274d49c-a2c6-4e2c-bd1c-fc3d29838810 req-c247c17f-571f-4011-9cc1-5ba4b416a255 service nova] Creating event network-vif-unplugged:34cd3a96-20f0-4da5-9fc7-b28ab17e9dda for instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 on nch1-master-1 Feb 12 21:19:15.187171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1274d49c-a2c6-4e2c-bd1c-fc3d29838810 req-c247c17f-571f-4011-9cc1-5ba4b416a255 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097357 Feb 12 21:19:15.188136 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2137/4179] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:15.203836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:15.204470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:15.213687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.235423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:15.241813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.249983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:15.390440 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9e175259-2364-4f0b-88fd-55278d2815ac tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 204 len: 0 microversion: 2.1 time: 0.502119 Feb 12 21:19:15.391131 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2043/4180] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:14 2022] DELETE /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:19:15.400428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:15.401240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:15.409574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.413919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:15.415018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.418746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:15.729878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:15.730672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:15.759315 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db0e7a56-1cf2-4fd4-88b5-3b817e1baf57 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1499 microversion: 2.1 time: 0.363482 Feb 12 21:19:15.762825 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27f31ab7-4a96-4cd8-bd23-56ad6ea1b498 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.573465 Feb 12 21:19:15.772772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2138/4181] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:15 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:15.773427 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2044/4182] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:15 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1499 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:15.788954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:15.791496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:15.811914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.812387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:15.813800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:15.814259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:16.106307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:16.107710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:16.119275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:16.124466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:16.126491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:16.128495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:16.374863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:16.388635 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7fcd8d9d-185f-465b-899f-661d73f5aa00 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.610860 Feb 12 21:19:16.403493 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2045/4183] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:15 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:16.792874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:16.793958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:16.812940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:16.816438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:16.825306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:16.826717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:17.389818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:17.403045 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb6d598e-c282-4c20-85bb-a67de50eafdf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 1.298395 Feb 12 21:19:17.407983 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2139/4184] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:16 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:17.414155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:17.433426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:17.451330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:17.452078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:17.453322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:17.453964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:17.623742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:17.647642 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e6a7c6d-7f3d-41c1-a6a4-a8f189e790a5 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1499 microversion: 2.1 time: 0.853205 Feb 12 21:19:17.648349 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2046/4185] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:16 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1499 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:17.672971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-73e59f52-dd2b-4de0-bb03-b3cbd47e1cc7 req-e72a734b-680a-4a85-b95d-f590b5c3f0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-plugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:17.674904 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:17.674904 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:17.690468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-73e59f52-dd2b-4de0-bb03-b3cbd47e1cc7 req-e72a734b-680a-4a85-b95d-f590b5c3f0ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:17.694796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-73e59f52-dd2b-4de0-bb03-b3cbd47e1cc7 req-e72a734b-680a-4a85-b95d-f590b5c3f0ba service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:17.723689 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-73e59f52-dd2b-4de0-bb03-b3cbd47e1cc7 req-e72a734b-680a-4a85-b95d-f590b5c3f0ba service nova] Creating event network-vif-plugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:19:17.737800 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-73e59f52-dd2b-4de0-bb03-b3cbd47e1cc7 req-e72a734b-680a-4a85-b95d-f590b5c3f0ba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087160 Feb 12 21:19:17.739793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2047/4186] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:17.755953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:17.761379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:17.778526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:17.784970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:17.784970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:17.784970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:17.864749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:17.884004 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a68def1-5111-4f8b-bf41-ae8a5bee34d2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.473920 Feb 12 21:19:17.885427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2140/4187] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:17 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:18.430969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:18.431757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:18.450470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:18.454465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:18.458423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:18.459901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:19.015260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:19.048424 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-44effbe7-5d25-439d-803e-ebb2988f40a7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 1.300603 Feb 12 21:19:19.049936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2048/4188] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:17 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:19.059665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:19.062009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:19.079121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:19.081700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:19.081700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:19.081700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:19.186112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:19.202038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be1d73ce-f158-43a2-9cd0-eab8676b87a0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.774244 Feb 12 21:19:19.203584 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2141/4189] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:18 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:19.220912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:19.224115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:19.234378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:19.235101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:19.236124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:19.236611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:19.723136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:19.743737 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-833c40ca-495c-4e0c-907a-9a0478e430d8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.528433 Feb 12 21:19:19.757497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2142/4190] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:19 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:19.800773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e61cbd6d-a1ff-4491-ad75-1498a4bcc35a req-57ee6c3d-18c2-4e12-9773-31759012c9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3522148-f16e-43ef-973c-6033239d0aad", "name": "network-vif-plugged", "status": "completed", "tag": "80f6a8a7-4056-45bf-bb8c-ed6b2a0661bb"}, {"server_uuid": "ac0f23fe-5df2-49f4-85af-3e16dabe1ca5", "name": "network-vif-plugged", "status": "completed", "tag": "34cd3a96-20f0-4da5-9fc7-b28ab17e9dda"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:19.803076 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:19.803076 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:19.822157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e61cbd6d-a1ff-4491-ad75-1498a4bcc35a req-57ee6c3d-18c2-4e12-9773-31759012c9b0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:19.822610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e61cbd6d-a1ff-4491-ad75-1498a4bcc35a req-57ee6c3d-18c2-4e12-9773-31759012c9b0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:19.854259 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e61cbd6d-a1ff-4491-ad75-1498a4bcc35a req-57ee6c3d-18c2-4e12-9773-31759012c9b0 service nova] Creating event network-vif-plugged:80f6a8a7-4056-45bf-bb8c-ed6b2a0661bb for instance e3522148-f16e-43ef-973c-6033239d0aad on nch1-master-1 Feb 12 21:19:19.858556 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e61cbd6d-a1ff-4491-ad75-1498a4bcc35a req-57ee6c3d-18c2-4e12-9773-31759012c9b0 service nova] Creating event network-vif-plugged:34cd3a96-20f0-4da5-9fc7-b28ab17e9dda for instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 on nch1-master-1 Feb 12 21:19:19.875051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e61cbd6d-a1ff-4491-ad75-1498a4bcc35a req-57ee6c3d-18c2-4e12-9773-31759012c9b0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078061 Feb 12 21:19:19.880833 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2143/4191] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:19:20.071542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:20.072671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:20.083093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.083093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:20.083863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.084265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:20.329252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:20.348569 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e7752b9-4035-4ae1-8f64-c05011fe6848 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1499 microversion: 2.1 time: 1.297373 Feb 12 21:19:20.351748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2049/4192] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:19 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1499 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:20.412897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:20.413929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:20.472712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.476725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:20.478174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.478873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:20.749592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:20.773349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31979679-7ab4-4d0d-a7a3-b13395104c36 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.706227 Feb 12 21:19:20.774357 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2144/4193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:20 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:20.795752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6c62f91b-7935-41d7-88d1-028f9efb12bb req-d9b85afc-0446-476d-a1d6-344037e82439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6db0091-cd0e-4017-8904-3f29a7eb1d8a", "name": "network-vif-deleted", "tag": "38508fe6-8e66-469e-98e4-e2de52fcb172"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:20.797689 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:20.797689 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:20.806601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6c62f91b-7935-41d7-88d1-028f9efb12bb req-d9b85afc-0446-476d-a1d6-344037e82439 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.807200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6c62f91b-7935-41d7-88d1-028f9efb12bb req-d9b85afc-0446-476d-a1d6-344037e82439 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:20.826704 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6c62f91b-7935-41d7-88d1-028f9efb12bb req-d9b85afc-0446-476d-a1d6-344037e82439 service nova] Creating event network-vif-deleted:38508fe6-8e66-469e-98e4-e2de52fcb172 for instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a on nch2-master-1 Feb 12 21:19:20.832092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6c62f91b-7935-41d7-88d1-028f9efb12bb req-d9b85afc-0446-476d-a1d6-344037e82439 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052032 Feb 12 21:19:20.833277 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2145/4194] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:20.851910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:20.859089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:20.867553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.868090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:20.868975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:20.869545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:21.198402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:21.206403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b824f473-2868-4eb4-a87c-40c857234b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.371476 Feb 12 21:19:21.213747 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2146/4195] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:20 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:21.367231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:21.367858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:21.377185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:21.377692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:21.378595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:21.378999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:21.461014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:21.461501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:21.461975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lazy-loading 'fault' on Instance uuid e6db0091-cd0e-4017-8904-3f29a7eb1d8a {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:19:21.548009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af0023ef6e54079aa852f3d20e829f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e88ed10d0c57403dbc48251e998fbd1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:21.559733 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2a8c847-8593-44e7-93c4-db3e9b9b25eb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 200 len: 1305 microversion: 2.1 time: 0.195248 Feb 12 21:19:21.572442 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2147/4196] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:21 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 1305 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:21.731515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:21.740043 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f078c15f-0129-4d39-ab2f-721de3bbe9c2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 1.386409 Feb 12 21:19:21.743104 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2050/4197] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:20 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:21.793628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:21.795034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:21.816116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:21.816595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:21.818065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:21.818520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.142967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:22.161728 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-123da2e7-e33e-47bc-b956-b8b670618002 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1321 microversion: 2.1 time: 0.373610 Feb 12 21:19:22.168381 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2148/4198] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:21 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:22.231557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.232316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.245218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.245834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.246741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.247295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.563779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:22.581328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.582211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.594163 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe21d9b8-6726-4865-868b-2d793f3fe48c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1521 microversion: 2.1 time: 0.366054 Feb 12 21:19:22.608029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2051/4199] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:22 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:22.609963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.610708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.611759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.612511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.629804 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a could not be found. Feb 12 21:19:22.631972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:22.631972 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b7817a4e-3ef6-4dd1-bf45-10c0f287d0c7 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 404 len: 111 microversion: 2.1 time: 0.055948 Feb 12 21:19:22.640239 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2149/4200] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:22 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:22.644090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.644869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.653289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.655128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.655677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.656340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.673680 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a could not be found. Feb 12 21:19:22.674660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:22.679479 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-feccd2da-e9d1-4b15-a123-676d7a20ad62 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 404 len: 111 microversion: 2.1 time: 0.039555 Feb 12 21:19:22.683452 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2052/4201] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:22 2022] DELETE /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:22.690374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.694032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: e6db0091-cd0e-4017-8904-3f29a7eb1d8a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.701665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.702194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.703945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.704410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.728793 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a could not be found. Feb 12 21:19:22.729429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance e6db0091-cd0e-4017-8904-3f29a7eb1d8a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:22.730337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37b6884d-16bb-4d99-9e98-743b43b904cb tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a" status: 404 len: 111 microversion: 2.1 time: 0.045677 Feb 12 21:19:22.731570 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2150/4202] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:22 2022] GET /compute/v2.1/servers/e6db0091-cd0e-4017-8904-3f29a7eb1d8a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:19:22.746593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.747903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.763014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.766576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.767948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.770507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.772504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.773168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.791447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.792187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.794369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.795533 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb could not be found. Feb 12 21:19:22.796288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.796648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:22.797676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36491d03-2185-4411-8198-c55885c43b72 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 404 len: 111 microversion: 2.1 time: 0.056057 Feb 12 21:19:22.798799 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2053/4203] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:22 2022] DELETE /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:22.816950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.820994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.837295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.838130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.858189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.858189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.890864 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb could not be found. Feb 12 21:19:22.892008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 53e7ee65-5b25-44eb-85b6-3eadf4c45aeb could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:22.893045 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c6e476e-9c34-49d4-a41c-b7eb6ee09385 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb" status: 404 len: 111 microversion: 2.1 time: 0.084722 Feb 12 21:19:22.895049 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2054/4204] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:22 2022] GET /compute/v2.1/servers/53e7ee65-5b25-44eb-85b6-3eadf4c45aeb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:22.909172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:22.913682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:22.945593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.945593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.945593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:22.947375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:22.993245 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 43260354-ea4d-4384-9956-3ded0eb6b91c could not be found. Feb 12 21:19:22.994136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 43260354-ea4d-4384-9956-3ded0eb6b91c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:22.997237 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a38af0d1-4ce0-4f13-878b-a10973867559 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 404 len: 111 microversion: 2.1 time: 0.097116 Feb 12 21:19:23.000604 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2055/4205] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:22 2022] DELETE /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:23.015839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:23.019826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 43260354-ea4d-4384-9956-3ded0eb6b91c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:23.039928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.042158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.045141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.045695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.094868 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 43260354-ea4d-4384-9956-3ded0eb6b91c could not be found. Feb 12 21:19:23.095524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 43260354-ea4d-4384-9956-3ded0eb6b91c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:23.096397 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e66d081-eacc-45c0-b07e-db934e13c210 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c" status: 404 len: 111 microversion: 2.1 time: 0.092735 Feb 12 21:19:23.101844 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2056/4206] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:23 2022] GET /compute/v2.1/servers/43260354-ea4d-4384-9956-3ded0eb6b91c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:23.119008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:23.119531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:23.140176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.142221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.169829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.170811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.218211 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 could not be found. Feb 12 21:19:23.219767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:23.222917 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-533b5176-c258-477a-af8b-257c9ab1b8a9 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 404 len: 111 microversion: 2.1 time: 0.113943 Feb 12 21:19:23.224477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2057/4207] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:23 2022] DELETE /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:19:23.237423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:23.238046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:23.259434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.261711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.263136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.264935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.542044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:23.554403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dcaab5f0-94e2-4d15-974c-d4254627dbcf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.796103 Feb 12 21:19:23.555653 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2151/4208] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:22 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:23.576575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:23.577202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: fc9519e0-9ff9-49f2-898e-a7cea01ca2c1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:23.593133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.593651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.594461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.600933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.637870 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 could not be found. Feb 12 21:19:23.638481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:23.639594 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fc08559-1225-40be-a912-7cc0ee46da7f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1" status: 404 len: 111 microversion: 2.1 time: 0.067127 Feb 12 21:19:23.641951 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2152/4209] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:23 2022] GET /compute/v2.1/servers/fc9519e0-9ff9-49f2-898e-a7cea01ca2c1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:23.650991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:23.651555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:23.670596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.672579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.673478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.673909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.918050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:23.932434 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-818b9af0-d061-4cce-9e30-624b29a26a74 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1500 microversion: 2.1 time: 0.706686 Feb 12 21:19:23.936460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2058/4210] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:23 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1500 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:23.952493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:23.955644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:23.972548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.973022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:23.974839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:23.974945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.063390 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c could not be found. Feb 12 21:19:24.069422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:24.070633 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-162f26b9-7cf6-492a-8d08-13be4901dcfe tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c" status: 404 len: 111 microversion: 2.1 time: 0.132962 Feb 12 21:19:24.076000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2059/4211] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:23 2022] DELETE /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:24.082859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:24.089304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:24.103054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.118111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.119277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.120252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.209579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:24.219038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6979fcd3-6c5c-4090-937e-57e7034aa708 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1506 microversion: 2.1 time: 0.574588 Feb 12 21:19:24.227035 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2153/4212] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:23 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:24.240403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:24.246835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:24.260832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.261286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.262201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.262638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.293493 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c could not be found. Feb 12 21:19:24.295115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 1a4e12dc-6f73-4d50-ab2f-1cec2114a33c could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:24.296227 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-099c833e-89d4-4fc3-bd74-dc11e52aa07a tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c" status: 404 len: 111 microversion: 2.1 time: 0.068190 Feb 12 21:19:24.303290 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2154/4213] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:24 2022] GET /compute/v2.1/servers/1a4e12dc-6f73-4d50-ab2f-1cec2114a33c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:24.310222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:24.311083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:24.325966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.326692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.330422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.330422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.883306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:24.899218 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6cf31d55-9511-4fe8-b41c-634337199b99 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1500 microversion: 2.1 time: 0.821781 Feb 12 21:19:24.899842 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2060/4214] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:24 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1500 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:24.911913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:24.914433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:24.934089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.934089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.936545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:24.937256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:24.961725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:24.979635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6726fe2a-66f7-40a1-91b0-dbe52ed6b0d9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 200 len: 1506 microversion: 2.1 time: 0.674742 Feb 12 21:19:24.983190 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2155/4215] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:24 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:25.028261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:25.029342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:25.058284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:25.058792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:25.061623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:25.062805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:25.111550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:19:25.440829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:25.451940 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61ff8be5-c581-4b53-83fa-9063b0e5f119 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.549480 Feb 12 21:19:25.466757 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2061/4216] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:24 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:25.477737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:25.497926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:25.527061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:25.543184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:25.544201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:25.558201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:25.607169 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7587a13f-6c65-4552-bb2d-9c408f21b1ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 204 len: 0 microversion: 2.1 time: 0.599799 Feb 12 21:19:25.608402 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2156/4217] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:24 2022] DELETE /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:19:25.624244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:25.637255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:25.673942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:25.680429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:25.691925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:25.696537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:25.711137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:19:26.252260 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-329ff046-2c58-403b-975e-8e134ac5c640 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 204 len: 0 microversion: 2.1 time: 0.784097 Feb 12 21:19:26.256567 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2062/4218] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:25 2022] DELETE /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:19:26.483026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:26.485913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:26.509789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:26.511420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:26.513637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:26.525383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:26.607129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:26.624471 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98fcacb3-7ee6-48a0-a2e6-ecf120b4471c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1506 microversion: 2.1 time: 1.009755 Feb 12 21:19:26.634658 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2157/4219] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:25 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1506 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:26.639935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1411785175", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "19170c93-d9ce-4497-9280-91aac6f17f7b"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:26.774235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] validate_networks() for [('19170c93-d9ce-4497-9280-91aac6f17f7b', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:19:28.661960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:19:28.663182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:19:28.663899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:19:28.664491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:19:28.665994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:19:28.693565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:28.693709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:28.694595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:28.695050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:28.760071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Getting quotas for project cf7e0df130604d2b9dab6a7fb331f5c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:28.796551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:28.810790 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-36ae57e6-a8db-4e0c-a236-5ecf952a9d98 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 2.333073 Feb 12 21:19:28.811399 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2063/4220] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:26 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:28.815279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Getting quotas for user c2d612e20334459eb9f7b2cdee9320bc and project cf7e0df130604d2b9dab6a7fb331f5c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:28.850012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:28.857600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:28.877016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:19:28.886259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:19:28.893556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:28.896701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:28.896701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:28.900215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.126537 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-55f83f1c-0ee0-433c-9291-b1a60797d76b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.490640 Feb 12 21:19:29.127455 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2158/4221] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:19:29.139075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:29.140000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:29.151433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.152158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.153179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.153830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.196134 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. Feb 12 21:19:29.196763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:29.201971 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-728cceec-8541-46c4-a5b1-18dfbc421b28 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 404 len: 111 microversion: 2.1 time: 0.063076 Feb 12 21:19:29.208674 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2159/4222] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:29 2022] DELETE /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:29.229760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17625015-9447-483e-aa00-20ec7c627b5e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:29.229760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-17625015-9447-483e-aa00-20ec7c627b5e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:29.685235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-17625015-9447-483e-aa00-20ec7c627b5e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:29.694238 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-17625015-9447-483e-aa00-20ec7c627b5e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1218 microversion: 2.1 time: 0.482002 Feb 12 21:19:29.697742 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2160/4223] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:29 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1218 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:29.715048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:29.715804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 0ae9bb06-a90d-4b9b-914d-6304f6312070] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:29.734610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.735055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.742391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.756174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.781568 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. Feb 12 21:19:29.782588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 0ae9bb06-a90d-4b9b-914d-6304f6312070 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:29.784387 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88ae1494-6ea1-46ce-b4af-7d0d1e1dbc8e tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070" status: 404 len: 111 microversion: 2.1 time: 0.085251 Feb 12 21:19:29.785898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2161/4224] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:29 2022] GET /compute/v2.1/servers/0ae9bb06-a90d-4b9b-914d-6304f6312070 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:29.803156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:29.803156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:29.810068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.810584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.811510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.812019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.839484 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 37517a7b-4ae7-408a-86d8-c16203fef034 could not be found. Feb 12 21:19:29.840138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 37517a7b-4ae7-408a-86d8-c16203fef034 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:29.841065 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a3c101f-be6e-4815-a7a7-4c8c6c5b8148 tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "DELETE /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 404 len: 111 microversion: 2.1 time: 0.048333 Feb 12 21:19:29.842025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2162/4225] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:19:29 2022] DELETE /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:29.850168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:29.851070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:29.861689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.869746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:29.871084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:29.871817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:30.080900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:30.101572 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6dcfb109-5f24-456f-a577-829249d6c453 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1506 microversion: 2.1 time: 1.275131 Feb 12 21:19:30.102751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2064/4226] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:28 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1506 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:30.118903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:30.120102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] [instance: 37517a7b-4ae7-408a-86d8-c16203fef034] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:30.139587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:30.140808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:30.146665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:30.146665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:30.170203 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] HTTP exception thrown: Instance 37517a7b-4ae7-408a-86d8-c16203fef034 could not be found. Feb 12 21:19:30.171279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] Returning 404 to user: Instance 37517a7b-4ae7-408a-86d8-c16203fef034 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:30.172584 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee6b142f-48b4-436a-b19e-55a4b18b158f tempest-DeleteServersTestJSON-1687401015 tempest-DeleteServersTestJSON-1687401015-project] 10.222.0.31 "GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034" status: 404 len: 111 microversion: 2.1 time: 0.067209 Feb 12 21:19:30.174348 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2065/4227] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:30 2022] GET /compute/v2.1/servers/37517a7b-4ae7-408a-86d8-c16203fef034 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:30.711957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-da04c9b3-96c0-4f69-b6bf-8c13637f16ca tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:30.712731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-da04c9b3-96c0-4f69-b6bf-8c13637f16ca tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:30.981647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-da04c9b3-96c0-4f69-b6bf-8c13637f16ca tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:30.994854 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-da04c9b3-96c0-4f69-b6bf-8c13637f16ca tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1218 microversion: 2.1 time: 0.284670 Feb 12 21:19:31.000897 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2066/4228] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:30 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1218 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:31.017960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a13ea30e-ad35-4534-9ce5-019322480e02 req-e3fdff48-a8e4-4500-bc2f-47b48f32f40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3522148-f16e-43ef-973c-6033239d0aad", "name": "network-vif-deleted", "tag": "80f6a8a7-4056-45bf-bb8c-ed6b2a0661bb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:31.024728 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:31.024728 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:31.075982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a13ea30e-ad35-4534-9ce5-019322480e02 req-e3fdff48-a8e4-4500-bc2f-47b48f32f40e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:31.081929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a13ea30e-ad35-4534-9ce5-019322480e02 req-e3fdff48-a8e4-4500-bc2f-47b48f32f40e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:31.120103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a13ea30e-ad35-4534-9ce5-019322480e02 req-e3fdff48-a8e4-4500-bc2f-47b48f32f40e service nova] Creating event network-vif-deleted:80f6a8a7-4056-45bf-bb8c-ed6b2a0661bb for instance e3522148-f16e-43ef-973c-6033239d0aad on nch1-master-1 Feb 12 21:19:31.150836 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a13ea30e-ad35-4534-9ce5-019322480e02 req-e3fdff48-a8e4-4500-bc2f-47b48f32f40e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137635 Feb 12 21:19:31.153130 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2067/4229] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:31.176458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:31.180701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:31.204257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:31.205258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:31.208662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:31.214558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:31.216083 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dff4ddb5-5af4-434d-8df0-134bcc0331f3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 1.372974 Feb 12 21:19:31.216673 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2163/4230] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:29 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:31.217595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:31.829652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a22d069-e260-46c5-967c-c8ec03051bf2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: .version_select at 0x7fa8fe898820>, body: {"keypair": {"name": "tempest-keypair-697650077"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:31.860382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:31.866886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9a22d069-e260-46c5-967c-c8ec03051bf2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:31.875786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9a22d069-e260-46c5-967c-c8ec03051bf2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for user b2f827b7e9bd4d3c9b1062b67179782d and project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:31.876401 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae16d6d1-7093-42db-a1ef-62b39b793b40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 200 len: 1464 microversion: 2.1 time: 0.719612 Feb 12 21:19:31.876997 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2068/4231] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:31 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 1464 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:31.882532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-550e8596-0b18-4828-bb50-ae0838d1f7e2 req-bc4eda19-0c4b-4287-ba21-5c94ec153e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0f23fe-5df2-49f4-85af-3e16dabe1ca5", "name": "network-vif-deleted", "tag": "34cd3a96-20f0-4da5-9fc7-b28ab17e9dda"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:31.886315 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:31.886315 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:31.902660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-550e8596-0b18-4828-bb50-ae0838d1f7e2 req-bc4eda19-0c4b-4287-ba21-5c94ec153e70 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:31.904364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-550e8596-0b18-4828-bb50-ae0838d1f7e2 req-bc4eda19-0c4b-4287-ba21-5c94ec153e70 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:31.934187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-550e8596-0b18-4828-bb50-ae0838d1f7e2 req-bc4eda19-0c4b-4287-ba21-5c94ec153e70 service nova] Creating event network-vif-deleted:34cd3a96-20f0-4da5-9fc7-b28ab17e9dda for instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 on nch1-master-1 Feb 12 21:19:31.943890 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-550e8596-0b18-4828-bb50-ae0838d1f7e2 req-bc4eda19-0c4b-4287-ba21-5c94ec153e70 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065375 Feb 12 21:19:31.945091 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2069/4232] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:32.019195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:32.020172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:32.031959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:32.033286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:32.035690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:32.038261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:32.190207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:32.199175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54a228cd-92f0-4d17-817e-0ff0302da5b0 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1214 microversion: 2.1 time: 0.184980 Feb 12 21:19:32.202093 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2070/4233] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:32 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:32.211908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9a22d069-e260-46c5-967c-c8ec03051bf2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:32.230063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-9a22d069-e260-46c5-967c-c8ec03051bf2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for user b2f827b7e9bd4d3c9b1062b67179782d and project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:32.233805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:32.234870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:32.245599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:32.246488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:32.247546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:32.248991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:32.271357 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a22d069-e260-46c5-967c-c8ec03051bf2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.704321 Feb 12 21:19:32.272288 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2164/4234] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:19:31 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:32.687381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:32.704460 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-748d94b6-2738-4f31-8f04-75500bab06bc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.472011 Feb 12 21:19:32.709019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2071/4235] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:32 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:32.896096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:32.897684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:32.910840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:32.916056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:32.917463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:32.918155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:32.953451 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance e3522148-f16e-43ef-973c-6033239d0aad could not be found. Feb 12 21:19:32.960073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance e3522148-f16e-43ef-973c-6033239d0aad could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:19:32.965403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05d722c3-b886-45d6-bc00-93e42b567475 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 404 len: 111 microversion: 2.1 time: 0.069464 Feb 12 21:19:32.983050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6f82cce-f1c6-40e5-86d4-c80a94ad4402 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: .version_select at 0x7fa907fb1af0>, body: {"keypair": {"name": "tempest-key-1607446"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:32.990469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2165/4236] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:32 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:19:33.033795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f6f82cce-f1c6-40e5-86d4-c80a94ad4402 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:33.057226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f6f82cce-f1c6-40e5-86d4-c80a94ad4402 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:33.219035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:33.220525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:33.229696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:33.233992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:33.240184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:33.240184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:33.389387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:33.405445 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62b935c9-1732-44ef-8097-072884da02e9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1278 microversion: 2.1 time: 0.186196 Feb 12 21:19:33.420188 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2166/4237] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:33 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:33.671551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f6f82cce-f1c6-40e5-86d4-c80a94ad4402 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:33.691479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-f6f82cce-f1c6-40e5-86d4-c80a94ad4402 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:33.734206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:33.735316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:33.751170 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6f82cce-f1c6-40e5-86d4-c80a94ad4402 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2298 microversion: 2.1 time: 0.771440 Feb 12 21:19:33.753869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:33.754574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:33.760580 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2072/4238] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:19:32 2022] POST /compute/v2.1/os-keypairs => generated 2298 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:33.762094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:33.765615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:33.772085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9465a54b-ce05-40ae-8f26-31675d7c9b50 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '.version_select at 0x7fa90800c0d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:33.779830 ncdv-master-1 devstack@n-api.service[141726]: WARNING oslo_db.sqlalchemy.utils [None req-9465a54b-ce05-40ae-8f26-31675d7c9b50 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Unique keys not in sort_keys. The sorting order may be unstable. Feb 12 21:19:33.790467 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9465a54b-ce05-40ae-8f26-31675d7c9b50 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/os-keypairs" status: 200 len: 542 microversion: 2.1 time: 0.028906 Feb 12 21:19:33.798842 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2073/4239] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:19:33 2022] GET /compute/v2.1/os-keypairs => generated 542 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:34.026635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-943927178", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "key_name": "tempest-key-1607446", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:34.164240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:19:34.575101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:34.583614 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe0eb9fe-e397-433e-aea6-d9aa5e21398d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.854831 Feb 12 21:19:34.594302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2167/4240] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:33 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:34.612354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:34.622291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:34.634986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:34.635460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:34.636283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:34.636733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:34.776286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:34.784512 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-61937043-960a-4f28-96a6-d9c7bd453023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1276 microversion: 2.1 time: 0.188873 Feb 12 21:19:34.791620 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2168/4241] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:34 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:35.610969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:35.611594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:35.632401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:35.633011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:35.636491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:35.641138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:36.142900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:19:36.145041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:19:36.153058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:19:36.153058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:19:36.153058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:19:36.173986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:36.174835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:36.183540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:36.184320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:36.273155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:36.283465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:36.325925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:19:36.334671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:19:36.563294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:36.584380 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-310e35d6-36b1-42ca-9f2e-7d1d1f427861 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.976927 Feb 12 21:19:36.588414 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2169/4242] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:36.635757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:36.638194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:36.640048 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b3824dfc-7eb8-4af9-b0bd-4864bb772f49 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.612713 Feb 12 21:19:36.643619 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2074/4243] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:19:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:19:36.662104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ecb73cf-3f1d-4f46-a419-8b62141ed1bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:36.665822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:36.669403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ecb73cf-3f1d-4f46-a419-8b62141ed1bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:36.669707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:36.673236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:36.675137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:36.834070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7ecb73cf-3f1d-4f46-a419-8b62141ed1bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:36.840729 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ecb73cf-3f1d-4f46-a419-8b62141ed1bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1225 microversion: 2.1 time: 0.189901 Feb 12 21:19:36.850773 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2075/4244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:36 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:37.041371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:37.055713 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8741f94-6721-45ce-bbbc-b369fc0db11d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1276 microversion: 2.1 time: 0.437064 Feb 12 21:19:37.060842 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2170/4245] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:36 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:37.604874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:37.605512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:37.636922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:37.637682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:37.638695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:37.640712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:37.860751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a50601e2-4fd5-4089-96c8-fea1cdfa7704 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:37.862121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a50601e2-4fd5-4089-96c8-fea1cdfa7704 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:38.055574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a50601e2-4fd5-4089-96c8-fea1cdfa7704 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:38.072947 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a50601e2-4fd5-4089-96c8-fea1cdfa7704 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1225 microversion: 2.1 time: 0.216995 Feb 12 21:19:38.082622 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2171/4246] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:37 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1225 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:38.091227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:38.092265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:38.112589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:38.113983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:38.144176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:38.145078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:38.581431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:38.589670 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7f349435-ff9a-470f-b4ea-d8b226d3cba2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.989164 Feb 12 21:19:38.601758 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2076/4247] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:37 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:39.099665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:39.101096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:39.119220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:39.120063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:39.121301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:39.121953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:39.282927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:39.292979 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-535bf725-12d5-4fbb-9091-2aaadfe34c9d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 1.205825 Feb 12 21:19:39.305025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2172/4248] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:38 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:39.608261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:39.609250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:39.619188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:39.622522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:39.623592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:39.624138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:39.739268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:39.747792 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b66031c4-72ed-4ae6-be2e-0b541c0ad0d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1277 microversion: 2.1 time: 0.652309 Feb 12 21:19:39.753889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2077/4249] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:39 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1277 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:40.309751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:40.310371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:40.326317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:40.326781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:40.327619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:40.328076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:40.527434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:40.535794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b212043-989d-4a80-9fca-4249d9d41e43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.932145 Feb 12 21:19:40.549756 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2173/4250] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:39 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:40.772733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:40.773799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:40.798916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:40.805281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:40.806487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:40.807112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:41.037115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:41.054038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-356709cd-2d24-4ba2-8be0-c2033325580b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1283 microversion: 2.1 time: 0.286947 Feb 12 21:19:41.054642 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2174/4251] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:40 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1283 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:41.068315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-607056905", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d3223c4-7d3e-45d4-827e-f74909602e0e"}], "security_groups": [{"name": "tempest-securitygroup--901086966"}], "key_name": "tempest-keypair-697650077", "user_data": "}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:41.379860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:41.387486 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9450ef6-1ddb-4605-80d5-c20d853c8162 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 1.081373 Feb 12 21:19:41.397736 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2078/4252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:40 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:19:41.529390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] validate_networks() for [('3d3223c4-7d3e-45d4-827e-f74909602e0e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:19:41.558215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:41.559136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:41.566305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:41.573546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:41.578961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:41.579703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:42.427279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:42.436595 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6cf75e17-65f5-461e-a618-97733b133f4d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1682 microversion: 2.1 time: 0.881970 Feb 12 21:19:42.442796 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2079/4253] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:41 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1682 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:42.452933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:42.453866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:42.466860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:42.471334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:42.472214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:42.472705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:42.659250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:42.670869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e12f5cfa-a243-43b3-8f8d-d6bb9c67b4ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1283 microversion: 2.1 time: 0.229172 Feb 12 21:19:42.671755 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2080/4254] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:42 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1283 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:42.677645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-81b2d15f-b95c-4916-9eb6-b313b96d6248 req-1c0e3cc4-36d5-496d-884b-77cf1f584503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd", "tag": "56d77b1f-6780-4fa2-af74-237c0810bff8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:42.679397 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:42.679397 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:42.688082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81b2d15f-b95c-4916-9eb6-b313b96d6248 req-1c0e3cc4-36d5-496d-884b-77cf1f584503 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:42.694293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81b2d15f-b95c-4916-9eb6-b313b96d6248 req-1c0e3cc4-36d5-496d-884b-77cf1f584503 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:42.702711 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-81b2d15f-b95c-4916-9eb6-b313b96d6248 req-1c0e3cc4-36d5-496d-884b-77cf1f584503 service nova] Creating event network-changed:56d77b1f-6780-4fa2-af74-237c0810bff8 for instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd on nch2-master-1 Feb 12 21:19:42.710368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-81b2d15f-b95c-4916-9eb6-b313b96d6248 req-1c0e3cc4-36d5-496d-884b-77cf1f584503 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037049 Feb 12 21:19:42.711556 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2081/4255] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:42.728763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:42.729894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:42.751063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:42.755343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:42.756598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:42.757215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:43.425656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:43.460300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f34edd08-995c-412d-a29b-535fa14b2fbd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 0.745835 Feb 12 21:19:43.469941 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2082/4256] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:42 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:43.763952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1545300758", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "39f292e9-8e77-4a3a-adae-81674dd31288"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:43.850070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] validate_networks() for [('39f292e9-8e77-4a3a-adae-81674dd31288', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:19:44.182949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:19:44.183475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:19:44.183958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:19:44.184379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:19:44.185177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:19:44.202070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:44.205318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:44.209227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:44.211151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:44.261174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:44.267280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for user b2f827b7e9bd4d3c9b1062b67179782d and project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:44.324298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:19:44.326591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:19:44.500623 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4683b42-a046-4122-a15c-71315431d233 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.444654 Feb 12 21:19:44.522880 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2175/4257] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:19:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 3467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:19:44.547178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:44.547832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:44.566981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:44.567626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:44.582447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:44.590834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:44.969194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:19:44.971917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:19:44.972641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:19:44.973753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:19:44.974368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:19:44.985497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:44.986234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:44.987367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:44.987973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:45.058371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Getting quotas for project bd5a0b396b5045459fdedb8d4039960a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:45.069277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Getting quotas for user bf1d1df6d06a430684c3335b89dafd98 and project bd5a0b396b5045459fdedb8d4039960a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:45.105904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:19:45.109867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:19:45.288699 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a05a4ae5-5e3d-4923-901f-5c95110ce440 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815279 Feb 12 21:19:45.293683 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2083/4258] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:19:45.334001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:45.337246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:45.353107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:45.354812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:45.360072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:45.360846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:45.680061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:45.695202 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ae5fea6-c846-400b-af78-55ab25b1e070 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.396319 Feb 12 21:19:45.705086 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2084/4259] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:45 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:45.714030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:45.716359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:45.716971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:45.734690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:45.737266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:45.741382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:45.741555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2f2e1080-fdf0-4263-8ded-efbb2129bcba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 1.208965 Feb 12 21:19:45.741868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:45.750600 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2176/4260] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:44 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:45.779987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3c48f84-3b96-4c4f-afc1-ca6d1048b38a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:45.779987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3c48f84-3b96-4c4f-afc1-ca6d1048b38a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:46.057231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:46.065405 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00cbddbe-48cb-4fc1-a89e-d614f3d72185 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 0.359022 Feb 12 21:19:46.075327 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2085/4261] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:45 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:46.090203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-792274640", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "39f292e9-8e77-4a3a-adae-81674dd31288"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:46.200084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] validate_networks() for [('39f292e9-8e77-4a3a-adae-81674dd31288', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:19:46.477833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3c48f84-3b96-4c4f-afc1-ca6d1048b38a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:46.493268 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3c48f84-3b96-4c4f-afc1-ca6d1048b38a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1236 microversion: 2.1 time: 0.737148 Feb 12 21:19:46.494211 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2177/4262] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:45 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1236 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:46.502877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:46.506814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:46.519102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:46.521424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:46.522282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:46.522735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.024814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:19:47.025129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:19:47.026007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:19:47.026746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:19:47.027685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:19:47.040767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.041225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.042780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.043274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.064473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Getting quotas for project bd5a0b396b5045459fdedb8d4039960a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:47.072771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Getting quotas for user bf1d1df6d06a430684c3335b89dafd98 and project bd5a0b396b5045459fdedb8d4039960a. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:47.089283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:19:47.103167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:19:47.330608 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-063f0958-a46d-4f32-95cc-5fdb834e2dae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253527 Feb 12 21:19:47.331638 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2086/4263] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:19:47.350544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:47.351736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:47.364634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.365841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.366917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.367718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.730322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:47.742814 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b83feab-b684-415e-9c13-ec1960540d57 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.409515 Feb 12 21:19:47.744062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2087/4264] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:47 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:47.767795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-50d367f5-c5c1-49f8-be1a-7a006554f100 req-8a7e2480-13db-4de5-b7cd-5255f5a5411f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-unplugged", "status": "completed", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:47.784542 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:47.784542 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:47.805150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-50d367f5-c5c1-49f8-be1a-7a006554f100 req-8a7e2480-13db-4de5-b7cd-5255f5a5411f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.805150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-50d367f5-c5c1-49f8-be1a-7a006554f100 req-8a7e2480-13db-4de5-b7cd-5255f5a5411f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.831531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-50d367f5-c5c1-49f8-be1a-7a006554f100 req-8a7e2480-13db-4de5-b7cd-5255f5a5411f service nova] Creating event network-vif-unplugged:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:19:47.837310 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-50d367f5-c5c1-49f8-be1a-7a006554f100 req-8a7e2480-13db-4de5-b7cd-5255f5a5411f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091655 Feb 12 21:19:47.838371 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2088/4265] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:47.845600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:47.846554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:47.854637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.856675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:47.856675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:47.857113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:48.079735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:48.103818 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80cf59ca-f83d-4060-8592-1c728f85fce3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 1.607647 Feb 12 21:19:48.108435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2178/4266] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:46 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:48.138149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1395805409", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "451", "networks": [{"uuid": "39f292e9-8e77-4a3a-adae-81674dd31288"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:48.284541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] validate_networks() for [('39f292e9-8e77-4a3a-adae-81674dd31288', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:19:48.568371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:48.582108 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f694ab21-dce1-4c84-afad-ffcb245a5f12 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 0.738013 Feb 12 21:19:48.583700 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2089/4267] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:47 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:48.595259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:48.596237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:48.610734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:48.611436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:48.612711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:48.613314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:48.815364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:48.824402 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-18b63049-7307-49a6-98c1-ad35f75fd6e1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1296 microversion: 2.1 time: 0.239133 Feb 12 21:19:48.836198 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2090/4268] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:48 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1296 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:48.841702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:48.842558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:48.850379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:48.852529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:48.852529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:48.852529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:49.687029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:49.730043 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30efe5a5-280c-48ea-900b-4d8fc76277a9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.886487 Feb 12 21:19:49.731896 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2091/4269] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:48 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:49.745304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:49.747917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:49.762628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:49.765807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:49.769666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:49.770904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:50.672766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:19:50.673507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:19:50.674480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:19:50.675120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:19:50.675798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:19:50.738432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:50.739522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:50.742702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:50.743161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:50.799669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Getting quotas for project bd5a0b396b5045459fdedb8d4039960a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:19:50.806968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Getting quotas for user bf1d1df6d06a430684c3335b89dafd98 and project bd5a0b396b5045459fdedb8d4039960a. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:19:50.839830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:19:50.844450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:19:51.011653 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1cada91-578f-46b6-bb98-d257f1cd8f5f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.900212 Feb 12 21:19:51.022431 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2179/4270] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:19:51.027516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:51.029786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:51.050532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.051171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.052492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.053585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.316290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:51.324900 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd90d228-733b-4a1d-9b0a-04496610ee91 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1294 microversion: 2.1 time: 0.301022 Feb 12 21:19:51.326180 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2180/4271] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:51 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1294 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:51.331528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7de3c506-286d-4a23-87d2-99a31a28bf34 req-56426988-cffc-46c0-84b5-82405c1ab17f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d926e2b-0f1a-45c6-aeff-35800faf7d40", "tag": "fbbb7b5a-5ca5-4ff8-9dca-f3a9de052888"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:51.334297 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:51.334297 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:51.343395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7de3c506-286d-4a23-87d2-99a31a28bf34 req-56426988-cffc-46c0-84b5-82405c1ab17f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.350402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7de3c506-286d-4a23-87d2-99a31a28bf34 req-56426988-cffc-46c0-84b5-82405c1ab17f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.361908 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7de3c506-286d-4a23-87d2-99a31a28bf34 req-56426988-cffc-46c0-84b5-82405c1ab17f service nova] Creating event network-changed:fbbb7b5a-5ca5-4ff8-9dca-f3a9de052888 for instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 on nch1-master-1 Feb 12 21:19:51.362060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:51.368537 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7de3c506-286d-4a23-87d2-99a31a28bf34 req-56426988-cffc-46c0-84b5-82405c1ab17f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040819 Feb 12 21:19:51.369643 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2181/4272] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:51.375569 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb8e38a3-3a3e-4bab-9ba2-4f939f95d473 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 1.638579 Feb 12 21:19:51.375954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fcb5a786-8b1f-4d6d-973f-c645e3b58694 req-17f1ecbe-776c-4f18-80a4-889759e7ec62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd", "name": "network-vif-plugged", "status": "completed", "tag": "56d77b1f-6780-4fa2-af74-237c0810bff8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:51.376468 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2092/4273] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:49 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:51.379159 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:51.379159 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:51.386967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:51.387592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:51.387831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fcb5a786-8b1f-4d6d-973f-c645e3b58694 req-17f1ecbe-776c-4f18-80a4-889759e7ec62 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.388320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fcb5a786-8b1f-4d6d-973f-c645e3b58694 req-17f1ecbe-776c-4f18-80a4-889759e7ec62 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.401530 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fcb5a786-8b1f-4d6d-973f-c645e3b58694 req-17f1ecbe-776c-4f18-80a4-889759e7ec62 service nova] Creating event network-vif-plugged:56d77b1f-6780-4fa2-af74-237c0810bff8 for instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd on nch2-master-1 Feb 12 21:19:51.403700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.406525 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fcb5a786-8b1f-4d6d-973f-c645e3b58694 req-17f1ecbe-776c-4f18-80a4-889759e7ec62 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035018 Feb 12 21:19:51.407592 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2182/4274] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:51.413803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.415656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.415945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f6a36a5a-8b1b-4c28-8d70-df855849f2d3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:51.416123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.416982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f6a36a5a-8b1b-4c28-8d70-df855849f2d3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:51.666377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f6a36a5a-8b1b-4c28-8d70-df855849f2d3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:51.678614 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f6a36a5a-8b1b-4c28-8d70-df855849f2d3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1221 microversion: 2.1 time: 0.269196 Feb 12 21:19:51.705081 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2183/4275] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:51 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1221 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:51.717911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:51.718549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:51.735328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.736277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:51.737374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:51.737911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.179182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:52.186775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebf2b6c8-4a3d-4dbc-b67e-007d1e114baa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.806268 Feb 12 21:19:52.195716 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2093/4276] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:51 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:52.304377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:52.322180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44f95387-e83a-4f62-b2f4-7ffe80f074ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.616486 Feb 12 21:19:52.323405 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2184/4277] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:51 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:52.342480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:52.343984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:52.344101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:52.344667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:52.354328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.355136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.357028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.357742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.358119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.358728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.359638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.360143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.548867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:52.557050 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3833c19a-06ca-44ba-a600-c3b5287cec43 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1294 microversion: 2.1 time: 0.217124 Feb 12 21:19:52.566344 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2185/4278] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:52 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:52.577107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:52.579104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:52.592418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.592876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.601957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.602435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.897612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:52.906840 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6d335f69-e33d-41dc-a699-44ab176659ac tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.568416 Feb 12 21:19:52.907428 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2094/4279] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:52 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:52.933471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:52.937083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:52.978168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.980753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:52.983428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:52.984424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:53.108316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:53.124131 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-da01871d-e8ca-4e3a-a89e-53a43dfb1112 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1217 microversion: 2.1 time: 0.214056 Feb 12 21:19:53.126653 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2095/4280] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:52 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:53.143232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:53.144333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:53.164143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:53.166522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:53.168386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:53.168876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:53.714277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:53.732056 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c39d4c95-1831-44c8-9d3f-87cf8b94e49a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1318 microversion: 2.1 time: 1.170061 Feb 12 21:19:53.749921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2186/4281] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:52 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1318 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:53.771873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:53.771873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:53.785489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:53.786799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:53.787804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:53.792583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:54.065857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:54.077285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6653788e-86b6-4dfd-b138-bb88498d85de tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.947631 Feb 12 21:19:54.078698 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2096/4282] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:53 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:54.087769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:54.088806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:54.098808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:54.100424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:54.102446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:54.103647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:54.887097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:54.897390 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8172719d-10da-448b-8450-1244a873c75c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 1.146156 Feb 12 21:19:54.898510 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2187/4283] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:53 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:54.920502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:54.931474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:54.943822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:54.944771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:54.945996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:54.946662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.249756 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d015e6b6-442a-4199-b22e-61693ce2aa4a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.349655 Feb 12 21:19:55.250791 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2188/4284] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:19:54 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:19:55.267895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:55.274579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:55.287993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:55.289150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.290263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:55.291004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.363019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:55.397645 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f510fcea-a317-4f06-b571-aa82a3b8fab4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 1.305458 Feb 12 21:19:55.397645 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2097/4285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:54 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:55.401668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:55.402534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:55.404786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:55.418735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d66047d4-eab9-46e1-b2e5-8158b1c46aa9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1279 microversion: 2.1 time: 0.166515 Feb 12 21:19:55.435494 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2189/4286] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:55 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:55.435494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:55.436410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:55.437588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:55.440373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.444126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:55.446578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.452834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:55.454419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.455876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:55.456599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:55.963526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:55.975091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a70f36e3-d49e-46bf-9a33-a330665f5fdb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1671 microversion: 2.1 time: 0.550429 Feb 12 21:19:55.975746 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2190/4287] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:55 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1671 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:55.987781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:55.989239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:56.005777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.006440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.007749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.008584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.581195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:56.589709 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-22ad7ded-dcca-44f2-b290-0a693a26d7f8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1507 microversion: 2.1 time: 1.200742 Feb 12 21:19:56.590298 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2098/4288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:55 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1507 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:56.602776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-16341ddd-e59e-4a19-b64a-15adb9251e9d req-1f6e7410-b965-48c0-bff5-22f6ab91e78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dceb2da3-afd2-4395-a3c8-eaf417cce25b", "tag": "f5943c26-37c8-4eb7-847d-98d39b953002"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:56.610033 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:56.610033 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:19:56.622845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-16341ddd-e59e-4a19-b64a-15adb9251e9d req-1f6e7410-b965-48c0-bff5-22f6ab91e78e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.623296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-16341ddd-e59e-4a19-b64a-15adb9251e9d req-1f6e7410-b965-48c0-bff5-22f6ab91e78e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.624657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:56.633161 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ea1a6d1-4b25-410d-84c2-ac43d1a8aba8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.656150 Feb 12 21:19:56.638443 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2191/4289] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:55 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:56.651475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:56.652399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:56.664321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.666682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.666682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.666682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.685511 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-16341ddd-e59e-4a19-b64a-15adb9251e9d req-1f6e7410-b965-48c0-bff5-22f6ab91e78e service nova] Creating event network-changed:f5943c26-37c8-4eb7-847d-98d39b953002 for instance dceb2da3-afd2-4395-a3c8-eaf417cce25b on nch1-master-1 Feb 12 21:19:56.714163 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-16341ddd-e59e-4a19-b64a-15adb9251e9d req-1f6e7410-b965-48c0-bff5-22f6ab91e78e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115260 Feb 12 21:19:56.717082 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2099/4290] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:56.726781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:56.737700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:56.745755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.749437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.750557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:56.751228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:56.980210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:56.994361 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ee76e4a-1c65-46be-a5c8-356530d9a032 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1279 microversion: 2.1 time: 0.274143 Feb 12 21:19:57.004951 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2100/4291] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:56 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:57.011754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:57.012757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:57.021322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:57.024048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:57.024048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:57.024048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:57.458386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:57.464433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-076689ce-b6a5-455f-afb0-2728b7dcaea4 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.824703 Feb 12 21:19:57.465034 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2192/4292] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:56 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:57.469786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:57.472361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:57.487756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:57.494919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:57.495979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:57.496936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:57.808986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:57.826381 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e013edd-22a7-49e6-bf72-01b7559da2f6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1671 microversion: 2.1 time: 0.359938 Feb 12 21:19:57.829646 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2193/4293] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:57 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:57.841448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:57.842187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:57.853737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:57.865369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:57.866537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:57.867151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:57.970633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:57.989294 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4de4a2de-1a0a-491e-a54d-524ffe109537 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1507 microversion: 2.1 time: 0.979887 Feb 12 21:19:57.993270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2101/4294] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:57 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1507 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:58.018862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:58.021348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:58.033417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.034140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.035060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.036048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.165458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:58.182274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1868b06e-d1ec-4e83-8e14-f35fd717917b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.344734 Feb 12 21:19:58.183824 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2194/4295] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:57 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:58.189294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:58.190156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:58.197239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.197999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.198948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.199561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.244871 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b6340e7f-4068-423b-bda2-37deadc4229d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "PUT /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1079 microversion: 2.1 time: 0.237816 Feb 12 21:19:58.254373 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2102/4296] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:19:58 2022] PUT /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1079 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:58.259461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:58.260357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:58.267243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.267979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.271989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.272350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.682505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:58.689575 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7b726c9-d781-4323-aa62-5edc0855386c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.504544 Feb 12 21:19:58.694703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2195/4297] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:58 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:58.703039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7a7a89c3-48ef-4cda-b279-22a0b5ad9238 req-59e4beb5-07e6-466a-9247-56401ff8d956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245ee706-32b5-4ae4-bf28-f1e5139ea077", "tag": "6f7bc51a-17c9-4327-a4af-7e41ba429351"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:58.710004 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:58.710004 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:58.745902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7a7a89c3-48ef-4cda-b279-22a0b5ad9238 req-59e4beb5-07e6-466a-9247-56401ff8d956 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.746406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7a7a89c3-48ef-4cda-b279-22a0b5ad9238 req-59e4beb5-07e6-466a-9247-56401ff8d956 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.792405 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7a7a89c3-48ef-4cda-b279-22a0b5ad9238 req-59e4beb5-07e6-466a-9247-56401ff8d956 service nova] Creating event network-changed:6f7bc51a-17c9-4327-a4af-7e41ba429351 for instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 on nch1-master-1 Feb 12 21:19:58.800988 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7a7a89c3-48ef-4cda-b279-22a0b5ad9238 req-59e4beb5-07e6-466a-9247-56401ff8d956 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104898 Feb 12 21:19:58.802134 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2196/4298] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:58.808164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:58.809075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:58.819922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.821592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:58.822578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:58.823105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.170807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:59.178631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a6763297-d261-4f3b-b913-66674e719857 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1505 microversion: 2.1 time: 0.922845 Feb 12 21:19:59.189145 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2103/4299] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:58 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1505 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:59.191617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:59.192920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:59.211380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.212049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.213023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.213680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.360239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:59.376904 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ae51e626-1118-431f-b90b-65e42457d3d8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.573166 Feb 12 21:19:59.377760 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2197/4300] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:58 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:59.391680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-52afc1c9-d7af-4976-9480-16f371064954 req-910c0f00-ebd4-47fd-ad7b-c6d1ac35b063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d926e2b-0f1a-45c6-aeff-35800faf7d40", "name": "network-vif-plugged", "status": "completed", "tag": "fbbb7b5a-5ca5-4ff8-9dca-f3a9de052888"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:19:59.397179 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:19:59.397179 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:19:59.420539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-52afc1c9-d7af-4976-9480-16f371064954 req-910c0f00-ebd4-47fd-ad7b-c6d1ac35b063 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.421012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-52afc1c9-d7af-4976-9480-16f371064954 req-910c0f00-ebd4-47fd-ad7b-c6d1ac35b063 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.458650 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-52afc1c9-d7af-4976-9480-16f371064954 req-910c0f00-ebd4-47fd-ad7b-c6d1ac35b063 service nova] Creating event network-vif-plugged:fbbb7b5a-5ca5-4ff8-9dca-f3a9de052888 for instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 on nch1-master-1 Feb 12 21:19:59.470316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-52afc1c9-d7af-4976-9480-16f371064954 req-910c0f00-ebd4-47fd-ad7b-c6d1ac35b063 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090472 Feb 12 21:19:59.477864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2198/4301] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:19:59.499943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:59.500897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:59.512183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.513128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.515137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.517588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.747486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:59.761046 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-345a1582-d041-43ed-a4a4-be2d381b7dbe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1505 microversion: 2.1 time: 0.279816 Feb 12 21:19:59.762851 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2199/4302] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:59 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:59.773717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:59.775918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:59.783309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.784022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.785517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.785923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.911674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:19:59.923679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c87968f5-fefa-42ec-a6b3-ca7ee1a4af7c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1671 microversion: 2.1 time: 0.735836 Feb 12 21:19:59.929716 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2104/4303] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:59 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1671 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:19:59.945720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:19:59.947263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:19:59.957411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.958178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:19:59.960153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:19:59.961696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:00.095081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:00.109655 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5c9923a-fa19-4385-af4d-144731119c7c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.344067 Feb 12 21:20:00.110307 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2200/4304] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:59 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:00.147919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:00.157702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:00.169064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:00.169554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:00.170575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:00.171026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:00.309844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:20:00.311607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:20:00.312712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:20:00.313629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:20:00.316492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:20:00.561326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:00.567751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:00.568766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:00.570210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:00.570965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:00.602585 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-967b50ad-3a7c-4c13-ba97-2159b6a3acd9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "POST /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd/action" status: 202 len: 1111 microversion: 2.1 time: 0.473148 Feb 12 21:20:00.603418 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2201/4305] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:20:00 2022] POST /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd/action => generated 1111 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 12 21:20:00.607827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:00.608438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:00.639168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:00.639890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:00.640705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:00.642685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.047601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:01.060998 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3c860a5-82c1-4ff3-9935-31888ae8ec8e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 1.120476 Feb 12 21:20:01.063072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:01.073119 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2105/4306] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:19:59 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:01.075104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5cf1dca-e478-4f17-86ad-ee9879e9356a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.470700 Feb 12 21:20:01.075702 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2202/4307] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:00 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:01.089381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2fe25d53-9228-443a-895b-3cf459abf146 req-36dc5719-e079-4b40-a358-d34c11637a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b988b5a-9dfb-4db8-9388-bae126fcf4fc", "tag": "f16e15df-4fce-4c6d-95cf-1ba7fe36760e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:01.090715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:01.091240 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:01.091240 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:01.091824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:01.105622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.105800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.106585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.107029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.128678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2fe25d53-9228-443a-895b-3cf459abf146 req-36dc5719-e079-4b40-a358-d34c11637a83 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.128678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2fe25d53-9228-443a-895b-3cf459abf146 req-36dc5719-e079-4b40-a358-d34c11637a83 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.157207 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2fe25d53-9228-443a-895b-3cf459abf146 req-36dc5719-e079-4b40-a358-d34c11637a83 service nova] Creating event network-changed:f16e15df-4fce-4c6d-95cf-1ba7fe36760e for instance 6b988b5a-9dfb-4db8-9388-bae126fcf4fc on nch2-master-1 Feb 12 21:20:01.161990 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2fe25d53-9228-443a-895b-3cf459abf146 req-36dc5719-e079-4b40-a358-d34c11637a83 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082619 Feb 12 21:20:01.163263 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2203/4308] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:01.171197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:01.172902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:01.181341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.182123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.183426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.184084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.580318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:01.588661 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eac4f652-7705-49fe-9373-1d65254ac206 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.421830 Feb 12 21:20:01.601885 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2204/4309] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:01.608335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:01.609213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:01.616793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.617552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.618845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.619489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.860331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:01.869904 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-84eea633-ca9a-450d-b0b0-5fcf54de3023 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.796648 Feb 12 21:20:01.881910 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2106/4310] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:01 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:01.886325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:01.887359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:01.898549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.899021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.899849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.902714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:01.973189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4ebc8644-517f-4521-9bbe-66b12d02aab1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 200 len: 322 microversion: 2.1 time: 0.097548 Feb 12 21:20:01.977039 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2107/4311] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:20:01 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:01.984417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:01.986570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:01.995722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:01.996431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.005104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:02.013457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.013457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.018420 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72b94ff2-5b56-4537-8d56-b812c599e8ca tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1325 microversion: 2.1 time: 0.414838 Feb 12 21:20:02.021443 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2205/4312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:01 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:02.080009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:02.081367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:02.094598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.095464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.096511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.097180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.421219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:02.430373 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c74041d1-cc4e-4ed8-930b-c72dec5dce81 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.354076 Feb 12 21:20:02.436694 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2206/4313] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:02 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:02.446403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:02.447324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:02.465637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.469102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.475173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.475908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.802954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:02.815059 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b1910e2d-4956-415a-b58d-7fe9d5eefbc3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.834396 Feb 12 21:20:02.829372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2108/4314] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:02.845719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:02.846875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:02.858171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.858935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:02.860163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:02.860606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.119885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:03.128819 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2945f661-588c-45c1-9915-3ed276416426 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.690315 Feb 12 21:20:03.130378 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2207/4315] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:02 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:03.136588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:03.137773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:03.146477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.146929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.148784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.149252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.482989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:03.494637 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d01b1c58-99e9-4aae-947e-9ef01e71414e tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.362923 Feb 12 21:20:03.496004 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2208/4316] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:03 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:03.501817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:03.502717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:03.520507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.520507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.520507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.520507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.734412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:03.745431 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9d67a56b-1437-479a-9505-6c883d5128de tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1504 microversion: 2.1 time: 0.247947 Feb 12 21:20:03.761711 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2209/4317] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:03 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:03.767183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4d9e37f2-151c-418f-bbd0-0d0841333624 req-ff09239a-778d-4dc2-a4b4-f66b6e9e8061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83499a06-e03e-4abd-9f5a-9ff4288b66ac", "tag": "23815c6a-3d4b-4d91-8e5a-906a6a120afd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:03.768884 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:03.768884 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:03.776863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4d9e37f2-151c-418f-bbd0-0d0841333624 req-ff09239a-778d-4dc2-a4b4-f66b6e9e8061 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.777235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4d9e37f2-151c-418f-bbd0-0d0841333624 req-ff09239a-778d-4dc2-a4b4-f66b6e9e8061 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.789083 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4d9e37f2-151c-418f-bbd0-0d0841333624 req-ff09239a-778d-4dc2-a4b4-f66b6e9e8061 service nova] Creating event network-changed:23815c6a-3d4b-4d91-8e5a-906a6a120afd for instance 83499a06-e03e-4abd-9f5a-9ff4288b66ac on nch2-master-1 Feb 12 21:20:03.794019 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4d9e37f2-151c-418f-bbd0-0d0841333624 req-ff09239a-778d-4dc2-a4b4-f66b6e9e8061 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030764 Feb 12 21:20:03.794626 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2210/4318] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:03.796543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:03.799688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:03.800599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:03.805637 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebfd3162-2103-49c1-baad-9ab7f1caf20d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.974299 Feb 12 21:20:03.807079 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2109/4319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:02 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:03.812177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:03.812776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:03.818100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.818608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.819511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.820050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.820998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.821778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:03.822717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:03.823315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.064293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:04.077099 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f248117a-8260-458f-af28-b5f412bff6b0 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.280450 Feb 12 21:20:04.086890 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2211/4320] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:03 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:04.093121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:04.093817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:04.101617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.102093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.102878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.103494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.286459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:04.302817 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e54405d5-fdcc-4904-beb0-2807afa0fda7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1504 microversion: 2.1 time: 0.493985 Feb 12 21:20:04.305178 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2110/4321] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:03 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1504 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:04.312042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:04.313092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:04.324817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.325700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.327725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.328573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.350198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:04.361423 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be697edb-a995-4ea0-882c-f7cd66412895 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.272050 Feb 12 21:20:04.363498 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2212/4322] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:04 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:04.375600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:04.375969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:04.384950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.385733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.386978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.387760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.427377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:04.734239 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-abdc8749-c58d-4c59-911d-776b90e4ad94 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 204 len: 0 microversion: 2.1 time: 0.368560 Feb 12 21:20:04.736017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2213/4323] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:04 2022] DELETE /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:04.768886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:04.770693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:04.780940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.781425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:04.782508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:04.782956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.079565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:05.098324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59ddab8b-3918-4bde-a57b-a9e48712df10 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.791308 Feb 12 21:20:05.104779 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2111/4324] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:04 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:05.109939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:05.110703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:05.117304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.118096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.119160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.119834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.216780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:05.226129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1abbe745-7ce1-4184-8465-f0fc52bf05e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.485857 Feb 12 21:20:05.242219 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2214/4325] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:04 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:05.248637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:05.250218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:05.257618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.258347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.259459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.260069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.612854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:05.621022 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49609253-8846-48d3-8df4-7e246a8b9a78 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1510 microversion: 2.1 time: 0.377391 Feb 12 21:20:05.621668 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2215/4326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:05 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:05.626159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-91318bc4-e007-4260-a924-bb114947a440 req-005bb1d8-de7c-4113-a302-84970fe1a55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceb2da3-afd2-4395-a3c8-eaf417cce25b", "name": "network-vif-plugged", "status": "completed", "tag": "f5943c26-37c8-4eb7-847d-98d39b953002"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:05.627736 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:05.627736 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:05.649471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-91318bc4-e007-4260-a924-bb114947a440 req-005bb1d8-de7c-4113-a302-84970fe1a55a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.650806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-91318bc4-e007-4260-a924-bb114947a440 req-005bb1d8-de7c-4113-a302-84970fe1a55a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.663654 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-91318bc4-e007-4260-a924-bb114947a440 req-005bb1d8-de7c-4113-a302-84970fe1a55a service nova] Creating event network-vif-plugged:f5943c26-37c8-4eb7-847d-98d39b953002 for instance dceb2da3-afd2-4395-a3c8-eaf417cce25b on nch1-master-1 Feb 12 21:20:05.669040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-91318bc4-e007-4260-a924-bb114947a440 req-005bb1d8-de7c-4113-a302-84970fe1a55a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046154 Feb 12 21:20:05.670315 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2216/4327] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:05.677569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:05.678620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:05.701971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.708365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.710415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:05.710877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:05.966703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:05.989431 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dca4f339-4b46-4c0f-88d7-af5548706363 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.878031 Feb 12 21:20:05.992939 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2112/4328] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:05 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:06.003969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-645045983", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2d2fb25f-a576-44b7-8aec-e44f4519d495"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:06.102584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] validate_networks() for [('2d2fb25f-a576-44b7-8aec-e44f4519d495', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:20:06.154484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:06.173688 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5e7cd92f-fa99-44ee-ac1d-16818a04da66 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.498702 Feb 12 21:20:06.193869 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2217/4329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:05 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:06.199543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:06.201156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:06.215380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:06.215849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:06.217224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:06.217727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:06.501074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:06.518523 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fff86f44-1bc9-42b7-a9b3-2fb2af1a047b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.323669 Feb 12 21:20:06.520127 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2218/4330] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:06 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:06.642466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:06.643895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:06.664539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:06.667051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:06.668349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:06.669844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:06.951817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:06.959144 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c0b12ef8-05ff-4158-a5a4-da64447a9307 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1510 microversion: 2.1 time: 0.324617 Feb 12 21:20:06.959943 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2219/4331] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:06 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:07.011658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:07.012891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:07.024500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.025239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.026729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.027803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.184066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:20:07.185916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:20:07.186708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:20:07.187413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:20:07.188113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:20:07.210342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.211001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.212909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.214181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.262707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:20:07.278295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:20:07.333217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:20:07.339522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:20:07.472403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82d18f95-99be-40ab-b8a3-13a6439ac8a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476048 Feb 12 21:20:07.480065 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2113/4332] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:20:07.486466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:07.487877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:07.498260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.499574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.500789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.501785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.627276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:07.643218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d966921b-d02b-450f-b882-f2fe3d75e09f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.632933 Feb 12 21:20:07.645944 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2220/4333] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:07 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:07.652999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-40a7d99b-dddf-4cad-8d71-f635d919c33f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:07.653686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-40a7d99b-dddf-4cad-8d71-f635d919c33f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:07.835804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:07.852348 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec881b49-e701-454c-a400-c7c6de477c68 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.368770 Feb 12 21:20:07.853537 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2114/4334] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:07 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:07.858235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:07.859358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:07.866969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.867690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.868655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.869255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.906721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-40a7d99b-dddf-4cad-8d71-f635d919c33f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:07.914247 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-40a7d99b-dddf-4cad-8d71-f635d919c33f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1214 microversion: 2.1 time: 0.267125 Feb 12 21:20:07.918304 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2221/4335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:07 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:07.935866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3aa75d38-de30-4901-877a-6e73efcc9724 req-492bc5e7-9dff-4591-b473-bb90bf89b3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b988b5a-9dfb-4db8-9388-bae126fcf4fc", "name": "network-vif-plugged", "status": "completed", "tag": "f16e15df-4fce-4c6d-95cf-1ba7fe36760e"}, {"server_uuid": "245ee706-32b5-4ae4-bf28-f1e5139ea077", "name": "network-vif-plugged", "status": "completed", "tag": "6f7bc51a-17c9-4327-a4af-7e41ba429351"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:07.939020 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:07.939020 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:07.949498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3aa75d38-de30-4901-877a-6e73efcc9724 req-492bc5e7-9dff-4591-b473-bb90bf89b3eb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.950247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3aa75d38-de30-4901-877a-6e73efcc9724 req-492bc5e7-9dff-4591-b473-bb90bf89b3eb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:07.973461 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3aa75d38-de30-4901-877a-6e73efcc9724 req-492bc5e7-9dff-4591-b473-bb90bf89b3eb service nova] Creating event network-vif-plugged:f16e15df-4fce-4c6d-95cf-1ba7fe36760e for instance 6b988b5a-9dfb-4db8-9388-bae126fcf4fc on nch2-master-1 Feb 12 21:20:07.973461 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3aa75d38-de30-4901-877a-6e73efcc9724 req-492bc5e7-9dff-4591-b473-bb90bf89b3eb service nova] Creating event network-vif-plugged:6f7bc51a-17c9-4327-a4af-7e41ba429351 for instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 on nch1-master-1 Feb 12 21:20:07.980137 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3aa75d38-de30-4901-877a-6e73efcc9724 req-492bc5e7-9dff-4591-b473-bb90bf89b3eb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047774 Feb 12 21:20:07.981392 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2222/4336] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:07.986594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-01b90726-0edb-4d12-ab44-326ed1f36fc1 req-62d4fa92-5f4d-4403-944b-67d43a6ab548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d926e2b-0f1a-45c6-aeff-35800faf7d40", "name": "network-vif-deleted", "tag": "fbbb7b5a-5ca5-4ff8-9dca-f3a9de052888"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:07.988907 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:07.988907 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:07.998736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-01b90726-0edb-4d12-ab44-326ed1f36fc1 req-62d4fa92-5f4d-4403-944b-67d43a6ab548 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:07.999398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-01b90726-0edb-4d12-ab44-326ed1f36fc1 req-62d4fa92-5f4d-4403-944b-67d43a6ab548 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.012566 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-01b90726-0edb-4d12-ab44-326ed1f36fc1 req-62d4fa92-5f4d-4403-944b-67d43a6ab548 service nova] Creating event network-vif-deleted:fbbb7b5a-5ca5-4ff8-9dca-f3a9de052888 for instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 on nch1-master-1 Feb 12 21:20:08.017962 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-01b90726-0edb-4d12-ab44-326ed1f36fc1 req-62d4fa92-5f4d-4403-944b-67d43a6ab548 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034994 Feb 12 21:20:08.020195 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2223/4337] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:08.027086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:08.028342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:08.037731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.038473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.042401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.042401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.079998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:08.090952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d21b3b07-42a8-4ae3-b3e8-16a5b7360e0c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.235971 Feb 12 21:20:08.092847 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2115/4338] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:07 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:08.556996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:08.567744 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1b0709b-10a7-480c-b2ec-d9046065bf7a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 200 len: 1310 microversion: 2.1 time: 0.545409 Feb 12 21:20:08.568633 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2224/4339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:08 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 1310 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:08.656874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:08.657692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:08.666074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.666936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.667855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.668407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.868776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:08.869610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:08.876618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.877411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.878626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.882438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.946630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:08.955984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a6765cbf-f402-4153-96f3-c0dd87877634 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.303197 Feb 12 21:20:08.957150 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2116/4340] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:08 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:08.963453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:08.964256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:08.970604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.971054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:08.971843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:08.972345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:09.044607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:09.053412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f684ce52-4c28-4d43-a12c-930318d1865f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1218 microversion: 2.1 time: 0.094105 Feb 12 21:20:09.054260 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2117/4341] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:08 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:09.110702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:09.111502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:09.120611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:09.121068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:09.121898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:09.122702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:09.311926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:09.322981 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4658027a-d627-4bb6-8522-560b7645a925 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.457707 Feb 12 21:20:09.325839 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2225/4342] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:08 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:09.420120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:09.428350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b30a740c-26a5-4f2b-a087-64c12272e09c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1361 microversion: 2.1 time: 0.321632 Feb 12 21:20:09.438203 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2118/4343] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:09 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:09.587514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:09.588845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:09.606498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:09.607359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:09.608525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:09.611523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:09.640171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 could not be found. Feb 12 21:20:09.640841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:20:09.641784 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e955b6e3-6fa3-4ae4-94da-bbbe6bac2af0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 404 len: 111 microversion: 2.1 time: 0.060160 Feb 12 21:20:09.642466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2226/4344] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:09 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:20:09.651011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08f8d381-5e49-44cf-acdb-b3b0c97f2b73 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '.version_select at 0x7fa907eb4e50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:09.771013 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08f8d381-5e49-44cf-acdb-b3b0c97f2b73 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-key-1607446" status: 202 len: 0 microversion: 2.1 time: 0.114185 Feb 12 21:20:09.771013 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2119/4345] 10.222.0.31 () {58 vars in 1199 bytes} [Sat Feb 12 21:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1607446 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:20:09.883517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1322163563", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:09.966000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:20:09.998558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:09.998558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:09.998558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:09.998558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:09.998558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:09.998558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.615137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:20:10.615643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:20:10.616215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:20:10.617007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:20:10.617572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:20:10.627046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.627582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.629701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.630303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.656131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:20:10.662541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:20:10.678942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:20:10.681743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:20:10.706632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:10.718347 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-863c3996-e565-41f6-9e82-94066b8becef tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.747075 Feb 12 21:20:10.719048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2120/4346] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:09 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:10.725148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:10.726081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:10.732741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.733715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.734561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.735159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.790588 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-571abeee-9609-4819-847f-7145e127e0bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911478 Feb 12 21:20:10.791449 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2227/4347] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:20:10.797039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:10.797713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:10.807843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.808347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.809729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.811117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.829214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:10.841929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-382eb507-91e3-4133-84bb-61fe5c850b93 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1272 microversion: 2.1 time: 0.121141 Feb 12 21:20:10.853109 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2121/4348] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:10 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:10.858294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-65ddeafe-d690-4dd2-902b-7874a5cfab88 req-4885e749-d94e-4f4f-a080-4ebb46a04466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83499a06-e03e-4abd-9f5a-9ff4288b66ac", "name": "network-vif-plugged", "status": "completed", "tag": "23815c6a-3d4b-4d91-8e5a-906a6a120afd"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:10.864568 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:10.864568 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:10.885091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-65ddeafe-d690-4dd2-902b-7874a5cfab88 req-4885e749-d94e-4f4f-a080-4ebb46a04466 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.885728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-65ddeafe-d690-4dd2-902b-7874a5cfab88 req-4885e749-d94e-4f4f-a080-4ebb46a04466 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.907130 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-65ddeafe-d690-4dd2-902b-7874a5cfab88 req-4885e749-d94e-4f4f-a080-4ebb46a04466 service nova] Creating event network-vif-plugged:23815c6a-3d4b-4d91-8e5a-906a6a120afd for instance 83499a06-e03e-4abd-9f5a-9ff4288b66ac on nch2-master-1 Feb 12 21:20:10.912561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-65ddeafe-d690-4dd2-902b-7874a5cfab88 req-4885e749-d94e-4f4f-a080-4ebb46a04466 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066556 Feb 12 21:20:10.913588 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2122/4349] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:10.919805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:10.920642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:10.930024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.930787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:10.931803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:10.932356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:11.089276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:11.099270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-791d0f48-ea29-4c83-bdb4-500ae7f6e6e6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.306445 Feb 12 21:20:11.099836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2228/4350] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:10 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:11.106197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70933f70-3ac8-4a4c-bc5f-b7a555a01fbe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:11.106806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70933f70-3ac8-4a4c-bc5f-b7a555a01fbe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:11.175122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70933f70-3ac8-4a4c-bc5f-b7a555a01fbe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:11.183848 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70933f70-3ac8-4a4c-bc5f-b7a555a01fbe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1209 microversion: 2.1 time: 0.082389 Feb 12 21:20:11.184755 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2229/4351] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:11 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:11.547866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:11.556946 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ced3f2f-2dcc-4289-9c38-465f0473a0bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1547 microversion: 2.1 time: 0.642059 Feb 12 21:20:11.557903 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2123/4352] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:10 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1547 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:11.575227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:11.575748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:11.585206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:11.586008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:11.587012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:11.587840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:11.678614 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-888e7829-5e67-495f-8a1f-590db496eaca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106966 Feb 12 21:20:11.679547 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2230/4353] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:20:11 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:11.735476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:11.736232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:11.753673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:11.757232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:11.758297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:11.758752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:11.860318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:11.861055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:11.869675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:11.870409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:11.871333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:11.871922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:12.135790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:12.157539 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7ef2f4c-0cea-4e54-a06c-7f8d39e536cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.419411 Feb 12 21:20:12.164612 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2124/4354] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:11 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:12.172181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:12.172820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:12.194340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:12.203297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:12.203297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:12.204081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:12.498716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:12.506569 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd793f61-4465-4891-b297-a73b0654ec4c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1321 microversion: 2.1 time: 0.340164 Feb 12 21:20:12.516390 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2125/4355] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:12 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:12.522798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:12.523457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:12.529973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:12.530651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:12.531443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:12.532078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:12.618381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:12.625158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:12.627262 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1cda737-7914-47f8-99d4-71c6118863d4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1261 microversion: 2.1 time: 0.109498 Feb 12 21:20:12.627859 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2126/4356] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:12 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:12.644804 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f0fa657e-cc2d-48ea-a703-3eb784c880b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.788210 Feb 12 21:20:12.645688 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2231/4357] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:11 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:13.172865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:13.174616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:13.187613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:13.188379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:13.189554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:13.190191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:13.525403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:13.528980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:13.539165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:13.540840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:13.542789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:13.543411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:13.812536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:13.820722 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d5891274-b480-4c14-b5ab-bad8840293ee tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.656430 Feb 12 21:20:13.821324 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2127/4358] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:13 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:13.834721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:13.835345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:13.843614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:13.844530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:13.845584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:13.846201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:14.017093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:14.032046 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de3e090a-8800-467f-b433-63faf66af79c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1267 microversion: 2.1 time: 0.209264 Feb 12 21:20:14.033462 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2128/4359] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:13 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:14.040117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:14.040939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:14.049146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:14.049706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:14.050537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:14.051710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:14.398764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:14.408608 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82f046f6-22c8-4e20-9d5d-4e391cff80c1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1512 microversion: 2.1 time: 0.889354 Feb 12 21:20:14.409872 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2232/4360] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:13 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1512 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:14.425840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:14.427003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:14.433944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:14.434398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:14.435193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:14.435844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:14.814972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:14.828985 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4eec2c4f-f6e6-4d5a-97a9-15e1e81ab4ef tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.792876 Feb 12 21:20:14.839511 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2129/4361] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:14 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:14.844662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:14.846634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:14.853136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:14.853855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:14.854836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:14.855965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.085680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:15.096853 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-317277b1-58e1-4726-856b-1993206db1c8 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1512 microversion: 2.1 time: 0.674700 Feb 12 21:20:15.109552 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2233/4362] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:14 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1512 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:15.114883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:15.115712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:15.123203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.124023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.126214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.126874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.256997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:15.265095 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bed89d65-0a78-4299-b62c-0a86ce10bdec tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1267 microversion: 2.1 time: 0.153551 Feb 12 21:20:15.265730 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2234/4363] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:15 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:15.291753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e51c6579-3a53-47ad-ba19-5ec0e1f2dcfb req-daf4d9a9-f484-4ff9-92c9-9919be4f437b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8df7ff-9049-4b7d-940f-776982de0700", "tag": "a500c7b1-8358-4bc8-ae00-21079afb6cb4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:15.293749 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:15.293749 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:15.336639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e51c6579-3a53-47ad-ba19-5ec0e1f2dcfb req-daf4d9a9-f484-4ff9-92c9-9919be4f437b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.336639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e51c6579-3a53-47ad-ba19-5ec0e1f2dcfb req-daf4d9a9-f484-4ff9-92c9-9919be4f437b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.372741 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e51c6579-3a53-47ad-ba19-5ec0e1f2dcfb req-daf4d9a9-f484-4ff9-92c9-9919be4f437b service nova] Creating event network-changed:a500c7b1-8358-4bc8-ae00-21079afb6cb4 for instance 1d8df7ff-9049-4b7d-940f-776982de0700 on nch2-master-1 Feb 12 21:20:15.383508 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e51c6579-3a53-47ad-ba19-5ec0e1f2dcfb req-daf4d9a9-f484-4ff9-92c9-9919be4f437b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096568 Feb 12 21:20:15.386736 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2235/4364] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:15.405687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:15.405687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:15.415769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.416435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.419842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.421063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.468468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:15.476619 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5591730-067d-4de2-9954-8ec005199fc6 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.635632 Feb 12 21:20:15.480007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2130/4365] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:14 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:15.598251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:15.598777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:15.616414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.616791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.623476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.623982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.683092 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57e438ee-4bb7-4c74-9608-640759e9acdc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/ips" status: 200 len: 106 microversion: 2.1 time: 0.088891 Feb 12 21:20:15.698930 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2131/4366] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:20:15 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/ips => generated 106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:20:15.698930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5eb2076d-fee5-492c-9b15-b69b8720d1a2 req-424edd08-c102-4726-863d-e8e3f608372d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "245ee706-32b5-4ae4-bf28-f1e5139ea077", "tag": "6f7bc51a-17c9-4327-a4af-7e41ba429351"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:15.704388 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:15.704388 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:15.726525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5eb2076d-fee5-492c-9b15-b69b8720d1a2 req-424edd08-c102-4726-863d-e8e3f608372d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.727179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5eb2076d-fee5-492c-9b15-b69b8720d1a2 req-424edd08-c102-4726-863d-e8e3f608372d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.759086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5eb2076d-fee5-492c-9b15-b69b8720d1a2 req-424edd08-c102-4726-863d-e8e3f608372d service nova] Creating event network-changed:6f7bc51a-17c9-4327-a4af-7e41ba429351 for instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 on nch1-master-1 Feb 12 21:20:15.767510 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5eb2076d-fee5-492c-9b15-b69b8720d1a2 req-424edd08-c102-4726-863d-e8e3f608372d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082084 Feb 12 21:20:15.769279 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2132/4367] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:15.874990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:15.874990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:15.874990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.874990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:15.874990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:15.874990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:16.031424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:16.043171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba1c80a7-8163-421b-996d-5a52839451df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 200 len: 1512 microversion: 2.1 time: 0.653902 Feb 12 21:20:16.043768 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2236/4368] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:15 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 1512 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:16.067723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:16.074310 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:16.074310 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:16.076695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:16.079280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:16.108261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:16.109155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:16.110212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:16.110823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:16.330174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:16.419266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:16.427722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:16.428324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:16.760163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:16.784137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b5b2a276-4de9-4f2d-9257-28b01c1931f1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.940147 Feb 12 21:20:16.795067 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2133/4369] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:15 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:16.804891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:16.807362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:16.820159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:16.821005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:16.822375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:16.823157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:17.165337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb5b762a-8f66-4b31-9359-82f9a8940bfb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.108119 Feb 12 21:20:17.166314 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2237/4370] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 21:20:16 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:17.183008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:17.183990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:17.195435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:17.198566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:17.198566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:17.198566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:17.520429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:17.533163 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f3a9195-9d28-4b44-9143-8214d9de325f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.364707 Feb 12 21:20:17.536115 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2238/4371] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:17 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:17.548843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:17.557817 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:17.557817 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:17.558958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:17.559779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1545300758', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:17.566152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:17.566840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:17.568039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:17.568872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:17.727550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:17.828693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:17.842451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:17.843243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.071537 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a5a1b1f-3baa-4cf2-8328-2984bc0b7f07 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1545300758" status: 200 len: 1515 microversion: 2.1 time: 0.533923 Feb 12 21:20:18.072419 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2239/4372] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:20:17 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1545300758 => generated 1515 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:18.077425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:18.078357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:18.090701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.092572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.093690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.094375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.119450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:18.126965 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-330e2c83-d91d-4fba-ab6e-9aab259c979d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 1.331913 Feb 12 21:20:18.130269 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2134/4373] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:16 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:18.141160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:18.153439 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:18.153439 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:18.154558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:18.155471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:18.168313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.168769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.169604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.175114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.336965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:18.483453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:18.499548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.500311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.756914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:18.768827 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0c4c8b0-5ade-4e06-99a6-586f87df4c96 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.695055 Feb 12 21:20:18.770254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2240/4374] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:18 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:18.787407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:18.788039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:18.794591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.795061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:18.795881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:18.796327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.232490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:19.241508 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f7231daf-afeb-4a73-aacd-c98f8467afc3 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.470283 Feb 12 21:20:19.242828 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2241/4375] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:18 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:19.248046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:19.248906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:19.256487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.257307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.258376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.259035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.409171 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-46d70816-a110-4558-bfc1-792a52f5344a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.272903 Feb 12 21:20:19.423388 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2135/4376] 10.222.0.31 () {58 vars in 1172 bytes} [Sat Feb 12 21:20:18 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:19.437147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:19.442504 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:19.442504 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:19.444933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:19.445880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.servers [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Removing options 'limit' from query {{(pid=141726) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1488}} Feb 12 21:20:19.447593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:19.453566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.454661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.455937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.457778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.508316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:19.516299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.517076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.733977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:19.746944 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b04b9e4d-a1cc-4976-b5aa-7b2dcbcdd443 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.502672 Feb 12 21:20:19.748221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2242/4377] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:19 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:19.787267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:19.790610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:19.794587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.795130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.796010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.796516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:19.954841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4846e014-a454-4b9e-942f-bb4b3d6cb701 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.524191 Feb 12 21:20:19.973556 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2136/4378] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:20:19 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:19.973556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-69e3687f-7644-43b9-8859-269b10294dd6 req-57378360-64f1-41d9-9ad2-bb8a65b340b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "614e2dee-b81e-4a15-91f6-be8faf694be7", "tag": "0762ac45-f397-472b-8939-3d99e373982f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:19.973556 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:19.973556 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:19.981626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-69e3687f-7644-43b9-8859-269b10294dd6 req-57378360-64f1-41d9-9ad2-bb8a65b340b3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:19.982302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-69e3687f-7644-43b9-8859-269b10294dd6 req-57378360-64f1-41d9-9ad2-bb8a65b340b3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.003559 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-69e3687f-7644-43b9-8859-269b10294dd6 req-57378360-64f1-41d9-9ad2-bb8a65b340b3 service nova] Creating event network-changed:0762ac45-f397-472b-8939-3d99e373982f for instance 614e2dee-b81e-4a15-91f6-be8faf694be7 on nch1-master-1 Feb 12 21:20:20.009060 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-69e3687f-7644-43b9-8859-269b10294dd6 req-57378360-64f1-41d9-9ad2-bb8a65b340b3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051659 Feb 12 21:20:20.010366 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2137/4379] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:20.015819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.020426 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:20.020426 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:20.022113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.023202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:20.029563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.030349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.031399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.032108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.135431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.144055 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-20296d0f-1681-493b-b192-247a34dffff0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.361123 Feb 12 21:20:20.154431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:20.155083 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2243/4380] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:19 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:20.262696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.263426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:20.277404 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0589e760-a1dd-4af6-929c-5b0396c8605e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.265534 Feb 12 21:20:20.279453 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2138/4381] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:20.286254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.286254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.286254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.288321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.293184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.297303 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:20.297303 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:20.303778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.304613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.servers [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Removing options 'limit' from query {{(pid=141726) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1488}} Feb 12 21:20:20.305841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:20.312058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.312787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.313857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.314647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.346834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:20.387642 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-512425c5-8df5-49e4-99b5-60de2fc1a386 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.099498 Feb 12 21:20:20.394601 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2139/4382] 10.222.0.31 () {58 vars in 1149 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:20.400709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.403936 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:20.403936 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:20.405631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.406369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:20.418614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.419694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.420606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.421108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.475493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:20.525278 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b1f47fb3-b0cd-4fb1-b02b-5f9d94a8d98b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.129101 Feb 12 21:20:20.533774 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2140/4383] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers => generated 1011 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:20.557693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.563157 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:20.563157 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:20.567292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.568445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:20.611467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.611785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.611931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.612772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.613814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.621660 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e384f8a9-469e-4085-bfe3-580cf00f93c2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.364677 Feb 12 21:20:20.635179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2244/4384] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:20.729643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:20.767053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.768176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:20.779850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.780135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.786754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.787094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.834406 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fceda3e-036a-4915-9bac-c2bfdc15e56b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.299227 Feb 12 21:20:20.835007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2141/4385] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:20.859271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.863322 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:20.863322 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:20.864661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.865115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.servers [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Removing options 'limit' from query {{(pid=141726) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1488}} Feb 12 21:20:20.865810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:20.878176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.878176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.878176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.878176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.909097 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bf5dc56a-3902-4670-b2e0-55ed979c8e72 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.063650 Feb 12 21:20:20.918239 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2142/4386] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:20.923562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:20.928533 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:20.928533 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:20.929750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:20.930573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1545300758', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:20.936637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.936637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:20.937383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:20.938073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:21.045765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:21.178560 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a56a47e-40a2-4a70-95b0-f668df03c8f4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1545300758" status: 200 len: 346 microversion: 2.1 time: 0.258682 Feb 12 21:20:21.179702 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2143/4387] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1545300758 => generated 346 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:21.187487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:21.188255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:21.198670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:21.199138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:21.200717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:21.201310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:21.427318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:21.440882 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ab6b13a-36a3-4816-92a9-12c12fd93579 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.680096 Feb 12 21:20:21.457559 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2245/4388] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:20 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:21.468563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b901790-6a82-4f6f-82a6-4b2260a827df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:21.480623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b901790-6a82-4f6f-82a6-4b2260a827df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:21.481344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b901790-6a82-4f6f-82a6-4b2260a827df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:21.574795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2b901790-6a82-4f6f-82a6-4b2260a827df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:20:21.764091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b901790-6a82-4f6f-82a6-4b2260a827df tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "POST /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b/action" status: 202 len: 0 microversion: 2.1 time: 0.304723 Feb 12 21:20:21.765057 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2246/4389] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:20:21 2022] POST /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:20:21.776379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:21.777589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:21.787260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:21.788251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:21.789336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:21.790380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:21.990720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:21.999544 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5fa24824-0da1-4215-b99d-1d4c20ecaedf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.818676 Feb 12 21:20:22.005957 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2144/4390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:21 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:22.008728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:22.020573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:22.021418 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b6bac7b0-48d4-45b3-8ec2-1839f2abc31b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.254618 Feb 12 21:20:22.021661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:22.022349 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2247/4391] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:21 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:22.039021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:22.039500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:22.040316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:22.041001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:22.464996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:22.465701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:22.473515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:22.480822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:22.481855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:22.483240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:22.483914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:22.489291 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6738d22a-0620-40fa-886c-8dbd9983fdc5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.481640 Feb 12 21:20:22.490165 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2145/4392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:22 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:22.810271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:22.822694 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e555e660-3605-41d2-8015-7cef9d2bc397 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.362550 Feb 12 21:20:22.824004 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2248/4393] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:22 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:23.022562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:23.023888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:23.030629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.031403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.034041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.034743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.043599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:23.044518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:23.056593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.057100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.059275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.062008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.334536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:23.346218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0d459980-5978-48d3-8744-97c2a114fd72 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1516 microversion: 2.1 time: 0.310841 Feb 12 21:20:23.366313 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2249/4394] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:23 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:23.398450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:23.413579 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e17a4d9d-7318-44ab-88dd-a2e4e06092c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.388621 Feb 12 21:20:23.413579 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2146/4395] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:23 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:23.507548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:23.508164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:23.514797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.515261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.516039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.516478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.685618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:23.695668 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e99a61d1-afaa-4469-af5d-bbda4f3d9c15 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.192651 Feb 12 21:20:23.706357 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2250/4396] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:23 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:23.841675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:23.844165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:23.852986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.859260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:23.864764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:23.865493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.115657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:24.127633 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-06225b54-0ccf-4bc5-9448-30097d2da22a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.290630 Feb 12 21:20:24.138369 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2147/4397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:23 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:24.363596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:24.364479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:24.386887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.387346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.388142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.388582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.433592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:24.434205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:24.449110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.453574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.453574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.453574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.655553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:24.668123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5605b371-3ec7-4157-95be-8a0006861832 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.242243 Feb 12 21:20:24.686805 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2148/4398] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:24 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:24.713717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:24.714338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:24.733458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.735035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.736601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.737320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.807400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:24.816180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41dc8f97-cef3-4d07-a401-b20b574e4d56 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1522 microversion: 2.1 time: 0.456689 Feb 12 21:20:24.816976 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2251/4399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:24 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:24.831155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b5dcc681-6ea9-403a-bf98-8fdb1bc10593 req-abfccf49-74ce-409e-9d61-4db9c0e76638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8df7ff-9049-4b7d-940f-776982de0700", "name": "network-vif-plugged", "status": "completed", "tag": "a500c7b1-8358-4bc8-ae00-21079afb6cb4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:24.833027 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:24.833027 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:24.842775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b5dcc681-6ea9-403a-bf98-8fdb1bc10593 req-abfccf49-74ce-409e-9d61-4db9c0e76638 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:24.845084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b5dcc681-6ea9-403a-bf98-8fdb1bc10593 req-abfccf49-74ce-409e-9d61-4db9c0e76638 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:24.858739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b5dcc681-6ea9-403a-bf98-8fdb1bc10593 req-abfccf49-74ce-409e-9d61-4db9c0e76638 service nova] Creating event network-vif-plugged:a500c7b1-8358-4bc8-ae00-21079afb6cb4 for instance 1d8df7ff-9049-4b7d-940f-776982de0700 on nch2-master-1 Feb 12 21:20:24.864936 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b5dcc681-6ea9-403a-bf98-8fdb1bc10593 req-abfccf49-74ce-409e-9d61-4db9c0e76638 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037328 Feb 12 21:20:24.866156 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2252/4400] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:25.079210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:25.093661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-56e4ed9e-33de-487f-8e37-1b9c673bfb18 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.381349 Feb 12 21:20:25.093661 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2149/4401] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:24 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:25.154942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:25.156110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:25.167292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:25.170949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:25.172668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:25.174029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:25.490661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:25.498608 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58a8e616-23cb-462e-bb05-b274eee39ca6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.350091 Feb 12 21:20:25.499316 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2253/4402] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:25 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:25.688680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:25.690190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:25.698074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:25.698523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:25.699324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:25.699989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:25.834601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:25.835981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:25.856911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:25.857818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:25.859499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:25.860350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:26.048679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:26.063605 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e54a06dc-343e-4f2e-9000-71116f6bbcfe tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1314 microversion: 2.1 time: 0.381407 Feb 12 21:20:26.064215 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2150/4403] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:25 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:26.112190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:26.112949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:26.124271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:26.125018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:26.126341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:26.127016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:26.590548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:26.598963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6faa026a-4245-4723-ae81-1772b4765bf9 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1522 microversion: 2.1 time: 0.769098 Feb 12 21:20:26.599562 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2254/4404] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:25 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:26.612871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:26.618220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:26.628050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:26.630824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:26.640561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:26.641300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:26.682086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:26.688072 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d40cce1c-9c23-45e1-ab26-d92e4720d101 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.581046 Feb 12 21:20:26.709834 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2151/4405] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:26 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:26.909216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bae3495e-74fc-4fa8-a439-dbe34c1292fb req-62f684f5-612d-41d3-9563-d575f7662654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd", "name": "network-vif-unplugged", "status": "completed", "tag": "56d77b1f-6780-4fa2-af74-237c0810bff8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:26.913482 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:26.913482 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:26.920567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bae3495e-74fc-4fa8-a439-dbe34c1292fb req-62f684f5-612d-41d3-9563-d575f7662654 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:26.921308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bae3495e-74fc-4fa8-a439-dbe34c1292fb req-62f684f5-612d-41d3-9563-d575f7662654 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:26.947995 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bae3495e-74fc-4fa8-a439-dbe34c1292fb req-62f684f5-612d-41d3-9563-d575f7662654 service nova] Creating event network-vif-unplugged:56d77b1f-6780-4fa2-af74-237c0810bff8 for instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd on nch2-master-1 Feb 12 21:20:26.954531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:26.970430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-21ae5d10-7a76-4597-877d-2d548245c6f8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.362010 Feb 12 21:20:26.970430 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2255/4406] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:26 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:26.972167 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bae3495e-74fc-4fa8-a439-dbe34c1292fb req-62f684f5-612d-41d3-9563-d575f7662654 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068544 Feb 12 21:20:26.976170 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2152/4407] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:27.082881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:27.083773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:27.091642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.092375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:27.094303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.095732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:27.438548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:27.449780 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60e03a04-c196-4597-8173-614f28d0c6b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1500 microversion: 2.1 time: 0.370850 Feb 12 21:20:27.450165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2256/4408] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:27 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1500 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:27.475531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-240c7125-4c74-4ac7-a36e-51c2eec82b0d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:27.484687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-240c7125-4c74-4ac7-a36e-51c2eec82b0d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.486068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-240c7125-4c74-4ac7-a36e-51c2eec82b0d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:27.527236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-240c7125-4c74-4ac7-a36e-51c2eec82b0d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Going to try to stop instance {{(pid=141726) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:20:27.615801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:27.616689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:27.625261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.627136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:27.628177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.629747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:27.775018 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-240c7125-4c74-4ac7-a36e-51c2eec82b0d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700/action" status: 202 len: 0 microversion: 2.1 time: 0.309903 Feb 12 21:20:27.776703 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2153/4409] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:20:27 2022] POST /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:20:27.803203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:27.804319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:27.812954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.814411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:27.815574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:27.816401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:28.002985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:28.014778 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-604df388-a63d-42e7-addc-8798cb8af6e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1522 microversion: 2.1 time: 0.400393 Feb 12 21:20:28.016709 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2257/4410] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:27 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:28.028021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:28.028709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:28.046795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:28.047360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:28.048298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:28.048994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:28.173851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:28.186340 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c9231bd-5308-4769-aa45-483d3fb6029e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.407473 Feb 12 21:20:28.196466 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2154/4411] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:27 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:28.201318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:28.202273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:28.209842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:28.211783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:28.213275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:28.213964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:28.325779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:28.333653 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a6be36e-db31-402c-b688-6a23d89eef89 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.315101 Feb 12 21:20:28.345083 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2258/4412] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:28 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:28.403752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:28.412061 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21a361c0-1e93-4633-ae84-e9f1488353bd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.222341 Feb 12 21:20:28.412643 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2155/4413] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:28 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:29.011215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-27780a10-d5e0-4d59-8b67-4eff55a6d8cf req-12ac120a-42e8-4140-9a22-41a9279b7133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614e2dee-b81e-4a15-91f6-be8faf694be7", "name": "network-vif-plugged", "status": "completed", "tag": "0762ac45-f397-472b-8939-3d99e373982f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:29.011215 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:29.011215 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:29.023042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-27780a10-d5e0-4d59-8b67-4eff55a6d8cf req-12ac120a-42e8-4140-9a22-41a9279b7133 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.023542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-27780a10-d5e0-4d59-8b67-4eff55a6d8cf req-12ac120a-42e8-4140-9a22-41a9279b7133 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.033965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:29.034639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:29.037896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-27780a10-d5e0-4d59-8b67-4eff55a6d8cf req-12ac120a-42e8-4140-9a22-41a9279b7133 service nova] Creating event network-vif-plugged:0762ac45-f397-472b-8939-3d99e373982f for instance 614e2dee-b81e-4a15-91f6-be8faf694be7 on nch1-master-1 Feb 12 21:20:29.044555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-27780a10-d5e0-4d59-8b67-4eff55a6d8cf req-12ac120a-42e8-4140-9a22-41a9279b7133 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040431 Feb 12 21:20:29.044691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.044791 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2259/4414] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:29.047271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.048085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.048527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.204590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:29.205719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:29.215679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.216210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.217089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.217800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.477540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:29.487906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbdb0180-5a6f-4c2b-ae33-841b520265fe tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1522 microversion: 2.1 time: 0.457711 Feb 12 21:20:29.489670 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2156/4415] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:29 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:29.495337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:29.496246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:29.496553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:29.505047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.505826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.506900 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-15eae173-5f87-43f0-8419-9105d8e22306 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.306571 Feb 12 21:20:29.516583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2260/4416] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:29 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:29.516583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:29.516583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:29.519740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.519740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.519942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.520487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.521400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:29.521878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:29.701101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:29.703136 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c5520ba-4cbc-43db-b1e9-8ddef78f71e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.212093 Feb 12 21:20:29.714490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2157/4417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:29 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:29.842110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:29.849929 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc84eb0c-e490-48a3-9a18-aee645266cb5 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1309 microversion: 2.1 time: 0.340641 Feb 12 21:20:29.850539 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2261/4418] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:29 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:30.506106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:30.506701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:30.513229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:30.519240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:30.520269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:30.520724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:30.525657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:30.527810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:30.537335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:30.538294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:30.539510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:30.539947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:30.897188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:30.905976 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58d19d55-2843-4184-9482-6215a5ff06fa tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.385656 Feb 12 21:20:30.907013 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2262/4419] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:30 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:30.912626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:30.918922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:30.920717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:30.921170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:30.922366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:30.922805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:31.142732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:31.151900 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b79de485-28d5-4de5-9ef9-c1befcce52bd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1522 microversion: 2.1 time: 0.649869 Feb 12 21:20:31.152408 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2158/4420] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:30 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:31.157218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:31.158298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:31.165719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:31.166170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:31.167145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:31.167832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:31.313901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:31.322115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-061042be-a7cd-4a1c-99fc-42fbd9209ce8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1488 microversion: 2.1 time: 0.168389 Feb 12 21:20:31.329676 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2159/4421] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:31 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1488 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:31.335494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-aa684e34-1136-4598-8bf7-d24b82dd8520 req-d3f1b74d-e5d0-4687-8bfa-0a0fcf9e54f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd", "name": "network-vif-plugged", "status": "completed", "tag": "56d77b1f-6780-4fa2-af74-237c0810bff8"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:31.337241 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:31.337241 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:31.356772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-aa684e34-1136-4598-8bf7-d24b82dd8520 req-d3f1b74d-e5d0-4687-8bfa-0a0fcf9e54f1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:31.358374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-aa684e34-1136-4598-8bf7-d24b82dd8520 req-d3f1b74d-e5d0-4687-8bfa-0a0fcf9e54f1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:31.362158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:31.374501 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25e98b8a-d054-410e-9016-95ae106461b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.464773 Feb 12 21:20:31.376803 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2263/4422] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:30 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:31.386491 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-aa684e34-1136-4598-8bf7-d24b82dd8520 req-d3f1b74d-e5d0-4687-8bfa-0a0fcf9e54f1 service nova] Creating event network-vif-plugged:56d77b1f-6780-4fa2-af74-237c0810bff8 for instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd on nch2-master-1 Feb 12 21:20:31.396817 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-aa684e34-1136-4598-8bf7-d24b82dd8520 req-d3f1b74d-e5d0-4687-8bfa-0a0fcf9e54f1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065978 Feb 12 21:20:31.398941 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2160/4423] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:31.481774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1322163563", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:31.557894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:20:31.925124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:31.926185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:31.932370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:31.932851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:31.933687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:31.934126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.158014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:20:32.158271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:20:32.158997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:20:32.159637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:20:32.160854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:20:32.173537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:32.177572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.180093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:32.181170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.204796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:20:32.211765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:20:32.219430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:32.233966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:20:32.236526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:20:32.242975 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db1a9dbd-9671-4021-ac06-d68ab8867a7b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.322647 Feb 12 21:20:32.257067 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2161/4424] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:31 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:32.262497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:32.263485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:32.272176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:32.272737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.274438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:32.275243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.440929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:32.449213 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5c86265-ec2b-406d-8e20-7ed7fb60989a tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1522 microversion: 2.1 time: 0.190584 Feb 12 21:20:32.449835 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2162/4425] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:32 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:32.454049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:32.454789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:32.461343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:32.461833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.462623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:32.463066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:32.562394 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31c92145-7939-47c4-b25b-ac8a980ddcf9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087140 Feb 12 21:20:32.567666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2264/4426] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:20:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:20:32.584129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bffa71c7-bae6-4357-9a65-868da2bc23bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:32.603416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bffa71c7-bae6-4357-9a65-868da2bc23bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:32.685963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bffa71c7-bae6-4357-9a65-868da2bc23bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:32.694596 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bffa71c7-bae6-4357-9a65-868da2bc23bf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1209 microversion: 2.1 time: 0.115248 Feb 12 21:20:32.695665 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2265/4427] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:32 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:32.731579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:32.740148 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed9fbdcc-1050-4e7e-88e7-ff039ad0c282 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.289295 Feb 12 21:20:32.740956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2163/4428] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:32 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:33.260738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:33.261400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:33.267737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.268260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.269205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.269904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.439173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:33.448060 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70be65b7-0be4-4c24-8e8c-24f4cbfd3393 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.191136 Feb 12 21:20:33.448749 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2266/4429] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:33 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:33.467894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:33.468634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:33.476555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.478625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.479899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.480817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.713424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:33.714647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:33.721940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.722424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.723221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.723686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.788661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:33.811389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:33.815057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-acd89803-2a66-44a9-8866-58d201d390e4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1507 microversion: 2.1 time: 0.351798 Feb 12 21:20:33.815876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2164/4430] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:33 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:33.822283 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0c7afb1-cce4-473e-8c45-3e8f62a91aea tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1213 microversion: 2.1 time: 0.113858 Feb 12 21:20:33.823572 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2267/4431] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:33 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:33.837156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:33.839090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:33.839403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:33.840261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:33.847105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.847989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.848269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.849092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.849501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.849733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:33.850873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:33.852043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.025018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:34.034641 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3733a5e1-72de-4d1f-b512-d848923d6ce5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 200 len: 1507 microversion: 2.1 time: 0.198503 Feb 12 21:20:34.036074 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2268/4432] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:33 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:34.054688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:34.055719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:34.063057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:34.063512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.064497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:34.065948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.095506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:34.212908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:34.224523 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6dee769a-dff0-4b96-8614-b43b75aa514b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.406725 Feb 12 21:20:34.225236 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2165/4433] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:33 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:34.465512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:34.466408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:34.472594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:34.473852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.474884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:34.475418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.485557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3744d150-8c28-499c-b807-c57f38cfa630 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 204 len: 0 microversion: 2.1 time: 0.437443 Feb 12 21:20:34.486158 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2269/4434] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:34 2022] DELETE /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:20:34.609839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1685439575", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "19170c93-d9ce-4497-9280-91aac6f17f7b"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:34.701538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] validate_networks() for [('19170c93-d9ce-4497-9280-91aac6f17f7b', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:20:34.748963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:34.766853 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a836829f-11b2-4f80-aeb2-014da76d01ae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.305067 Feb 12 21:20:34.767457 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2166/4435] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:34 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:34.839927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:34.840936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:34.847094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:34.847645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.848627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:34.849060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:34.990703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:34.998855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e54dd489-f5a6-4134-aba9-2cb770857472 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1261 microversion: 2.1 time: 0.162533 Feb 12 21:20:35.004517 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2167/4436] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:34 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:35.242414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:35.250679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:35.255430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:35.256052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:35.257145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:35.257758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:35.672036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:20:35.673840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:20:35.674669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:20:35.675819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:20:35.676520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:20:35.687751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:35.689738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:35.692376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:35.694223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:35.713580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Getting quotas for project cf7e0df130604d2b9dab6a7fb331f5c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:20:35.719274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Getting quotas for user c2d612e20334459eb9f7b2cdee9320bc and project cf7e0df130604d2b9dab6a7fb331f5c6. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:20:35.732572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:20:35.735036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:20:35.839548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:35.847899 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-29831f48-62c2-441c-920a-9efceeb07d6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.609366 Feb 12 21:20:35.848529 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2168/4437] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:35 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:35.853519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:35.854130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:35.859792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:35.860313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:35.861104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:35.861581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:36.010680 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2c473e38-fca8-49d0-85fe-11b814bbddbf tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400338 Feb 12 21:20:36.011774 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2270/4438] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:20:36.043561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:36.043561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:36.058662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:36.077647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:36.077647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:36.077647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:36.225731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:36.234197 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ec15cceb-bddf-4d08-ace2-89ab2d12798a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1267 microversion: 2.1 time: 0.216045 Feb 12 21:20:36.245871 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2271/4439] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:36 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:36.245871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79a6fdb9-9458-4c52-85d9-10bc4f4fb915 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:36.259685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79a6fdb9-9458-4c52-85d9-10bc4f4fb915 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:36.333865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79a6fdb9-9458-4c52-85d9-10bc4f4fb915 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:36.340665 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79a6fdb9-9458-4c52-85d9-10bc4f4fb915 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1218 microversion: 2.1 time: 0.102807 Feb 12 21:20:36.350338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2272/4440] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:36 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:36.387694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:36.406240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6dcd18d-6fd0-4456-b5a7-bad39a69629e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.556485 Feb 12 21:20:36.407246 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2169/4441] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:35 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:37.057046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:37.057046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:37.057046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.057046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.057046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.057046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.078970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:37.101524 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-99ce0d40-8c25-467c-b0d7-6ef4d2ceb232 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.237806 Feb 12 21:20:37.102136 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2273/4442] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:36 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:37.272520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:37.273747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:37.293070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.293559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.302513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.302513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.360844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:37.361938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:37.405088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.408145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.414633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.417766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.582170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:37.596424 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bdfbb7b0-e4e8-4f97-af3f-81899529ecf8 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1222 microversion: 2.1 time: 0.240311 Feb 12 21:20:37.598234 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2274/4443] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:37 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:37.622828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:37.623716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:37.633649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.634413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.635225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:37.635675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:37.835937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:37.844465 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-91d452e6-f93a-425d-9501-10f59cdb5eed tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.580811 Feb 12 21:20:37.845253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2170/4444] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:37 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:37.985621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:37.998497 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0bfa594d-5c50-4104-9c9d-9e5e7f641d0f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.395915 Feb 12 21:20:38.000942 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2275/4445] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:37 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:38.120326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:38.124976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:38.140544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.142248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:38.148277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.150413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:38.226045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a4429268-fe05-42bb-9006-1a9ccbbfcc93 req-83a321a0-5381-4810-b0a3-f91400a15d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd", "name": "network-vif-deleted", "tag": "56d77b1f-6780-4fa2-af74-237c0810bff8"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:38.227788 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:38.227788 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:38.246041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a4429268-fe05-42bb-9006-1a9ccbbfcc93 req-83a321a0-5381-4810-b0a3-f91400a15d81 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.246507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a4429268-fe05-42bb-9006-1a9ccbbfcc93 req-83a321a0-5381-4810-b0a3-f91400a15d81 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:38.270030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a4429268-fe05-42bb-9006-1a9ccbbfcc93 req-83a321a0-5381-4810-b0a3-f91400a15d81 service nova] Creating event network-vif-deleted:56d77b1f-6780-4fa2-af74-237c0810bff8 for instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd on nch2-master-1 Feb 12 21:20:38.276196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a4429268-fe05-42bb-9006-1a9ccbbfcc93 req-83a321a0-5381-4810-b0a3-f91400a15d81 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056424 Feb 12 21:20:38.278131 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2276/4446] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:38.539587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:38.552444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4b50050-b01c-4af6-afb4-62e424359f13 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.437165 Feb 12 21:20:38.565748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2171/4447] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:38 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:38.622916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:38.623863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:38.640319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.640970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:38.647484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.648431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:38.782918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:38.795021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b65bc087-33e6-420b-81af-c0d99cd3616c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1270 microversion: 2.1 time: 0.184693 Feb 12 21:20:38.795614 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2277/4448] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:38 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:38.868844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:38.870411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:38.884632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.885396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:38.887360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:38.888336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.018741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:39.020641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:39.031628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:39.032623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.035231 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:39.036360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.417759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:39.429428 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bbb1f38f-7a41-45cc-b52f-eeca2fa8658c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.417094 Feb 12 21:20:39.430029 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2278/4449] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:39 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:39.570057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:39.570735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:39.577989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:39.578544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.579350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:39.579791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.654792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:39.669953 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5089900b-2172-4327-ba5a-2059f5f4be2f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.810701 Feb 12 21:20:39.671580 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2172/4450] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:38 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:39.812802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:39.813753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:39.820533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:39.821198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.822643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:39.825855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:39.903426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:39.916195 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-265ee5ae-c9c3-4275-83d4-37c7e2050278 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.350276 Feb 12 21:20:39.936657 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2279/4451] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:39 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:40.013948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:40.027309 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a9550a5-99de-4da1-8919-01f441a0c349 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1276 microversion: 2.1 time: 0.219014 Feb 12 21:20:40.027997 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2173/4452] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:39 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:40.332274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-756c29c9-fa9d-48a2-a641-7668c98103e7 req-5d681562-702b-4cdf-be3b-fb8b6856e92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a7af65-ec45-4aa1-88d6-0034f7a4eed6", "tag": "327701bb-4024-4f42-a0e6-d17f1a51d3e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:40.335279 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:40.335279 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:40.349134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-756c29c9-fa9d-48a2-a641-7668c98103e7 req-5d681562-702b-4cdf-be3b-fb8b6856e92a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:40.349134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-756c29c9-fa9d-48a2-a641-7668c98103e7 req-5d681562-702b-4cdf-be3b-fb8b6856e92a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:40.362034 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-756c29c9-fa9d-48a2-a641-7668c98103e7 req-5d681562-702b-4cdf-be3b-fb8b6856e92a service nova] Creating event network-changed:327701bb-4024-4f42-a0e6-d17f1a51d3e6 for instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 on nch1-master-1 Feb 12 21:20:40.367879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-756c29c9-fa9d-48a2-a641-7668c98103e7 req-5d681562-702b-4cdf-be3b-fb8b6856e92a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043421 Feb 12 21:20:40.369192 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2280/4453] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:20:40.449858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:40.452125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:40.460993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:40.462273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:40.463591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:40.464803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:40.690392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:40.692674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:40.714659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:40.715394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:40.716453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:40.717478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3428fb9-02ce-4c6d-87ca-c2a4a650b30d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.297697 Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2281/4454] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:40 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:41.005497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:41.119400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:41.140762 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b177e8c3-cdf5-4c65-b442-112c5943ea39 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 0.687694 Feb 12 21:20:41.140762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2174/4455] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:40 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:41.140762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:41.140762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:41.144039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:41.144560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:41.145391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:41.145855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:41.543400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:41.553559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a74591c-b621-462e-a7e4-9ee15652a04e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.568032 Feb 12 21:20:41.563781 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2282/4456] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:40 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:41.583898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:41.599667 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a9b455d-192f-48b3-af9f-3664cc90e7a2 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.466113 Feb 12 21:20:41.614051 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2175/4457] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:41 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:42.012891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:42.013749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:42.022702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.024801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.026674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.027422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.148483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:42.149894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:42.162496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.163358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.164409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.170918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.376745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:42.386278 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f914b9f-fda3-483c-ac51-e47ef8146cf1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.378760 Feb 12 21:20:42.387200 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2283/4458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:42 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:42.571694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:42.572333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:42.579923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.580465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.586009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.586009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.913066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:42.920886 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-359c59aa-e1a0-473b-879a-43e7ba56d598 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.353450 Feb 12 21:20:42.921999 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2284/4459] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:42 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:42.926582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:42.931327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:42.934483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.935158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:42.936300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:42.936913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:43.144180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:43.153317 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8affaa36-f1f4-4cc3-98ee-65a89ce56e9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1522 microversion: 2.1 time: 1.009081 Feb 12 21:20:43.161831 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2176/4460] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:42 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1522 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:43.181127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:43.186936 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a4cc70e-7da0-4c09-af5c-4c2a587494d5 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.263561 Feb 12 21:20:43.187577 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2285/4461] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:42 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:43.404290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:43.405024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:43.414557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:43.415436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:43.417114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:43.417887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:43.958149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:43.960874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:43.993341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.004074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:44.006365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.010085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.012826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.013021 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85f64d0c-024d-466a-8ffe-172b27fe0bc9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.610961 Feb 12 21:20:44.023126 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2177/4462] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:43 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:44.152112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e991fb59-fb5e-4af6-aaa5-8d730ad2816f req-e9d7816d-030c-4be9-9422-102a59cc9930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77064ae-c12d-4359-9521-26b660d2d039", "tag": "1687b594-812e-4ad7-b4ef-c1a0818aa325"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:44.156531 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:44.156531 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:44.165248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e991fb59-fb5e-4af6-aaa5-8d730ad2816f req-e9d7816d-030c-4be9-9422-102a59cc9930 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.166149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e991fb59-fb5e-4af6-aaa5-8d730ad2816f req-e9d7816d-030c-4be9-9422-102a59cc9930 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.183760 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e991fb59-fb5e-4af6-aaa5-8d730ad2816f req-e9d7816d-030c-4be9-9422-102a59cc9930 service nova] Creating event network-changed:1687b594-812e-4ad7-b4ef-c1a0818aa325 for instance b77064ae-c12d-4359-9521-26b660d2d039 on nch2-master-1 Feb 12 21:20:44.190005 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e991fb59-fb5e-4af6-aaa5-8d730ad2816f req-e9d7816d-030c-4be9-9422-102a59cc9930 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044228 Feb 12 21:20:44.190739 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2178/4463] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:20:44.196461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:44.197589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:44.209343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.209343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.209343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.209878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.364344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:44.377050 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d249cc8-5dbd-4988-a63b-3df0251d6fe1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.441316 Feb 12 21:20:44.388408 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2286/4464] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:43 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:44.388408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:44.388408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:44.403165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.404225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.405183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:44.405768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:44.691601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:44.712967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0dfbe20e-2519-4932-84ce-3125dda3ca95 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.332400 Feb 12 21:20:44.726545 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2287/4465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:44 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:45.029645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:45.030721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:45.038239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.039100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.040121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.040883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.123977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:45.137144 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-297dbffb-e8af-4de2-918d-92251cf719d6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1499 microversion: 2.1 time: 0.944381 Feb 12 21:20:45.138010 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2179/4466] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:44 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1499 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:45.160248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:45.166337 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:45.166337 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:45.166337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:45.167213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:45.192968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.194146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.194675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.195121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.271475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:45.337305 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9fd9744-13d8-49a6-be49-0649cad7504a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.185929 Feb 12 21:20:45.343609 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2180/4467] 10.222.0.31 () {58 vars in 1153 bytes} [Sat Feb 12 21:20:45 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:45.349630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a788130-444a-4880-ba70-99297085b47a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:45.356135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a788130-444a-4880-ba70-99297085b47a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.356800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a788130-444a-4880-ba70-99297085b47a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.392790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0a788130-444a-4880-ba70-99297085b47a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Going to try to start instance {{(pid=141726) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:20:45.558703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:45.567450 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f54b82a-7eb7-494a-ac8f-302cb8771f76 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.541844 Feb 12 21:20:45.576869 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2288/4468] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:45 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:45.583082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:45.583887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:45.590053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.590748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.591759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.592377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.609954 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a788130-444a-4880-ba70-99297085b47a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "POST /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b/action" status: 202 len: 0 microversion: 2.1 time: 0.264644 Feb 12 21:20:45.613126 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2181/4469] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:20:45 2022] POST /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:20:45.628142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:45.629416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:45.639001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.641636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.641636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.642269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.839509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:45.847776 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-66a58038-7066-4858-9236-bd73c83cd3cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.268825 Feb 12 21:20:45.848516 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2289/4470] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:45 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:45.857542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:45.858537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:45.866267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.866719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:45.867526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:45.867962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:46.072151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:46.081600 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0d411ba4-602d-4979-90c6-fd97ba5f3466 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.232072 Feb 12 21:20:46.086462 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2290/4471] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:45 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:46.133915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:46.148662 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1af1dbe6-9f03-4ad3-980e-9d012f6b431c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1508 microversion: 2.1 time: 0.525867 Feb 12 21:20:46.152162 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2182/4472] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:45 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1508 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:46.586873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:46.589037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:46.608891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:46.610010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:46.611209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:46.612404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:46.868224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:46.869036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:46.876266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:46.876720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:46.877599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:46.878037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:47.043870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:47.052348 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-222de083-5671-4682-9912-50df7a059340 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.471204 Feb 12 21:20:47.062189 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2291/4473] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:46 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:47.070350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-30056bae-60f3-41fe-b9a6-84b4e30e66f4 req-c7158be6-fc54-4e2e-9429-dfb2b63d2493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a7af65-ec45-4aa1-88d6-0034f7a4eed6", "name": "network-vif-plugged", "status": "completed", "tag": "327701bb-4024-4f42-a0e6-d17f1a51d3e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:47.072382 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:47.072382 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:47.083274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-30056bae-60f3-41fe-b9a6-84b4e30e66f4 req-c7158be6-fc54-4e2e-9429-dfb2b63d2493 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:47.083895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-30056bae-60f3-41fe-b9a6-84b4e30e66f4 req-c7158be6-fc54-4e2e-9429-dfb2b63d2493 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:47.095808 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-30056bae-60f3-41fe-b9a6-84b4e30e66f4 req-c7158be6-fc54-4e2e-9429-dfb2b63d2493 service nova] Creating event network-vif-plugged:327701bb-4024-4f42-a0e6-d17f1a51d3e6 for instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 on nch1-master-1 Feb 12 21:20:47.101659 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-30056bae-60f3-41fe-b9a6-84b4e30e66f4 req-c7158be6-fc54-4e2e-9429-dfb2b63d2493 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037882 Feb 12 21:20:47.102360 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2292/4474] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:47.109234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:47.110168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:47.117533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:47.118111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:47.118984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:47.119497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:47.234262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:47.245971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-492256bc-bb49-455d-8d67-a2b0a1ac53a2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.384342 Feb 12 21:20:47.256899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2183/4475] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:46 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:47.263639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:47.264481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:47.272911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:47.273646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:47.275100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:47.275727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:47.337519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:47.351400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00b17794-15fa-46b0-8bdb-c629de39b5cd tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.245886 Feb 12 21:20:47.352227 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2293/4476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:47 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:47.565748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:47.573697 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-298121b1-d533-4a3f-a57a-779fede8e4bb tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1508 microversion: 2.1 time: 0.314674 Feb 12 21:20:47.577025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2184/4477] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:47 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:48.069764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:48.071057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:48.078016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.081210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.081210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.081210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.264163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:48.265983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:48.274477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.276943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.288818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:48.300973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.304109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.305735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5980f7ed-b1a9-46f5-9691-ee18bf6a3908 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1309 microversion: 2.1 time: 0.238667 Feb 12 21:20:48.306931 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2294/4478] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:48 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1309 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:48.371221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:48.372233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:48.380607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.381913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.386753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.387416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.542702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:48.573808 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ced61d7-acfd-4903-a56b-f801d24927e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.313219 Feb 12 21:20:48.586508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2185/4479] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:48 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:48.592063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:48.592985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:48.600292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.601125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.602203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.604564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.847791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:48.857111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67b28334-98ec-4145-a470-ab9532cc7622 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1512 microversion: 2.1 time: 0.269017 Feb 12 21:20:48.863519 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2186/4480] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:48 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:48.879218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:48.882711 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:48.882711 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:48.884050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:48.884500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.servers [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Removing options 'limit' from query {{(pid=141726) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1488}} Feb 12 21:20:48.885260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:48.886539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.887171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.888563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.889573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.891451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b15c8c98-2da8-4100-b82d-0f839cd21d44 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018326 Feb 12 21:20:48.902508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2187/4481] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 21:20:48 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:20:48.903787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:48.904587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:48.914054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.914738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:48.916523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:48.917238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.178039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:49.186892 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-40b29d9b-2be5-4d48-ba22-0aa7f3a7c3a1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.821349 Feb 12 21:20:49.187676 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2295/4482] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:48 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:49.325327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:49.326016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:49.332921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.333651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.335744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.335744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.535584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:49.543465 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-29c343b3-d4b7-4af1-9736-4aed666cf348 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1488 microversion: 2.1 time: 0.221736 Feb 12 21:20:49.544069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2296/4483] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:49 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1488 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:49.565444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:49.566591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:49.573242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.580199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.580199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.580199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.693465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:49.704619 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b23f568b-f585-471a-8628-d0d082d390af tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1512 microversion: 2.1 time: 0.804268 Feb 12 21:20:49.705222 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2188/4484] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:48 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1512 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:49.709968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:49.715553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:49.725482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.729091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.729091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.729091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.766975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:49.776779 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4b970ba4-29bd-4dda-aabf-778f066d2562 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1488 microversion: 2.1 time: 0.214663 Feb 12 21:20:49.777489 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2297/4485] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:49 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1488 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:49.794321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:49.794943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:49.801820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.802572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:49.803571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:49.804186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.038525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:50.059219 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-670c1ddf-9cbd-4d89-ba95-1c7564d3aaae tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 200 len: 1512 microversion: 2.1 time: 0.257023 Feb 12 21:20:50.059219 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2298/4486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:49 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:50.059219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:50.059219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:50.059867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.060525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.061669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.062277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.243822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:50.255819 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3a30713-d40c-4edc-94f8-fb4d108694cc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1488 microversion: 2.1 time: 0.206957 Feb 12 21:20:50.257479 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2299/4487] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:50 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:50.262699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:50.266162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:50.271303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.271837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.272575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.273417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.294740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:50.303694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ba5de4f1-33e8-41b7-a38c-3d9e3c3b5f9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.597204 Feb 12 21:20:50.304282 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2189/4488] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:49 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:50.315116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:50.316312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:50.327743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.328304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.329549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.330126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.483296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:50.494740 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-966a08bd-ddd5-4b40-a147-3dd298fb2ea2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1512 microversion: 2.1 time: 0.235679 Feb 12 21:20:50.495707 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2300/4489] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:50 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:50.500579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:50.501074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:50.510698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.511450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.513318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:50.534314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:50.569839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:50.975488 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-187fc111-4f3f-4232-bd5a-8aa3c1136374 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 204 len: 0 microversion: 2.1 time: 0.478135 Feb 12 21:20:50.976455 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2301/4490] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:50 2022] DELETE /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:50.985123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:50.992099 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:50.992099 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:50.994125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:50.997863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:51.123079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:51.137137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe45aa0f-7126-4f04-a6c7-2e14ab49807b tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.823791 Feb 12 21:20:51.140644 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2190/4491] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:50 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:51.156401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.157372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.158458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.159094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.168249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b1fee754-1168-46c5-90a1-7d921ea770e5 req-cf2b13ec-13fd-4e2a-ba0a-06936c71dddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77064ae-c12d-4359-9521-26b660d2d039", "name": "network-vif-plugged", "status": "completed", "tag": "1687b594-812e-4ad7-b4ef-c1a0818aa325"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:51.175718 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:51.175718 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:51.197896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b1fee754-1168-46c5-90a1-7d921ea770e5 req-cf2b13ec-13fd-4e2a-ba0a-06936c71dddc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.198268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b1fee754-1168-46c5-90a1-7d921ea770e5 req-cf2b13ec-13fd-4e2a-ba0a-06936c71dddc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.243023 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b1fee754-1168-46c5-90a1-7d921ea770e5 req-cf2b13ec-13fd-4e2a-ba0a-06936c71dddc service nova] Creating event network-vif-plugged:1687b594-812e-4ad7-b4ef-c1a0818aa325 for instance b77064ae-c12d-4359-9521-26b660d2d039 on nch2-master-1 Feb 12 21:20:51.275271 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b1fee754-1168-46c5-90a1-7d921ea770e5 req-cf2b13ec-13fd-4e2a-ba0a-06936c71dddc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128375 Feb 12 21:20:51.275271 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2191/4492] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:51.290697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:51.298392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:51.307291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.325438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.326320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.326776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.335381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:51.458074 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0519fe48-beaa-4719-909e-53c25624f65e tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.475558 Feb 12 21:20:51.458074 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2302/4493] 10.222.0.31 () {58 vars in 1153 bytes} [Sat Feb 12 21:20:50 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:51.466839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:51.468984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:51.477349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.478161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.479154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.479756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.631800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:51.639563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-215f0719-283a-47ca-aff6-e4dc6d0e3bcd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.181930 Feb 12 21:20:51.650160 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2303/4494] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:51 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:51.655035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:51.655652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:51.662811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.663480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.664309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.664752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.822678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:51.830372 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7efe4df3-811c-4a81-a8de-fcb9c51be4b9 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1512 microversion: 2.1 time: 0.178992 Feb 12 21:20:51.836466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2304/4495] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:51 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:51.850658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:51.851538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:51.858524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.859259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.860131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:51.860640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:51.901060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:51.922111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-666b0e4e-5ac6-43fd-a6d2-f7ddd283cc02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1494 microversion: 2.1 time: 0.648612 Feb 12 21:20:51.937533 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2192/4496] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:51 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1494 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:52.072501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:52.083015 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f027892-b5cc-4937-8482-58541e55756f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 200 len: 1512 microversion: 2.1 time: 0.238420 Feb 12 21:20:52.094930 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2305/4497] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:51 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:52.103052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:52.104255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:52.111725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.112141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.113739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.114735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.159445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:52.160295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:52.171417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.171884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.172692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.173144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.511191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:52.520555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7316337-e54f-48c9-bc77-40fcf89a1ed7 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1318 microversion: 2.1 time: 0.366601 Feb 12 21:20:52.521349 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2306/4498] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:52 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:52.570664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:52.582598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c7ca6dd-3d92-43d1-9ac9-cc2a6e9b47c7 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1512 microversion: 2.1 time: 0.484891 Feb 12 21:20:52.594649 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2193/4499] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:52 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:52.601772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:52.606175 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:52.606175 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:52.607374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:52.608239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:52.616568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.617142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.618116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.625520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.656328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:52.657488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:52.658197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:52.665990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.666810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.667839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.668529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.701338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:52.725940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.728988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.952927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ecead437-658e-426a-b92f-c6d4a20be789 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.356301 Feb 12 21:20:52.967177 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2307/4500] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:20:52 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:52.967177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:52.967177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:52.969028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.979474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:52.979474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:52.979474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.341876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:53.352063 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-45edc14c-beef-42a1-be89-fd665ec50f82 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1494 microversion: 2.1 time: 0.397017 Feb 12 21:20:53.357332 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2308/4501] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:52 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1494 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:53.366571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:53.377245 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:53.377245 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:53.379154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:53.379849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:53.482003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.482705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.483543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.483974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.508249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:53.524515 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dae6a92b-306a-41fa-bb19-f3750dcc60ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.867673 Feb 12 21:20:53.531553 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2194/4502] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:52 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:53.543265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:53.546372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:53.555315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:53.561674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.562366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.563348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.563957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.595360 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49c3b27c-1e2c-459c-950c-5aa0b1d0089c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.240383 Feb 12 21:20:53.596585 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2309/4503] 10.222.0.31 () {58 vars in 1149 bytes} [Sat Feb 12 21:20:53 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:53.610402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:53.615696 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:53.615696 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:53.616751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:53.617460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:53.622746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.623597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.624151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.624597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.727105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:53.788351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b3e0d639-70a6-4c7d-a8d3-285aafc0e9b6 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.182154 Feb 12 21:20:53.789157 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2310/4504] 10.222.0.31 () {58 vars in 1211 bytes} [Sat Feb 12 21:20:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:53.808417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:53.808417 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:53.808417 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:53.808417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:53.808417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:53.810091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.810640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.811468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:53.811903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:53.902304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:53.968985 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c8c2c4f-4a9d-4a1c-8e82-54e37599c511 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.173298 Feb 12 21:20:53.971454 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2311/4505] 10.222.0.31 () {58 vars in 1195 bytes} [Sat Feb 12 21:20:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:53.984022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:53.989423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:53.996789 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:53.996789 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:53.998587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:54.000071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': '1545300758', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:54.011504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.012275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.013332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.013753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.016195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bf97c576-98a9-4b0c-b4b1-982d22020527 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1507 microversion: 2.1 time: 0.481700 Feb 12 21:20:54.030220 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2195/4506] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:53 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:54.036092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:54.036957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:54.043923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.044690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.045734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.046385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.166828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:54.259116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb084682-5c69-4d6d-9c75-fbb379d83f6c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?name=1545300758" status: 200 len: 346 microversion: 2.1 time: 0.279389 Feb 12 21:20:54.267631 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2312/4507] 10.222.0.31 () {58 vars in 1155 bytes} [Sat Feb 12 21:20:53 2022] GET /compute/v2.1/servers?name=1545300758 => generated 346 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:54.284309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:54.290675 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:54.290675 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:54.291883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:54.296950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:54.311263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.311787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.312626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.313065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.462553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:54.522170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:54.532221 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41040737-35d6-4528-b75e-9817a7490fe5 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.251160 Feb 12 21:20:54.532221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2313/4508] 10.222.0.31 () {58 vars in 1153 bytes} [Sat Feb 12 21:20:54 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:54.536741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b93be4b1-60c9-4524-ae6c-f5d67381c1a2 req-b618f671-e0b2-49a5-81dc-1117667226ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a7af65-ec45-4aa1-88d6-0034f7a4eed6", "name": "network-vif-deleted", "tag": "327701bb-4024-4f42-a0e6-d17f1a51d3e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:54.538355 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:54.538355 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:54.538862 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-861217ea-dfa4-48aa-8834-ae22d5eb88e1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1507 microversion: 2.1 time: 0.507060 Feb 12 21:20:54.539818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2196/4509] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:54 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:54.546247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b93be4b1-60c9-4524-ae6c-f5d67381c1a2 req-b618f671-e0b2-49a5-81dc-1117667226ec service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.546712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b93be4b1-60c9-4524-ae6c-f5d67381c1a2 req-b618f671-e0b2-49a5-81dc-1117667226ec service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.550639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:54.551368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:54.560715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b93be4b1-60c9-4524-ae6c-f5d67381c1a2 req-b618f671-e0b2-49a5-81dc-1117667226ec service nova] Creating event network-vif-deleted:327701bb-4024-4f42-a0e6-d17f1a51d3e6 for instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 on nch1-master-1 Feb 12 21:20:54.565335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.566318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.566721 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b93be4b1-60c9-4524-ae6c-f5d67381c1a2 req-b618f671-e0b2-49a5-81dc-1117667226ec service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Feb 12 21:20:54.567145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.567651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.568452 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2314/4510] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:54.575645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:54.580371 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:54.580371 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:20:54.581810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:54.582816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-154530075', 'deleted': False, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a'} {{(pid=141727) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:20:54.589834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.590727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.591735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.592345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.658832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:54.667575 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1473d124-0c29-4d14-baf6-875969885025 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 200 len: 1294 microversion: 2.1 time: 0.126618 Feb 12 21:20:54.668173 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2197/4511] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:54 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:54.681777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:54.681777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:54.681777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.681777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.682769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.683365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.764473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.multi_cell_list [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141727) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:20:54.848607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ef864b43-ea12-44cc-87a2-7b60075425a1 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-154530075" status: 200 len: 346 microversion: 2.1 time: 0.278712 Feb 12 21:20:54.849771 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2315/4512] 10.222.0.31 () {58 vars in 1227 bytes} [Sat Feb 12 21:20:54 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-154530075 => generated 346 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:54.856210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:54.858291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:54.863740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:54.872189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25f10265-cca3-463f-95d2-cfec330eefb4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.202361 Feb 12 21:20:54.873291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2198/4513] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:54 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:54.885283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:54.885283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:54.885903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.885903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.885903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.885903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.888708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.889329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.890789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:54.891331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:54.926420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:55.063615 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-036fe536-3cde-489f-a7b5-39de892344cc tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "PUT /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1079 microversion: 2.1 time: 0.212636 Feb 12 21:20:55.075259 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2316/4514] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:20:54 2022] PUT /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1079 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:55.087830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:55.088449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:55.101319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.101813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.102630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.103092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.265175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e1208e88-b9aa-414d-b180-cbce2699d38d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "DELETE /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 204 len: 0 microversion: 2.1 time: 0.388270 Feb 12 21:20:55.265831 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2199/4515] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:54 2022] DELETE /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:55.276002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:55.276002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:55.286207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.286662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.287526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.288186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.413555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:55.428245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e1900c67-cd9e-4f5d-b4ce-a90b52cbb049 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1505 microversion: 2.1 time: 0.351277 Feb 12 21:20:55.429384 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2317/4516] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:55 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:55.449466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:55.450144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:55.458743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.459200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.460272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.460907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.491631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:55.500738 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72b6d18c-8b5d-40d9-b52d-de8038ea3a12 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1518 microversion: 2.1 time: 0.229169 Feb 12 21:20:55.501657 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2200/4517] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:55 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:55.699337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:55.700509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:55.710305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.711030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.712250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.712855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.748599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 could not be found. Feb 12 21:20:55.748599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:20:55.748599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b6b7356d-8b50-46c2-9bae-7ca7e32754cb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 404 len: 111 microversion: 2.1 time: 0.047110 Feb 12 21:20:55.748599 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2201/4518] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:55 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:20:55.755238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:55.755759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:55.763974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.764427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.765710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.766415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.795347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:55.930367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:55.937870 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f9e0d8a1-ab4b-43da-9656-4c7af5ec2b5d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1505 microversion: 2.1 time: 0.497776 Feb 12 21:20:55.938635 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2318/4519] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:55 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:20:55.943631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:55.944379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:55.950926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.954944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:55.954944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:55.954944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.167855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:56.176693 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dd3ac0df-a1ee-4ec8-8902-449e7c4ab6ba tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.237053 Feb 12 21:20:56.177414 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2319/4520] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:55 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:56.182129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:56.183274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:56.189844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.190299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.192058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.192693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.242071 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-146fdf98-010f-4bea-9360-adb66882c383 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 204 len: 0 microversion: 2.1 time: 0.489494 Feb 12 21:20:56.242943 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2202/4521] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:55 2022] DELETE /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:56.252310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:56.254198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:56.260891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.261665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.262463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.262928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.406766 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-36e7633b-2b1d-4f97-bc24-083db128f978 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "PUT /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1081 microversion: 2.1 time: 0.227859 Feb 12 21:20:56.407714 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2320/4522] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:20:56 2022] PUT /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1081 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:56.423747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:56.424498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:56.431686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.433326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.433326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.433806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.445890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:56.462827 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a7f5218-6e9c-4dad-a9fe-c05b5a589e40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1494 microversion: 2.1 time: 0.214764 Feb 12 21:20:56.463482 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2203/4523] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:56 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1494 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:56.477488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4776652-3b7a-4b3e-8749-56e170786d32"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:56.479264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:56.485560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.486095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.487008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.487603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.722326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:56.729404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e06592b-5b46-423f-b408-95b8a549a024 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1507 microversion: 2.1 time: 0.309505 Feb 12 21:20:56.730192 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2321/4524] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:56 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:56.734663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:56.735509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:56.744621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.746177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:56.756528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:56.756528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.376542 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-835db3a6-fd00-412d-8bea-be9c769c31de tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911582 Feb 12 21:20:57.377807 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2204/4525] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:20:56 2022] POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-volume_attachments => generated 194 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:57.384400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:57.385503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:57.394373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.395203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.396430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.397104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.443810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:57.453841 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddc0115b-3600-435b-abcd-31875831a7a3 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 200 len: 1518 microversion: 2.1 time: 0.722363 Feb 12 21:20:57.454429 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2322/4526] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:56 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 1518 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:57.466159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:57.479682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:57.493030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.502151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.503127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.506063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.728133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:57.739018 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04f56158-950d-4265-aa32-5b89e2f973c4 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1507 microversion: 2.1 time: 0.357538 Feb 12 21:20:57.739922 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2205/4527] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:57 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:57.745512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-60a5b8ef-542e-44b8-887c-ab78f215ccd5 req-46df0ed9-4870-4f35-b3a9-5206197cc390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83499a06-e03e-4abd-9f5a-9ff4288b66ac", "name": "network-vif-deleted", "tag": "23815c6a-3d4b-4d91-8e5a-906a6a120afd"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:57.747348 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:57.747348 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:57.757861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-60a5b8ef-542e-44b8-887c-ab78f215ccd5 req-46df0ed9-4870-4f35-b3a9-5206197cc390 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.770844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-60a5b8ef-542e-44b8-887c-ab78f215ccd5 req-46df0ed9-4870-4f35-b3a9-5206197cc390 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.793513 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-60a5b8ef-542e-44b8-887c-ab78f215ccd5 req-46df0ed9-4870-4f35-b3a9-5206197cc390 service nova] Creating event network-vif-deleted:23815c6a-3d4b-4d91-8e5a-906a6a120afd for instance 83499a06-e03e-4abd-9f5a-9ff4288b66ac on nch2-master-1 Feb 12 21:20:57.798766 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-60a5b8ef-542e-44b8-887c-ab78f215ccd5 req-46df0ed9-4870-4f35-b3a9-5206197cc390 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057348 Feb 12 21:20:57.800098 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2206/4528] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:57.807949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:57.808973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:57.817073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.818014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.819011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:57.819626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:57.978069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:58.006320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d73a7bea-9e92-4ba5-a6d3-69eefdbc7305 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1510 microversion: 2.1 time: 0.543708 Feb 12 21:20:58.009616 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2323/4529] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:57 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:58.012614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:58.013302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:58.034016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.037345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.038397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.040493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.085192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:58.161027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:58.169526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14efe33e-9a6a-481c-a170-9bdaeea7939b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1494 microversion: 2.1 time: 0.367542 Feb 12 21:20:58.170687 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2207/4530] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:57 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1494 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:58.474554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:58.475330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 83499a06-e03e-4abd-9f5a-9ff4288b66ac] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:58.493697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.494844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.497719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.499259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.528336 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] HTTP exception thrown: Instance 83499a06-e03e-4abd-9f5a-9ff4288b66ac could not be found. Feb 12 21:20:58.539192 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47500df3-44ad-4f1c-8a26-f4a175dbf31f tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 204 len: 0 microversion: 2.1 time: 0.519490 Feb 12 21:20:58.541049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2324/4531] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:58 2022] DELETE /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:58.545611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Returning 404 to user: Instance 83499a06-e03e-4abd-9f5a-9ff4288b66ac could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:20:58.546601 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf799307-4bda-43f3-a6ae-50b6e4bc300d tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac" status: 404 len: 111 microversion: 2.1 time: 0.077852 Feb 12 21:20:58.547451 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2208/4532] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:58 2022] GET /compute/v2.1/servers/83499a06-e03e-4abd-9f5a-9ff4288b66ac => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:20:58.556616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:58.557417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:58.569529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:58.571380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:58.574141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.574598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.575610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.576224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.601117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.603045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.605100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.608055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.624585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:58.691639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:20:58.849393 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Instance is already in deleting state, ignoring this request Feb 12 21:20:58.851715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3471cc1f-8d4e-4173-b1e1-d26a238ee4d1 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 204 len: 0 microversion: 2.1 time: 0.297924 Feb 12 21:20:58.854168 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2325/4533] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:58 2022] DELETE /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:58.882333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:58.882990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:58.894713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.895130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:58.895854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:58.896332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.054411 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ac719e9-f871-44e4-b005-d3e708a640e4 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 204 len: 0 microversion: 2.1 time: 0.499774 Feb 12 21:20:59.059322 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2209/4534] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:20:58 2022] DELETE /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:20:59.068753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:59.069769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:59.080200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.081000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.082514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.083216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.350648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:59.358978 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ba74778c-ad3a-4f15-b7b7-cd1cdb982aa9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1487 microversion: 2.1 time: 0.298171 Feb 12 21:20:59.359661 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2210/4535] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:59 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1487 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:59.366032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:59.366921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:59.375076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.375800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.376770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.377410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.426879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:59.439911 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-74893449-5a39-4075-a864-e34c5a22cd11 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1513 microversion: 2.1 time: 0.580690 Feb 12 21:20:59.440697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2326/4536] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:58 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1513 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:59.458162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:59.458816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:59.475717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.476519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.477632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.480153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.577428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:59.588102 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-05a82102-c0a5-413d-abcd-ead0123054e2 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 200 len: 1518 microversion: 2.1 time: 0.227156 Feb 12 21:20:59.588694 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2211/4537] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:59 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 1518 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:59.593504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:59.596240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:59.607182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:20:59.612113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.612686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.613579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.614033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.619576 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81cffe1d-6c22-43f1-a93d-038c7a7770b3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 200 len: 1294 microversion: 2.1 time: 0.177744 Feb 12 21:20:59.621003 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2327/4538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:59 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 1294 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:20:59.684559 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7376431a-52e6-4494-84c1-779041774d9e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 200 len: 144 microversion: 2.1 time: 0.094574 Feb 12 21:20:59.689966 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2212/4539] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:20:59 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:20:59.705318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:20:59.706578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:20:59.724823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.726459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.733546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.734730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.818806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ab267ccf-5956-4fb2-b7e1-bb8349ae72d0 req-7e90fb0a-0313-4049-947a-78f71f4242e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "614e2dee-b81e-4a15-91f6-be8faf694be7", "name": "network-vif-deleted", "tag": "0762ac45-f397-472b-8939-3d99e373982f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:20:59.821091 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:20:59.821091 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:20:59.829636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ab267ccf-5956-4fb2-b7e1-bb8349ae72d0 req-7e90fb0a-0313-4049-947a-78f71f4242e5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:20:59.830090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ab267ccf-5956-4fb2-b7e1-bb8349ae72d0 req-7e90fb0a-0313-4049-947a-78f71f4242e5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:20:59.848087 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ab267ccf-5956-4fb2-b7e1-bb8349ae72d0 req-7e90fb0a-0313-4049-947a-78f71f4242e5 service nova] Creating event network-vif-deleted:0762ac45-f397-472b-8939-3d99e373982f for instance 614e2dee-b81e-4a15-91f6-be8faf694be7 on nch1-master-1 Feb 12 21:20:59.852686 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ab267ccf-5956-4fb2-b7e1-bb8349ae72d0 req-7e90fb0a-0313-4049-947a-78f71f4242e5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038298 Feb 12 21:20:59.853857 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2213/4540] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:21:00.114527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:00.132387 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-15d3a9de-bcba-40d3-ae27-c94a646b5826 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.441132 Feb 12 21:21:00.144531 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2328/4541] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:20:59 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:00.164045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:00.164761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:00.171861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.172614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.173982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.179679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.463972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:00.464760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:00.482197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.482938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.483817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.484270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.543936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:00.553760 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5b0f6b58-3280-46ff-9cb0-5c14abe75a9c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.394865 Feb 12 21:21:00.554359 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2214/4542] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:00 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:00.572204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:00.572971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:00.583312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.584016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.585559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.591377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.656556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:00.658988 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-baf0b497-d39d-4118-be17-8ea09adb903c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1471 microversion: 2.1 time: 0.200700 Feb 12 21:21:00.688098 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2329/4543] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:00 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:00.692864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:00.693626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:00.710071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.710682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:00.711654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:00.712681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:01.016366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:01.021324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:01.032890 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a56606e4-f8ca-4044-885b-ddabccc30716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.464399 Feb 12 21:21:01.033908 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2215/4544] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:00 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:01.041900 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2a8c70e-4ca0-4a33-a48e-6662803b097a tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 200 len: 1518 microversion: 2.1 time: 0.354714 Feb 12 21:21:01.045712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:01.047353 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2330/4545] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:00 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 1518 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:01.051604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:01.055165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:01.055993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:01.063156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:01.064531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:01.064667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:01.065282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:01.065549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:01.066558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:01.066818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:01.067394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:01.106390 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 614e2dee-b81e-4a15-91f6-be8faf694be7 could not be found. Feb 12 21:21:01.107612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 614e2dee-b81e-4a15-91f6-be8faf694be7 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:01.108936 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d5a1d627-42c6-4164-a019-1cd7836fb25d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 404 len: 111 microversion: 2.1 time: 0.071007 Feb 12 21:21:01.109725 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2216/4546] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:01 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:01.287207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1289678008", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:01.391657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:21:02.009057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:02.037739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4cae08c3-2bc1-4ffb-9315-08397dc2531b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.989155 Feb 12 21:21:02.038765 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2331/4547] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:02.056334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:02.057016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:02.100083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.100630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.102142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.102590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.247029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.247489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.254922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lazy-loading 'fault' on Instance uuid b77064ae-c12d-4359-9521-26b660d2d039 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:02.352219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d612e20334459eb9f7b2cdee9320bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7e0df130604d2b9dab6a7fb331f5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:02.364469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-61467651-8cc3-4b01-9f86-6a8e7f7fdc0c tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 200 len: 1308 microversion: 2.1 time: 0.321883 Feb 12 21:21:02.365257 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2332/4548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:02 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:02.377741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c6754d55-bfbb-45cd-a760-95c2830aad3d req-bb0fc998-f2aa-431b-b94c-f4f723af13a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77064ae-c12d-4359-9521-26b660d2d039", "name": "network-vif-deleted", "tag": "1687b594-812e-4ad7-b4ef-c1a0818aa325"}, {"server_uuid": "6b988b5a-9dfb-4db8-9388-bae126fcf4fc", "name": "network-vif-deleted", "tag": "f16e15df-4fce-4c6d-95cf-1ba7fe36760e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:02.380230 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:02.380230 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:02.397165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c6754d55-bfbb-45cd-a760-95c2830aad3d req-bb0fc998-f2aa-431b-b94c-f4f723af13a1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.398626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c6754d55-bfbb-45cd-a760-95c2830aad3d req-bb0fc998-f2aa-431b-b94c-f4f723af13a1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.427069 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c6754d55-bfbb-45cd-a760-95c2830aad3d req-bb0fc998-f2aa-431b-b94c-f4f723af13a1 service nova] Creating event network-vif-deleted:1687b594-812e-4ad7-b4ef-c1a0818aa325 for instance b77064ae-c12d-4359-9521-26b660d2d039 on nch2-master-1 Feb 12 21:21:02.432373 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c6754d55-bfbb-45cd-a760-95c2830aad3d req-bb0fc998-f2aa-431b-b94c-f4f723af13a1 service nova] Creating event network-vif-deleted:f16e15df-4fce-4c6d-95cf-1ba7fe36760e for instance 6b988b5a-9dfb-4db8-9388-bae126fcf4fc on nch2-master-1 Feb 12 21:21:02.455644 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c6754d55-bfbb-45cd-a760-95c2830aad3d req-bb0fc998-f2aa-431b-b94c-f4f723af13a1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088589 Feb 12 21:21:02.456741 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2333/4549] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:02.462633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:02.464020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:02.472950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.472950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.473874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.474485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.512125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.512125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.512511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lazy-loading 'fault' on Instance uuid 6b988b5a-9dfb-4db8-9388-bae126fcf4fc {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:02.607684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:02.610608 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-33913cd2-ff5c-4144-86a7-47711c4dd94c tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 200 len: 1310 microversion: 2.1 time: 0.152413 Feb 12 21:21:02.611605 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2334/4550] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:02 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 1310 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:02.616454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b329c85-b0e9-448f-84d7-e38d8979f559 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:02.631128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b329c85-b0e9-448f-84d7-e38d8979f559 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.631977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b329c85-b0e9-448f-84d7-e38d8979f559 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.635066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:21:02.635453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:21:02.635900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:21:02.636325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:21:02.636748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:21:02.664688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.670126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.671602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:02.677503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:02.703877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b329c85-b0e9-448f-84d7-e38d8979f559 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:21:02.736837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:21:02.746754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:21:02.764520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:21:02.767535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:21:02.920163 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0f6bafdf-2d55-42fb-a8fe-a9553678aa62 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637368 Feb 12 21:21:02.921523 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2217/4551] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:21:02.927187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1743204705", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2d2fb25f-a576-44b7-8aec-e44f4519d495"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:03.000268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] validate_networks() for [('2d2fb25f-a576-44b7-8aec-e44f4519d495', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:21:03.021211 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b329c85-b0e9-448f-84d7-e38d8979f559 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action" status: 202 len: 0 microversion: 2.1 time: 0.408330 Feb 12 21:21:03.022604 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2335/4552] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:02 2022] POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:03.031520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84eb25a4-c804-45f3-bcad-d3df6b20289b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.032230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-84eb25a4-c804-45f3-bcad-d3df6b20289b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.115824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84eb25a4-c804-45f3-bcad-d3df6b20289b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:03.122826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84eb25a4-c804-45f3-bcad-d3df6b20289b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1209 microversion: 2.1 time: 0.098743 Feb 12 21:21:03.123611 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2336/4553] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:03.139066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.139740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.149745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.150200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.150995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.151503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.428427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:03.446433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73bc101f-1234-4366-9c04-4effa0494796 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.311999 Feb 12 21:21:03.459040 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2337/4554] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:03.464239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.465238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: b77064ae-c12d-4359-9521-26b660d2d039] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.473325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.474219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.475274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.475962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.494462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] HTTP exception thrown: Instance b77064ae-c12d-4359-9521-26b660d2d039 could not be found. Feb 12 21:21:03.495181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Returning 404 to user: Instance b77064ae-c12d-4359-9521-26b660d2d039 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:03.496081 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5237fad9-f398-4a99-9b25-3b232d991d44 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039" status: 404 len: 111 microversion: 2.1 time: 0.035518 Feb 12 21:21:03.497197 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2338/4555] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/b77064ae-c12d-4359-9521-26b660d2d039 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:03.506133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.506714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.515749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.516345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.517338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.517843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.532415 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] HTTP exception thrown: Instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd could not be found. Feb 12 21:21:03.533195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Returning 404 to user: Instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:03.534302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c1e5dd4e-abe0-4a33-8890-50cf4bd5c976 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 404 len: 111 microversion: 2.1 time: 0.032821 Feb 12 21:21:03.535174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2339/4556] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:21:03 2022] DELETE /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:21:03.542809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.543418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.549534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.550513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.552360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.552826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.569447 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] HTTP exception thrown: Instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd could not be found. Feb 12 21:21:03.570202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Returning 404 to user: Instance ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:03.571033 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-777b236d-4a14-4723-804e-ae9050f6a3ed tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd" status: 404 len: 111 microversion: 2.1 time: 0.031900 Feb 12 21:21:03.571602 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2340/4557] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/ab3de8c7-5cbc-4936-a2c9-99c95d6f14dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:21:03.580788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.582351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.588672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.589132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.590391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.590993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.609385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] HTTP exception thrown: Instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 could not be found. Feb 12 21:21:03.610223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Returning 404 to user: Instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:03.611289 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e895470-f766-4f23-ba08-503ddd330b2d tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 404 len: 111 microversion: 2.1 time: 0.034909 Feb 12 21:21:03.616357 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2341/4558] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:21:03 2022] DELETE /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:03.623719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.624593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] [instance: ac0f23fe-5df2-49f4-85af-3e16dabe1ca5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.633787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.634343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.635495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.636060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.666268 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] HTTP exception thrown: Instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 could not be found. Feb 12 21:21:03.667291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] Returning 404 to user: Instance ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:03.668357 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0348a4f-5130-4ec2-b842-112a2f393f63 tempest-ServerDiskConfigTestJSON-720920110 tempest-ServerDiskConfigTestJSON-720920110-project] 10.222.0.31 "GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5" status: 404 len: 111 microversion: 2.1 time: 0.050117 Feb 12 21:21:03.669643 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2342/4559] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/ac0f23fe-5df2-49f4-85af-3e16dabe1ca5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:03.674838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.680576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: 6b988b5a-9dfb-4db8-9388-bae126fcf4fc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.683605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.684227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.685185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.685802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.694846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:21:03.695949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:21:03.696617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:21:03.697511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:21:03.698172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:21:03.726704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.727096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.727936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.728373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.735817 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] HTTP exception thrown: Instance 6b988b5a-9dfb-4db8-9388-bae126fcf4fc could not be found. Feb 12 21:21:03.736426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Returning 404 to user: Instance 6b988b5a-9dfb-4db8-9388-bae126fcf4fc could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:03.738049 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eee06692-10ad-4d3c-81a5-42d0c713aa73 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc" status: 404 len: 111 microversion: 2.1 time: 0.066435 Feb 12 21:21:03.752732 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2343/4560] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/6b988b5a-9dfb-4db8-9388-bae126fcf4fc => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:03.754755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:21:03.761017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:21:03.762273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.767361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:03.772317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.773093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.774404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:03.775209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:03.775792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:21:03.778285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:21:03.807888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:21:03.911538 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e772f304-e1e8-4e62-ac82-78341f8481ab tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988501 Feb 12 21:21:03.918166 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2218/4561] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:21:03.924628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3988466-6f5e-447f-a639-adbd5ee3dcd5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:03.925592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3988466-6f5e-447f-a639-adbd5ee3dcd5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:04.015895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3988466-6f5e-447f-a639-adbd5ee3dcd5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:04.023650 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3988466-6f5e-447f-a639-adbd5ee3dcd5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1215 microversion: 2.1 time: 0.104006 Feb 12 21:21:04.024563 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2219/4562] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:03 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:04.146130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:04.148183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:04.166800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:04.167516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:04.168525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:04.169133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:04.186320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7cb92ea5-d41b-4dd6-a142-c259430a33ab tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "DELETE /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 204 len: 0 microversion: 2.1 time: 0.427459 Feb 12 21:21:04.187032 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2344/4563] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:21:03 2022] DELETE /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:21:04.196902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:04.197875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:04.205195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:04.206605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:04.207581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:04.208189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:04.252006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:04.260619 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a61a286-fecf-4e7b-9e43-c78906de029a tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1213 microversion: 2.1 time: 0.123785 Feb 12 21:21:04.261200 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2220/4564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:04 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:04.471891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:04.472525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:04.488741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:04.489213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:04.491200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:04.491847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:04.528333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:04.538500 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9cf881eb-30b7-44b2-b3a8-ca2e1b676b3f tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1518 microversion: 2.1 time: 0.346573 Feb 12 21:21:04.540901 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2345/4565] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:04 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1518 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:04.947969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:04.965815 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a798be08-03d3-40f2-8278-0fa34dcc7909 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.503059 Feb 12 21:21:04.967360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2221/4566] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:04 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:05.044941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:05.045518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:05.056475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:05.057107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:05.058631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:05.059107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:05.209774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:05.225007 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41e8f7e7-eb6e-4188-a801-92725bc1fa6b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1219 microversion: 2.1 time: 0.186864 Feb 12 21:21:05.227498 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2346/4567] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:05 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:05.278250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:05.278877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:05.285638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:05.286093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:05.286900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:05.287343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:05.556706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:05.557668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:05.564860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:05.565989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:05.566926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:05.567374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:05.619829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:05.631589 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e78cbee-bc1c-4b98-939e-4a777387fd8e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1269 microversion: 2.1 time: 0.355473 Feb 12 21:21:05.633883 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2222/4568] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:05 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1269 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:05.927472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:05.942640 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-04d8d854-c1c8-40fb-9aac-6dbf3e62f4fe tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1518 microversion: 2.1 time: 0.387412 Feb 12 21:21:05.945590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2347/4569] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:05 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1518 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:05.989179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:05.995044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:06.007387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.011484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.014813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.016573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.243568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:06.246640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:06.254445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.258156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.258156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.258156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.351794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:06.363420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8748d890-c38f-4135-ba3b-2ede52d08f05 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.382124 Feb 12 21:21:06.369495 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2223/4570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:05 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:06.578068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:06.585734 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a3294d0-e5c5-4665-934f-ebf0c367df45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1267 microversion: 2.1 time: 0.346064 Feb 12 21:21:06.586587 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2348/4571] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:06 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:06.650839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:06.651464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:06.658397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.658856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.660241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.660685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.855337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:06.871189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a17ca297-fc23-4410-8cf1-c04dd71b84c9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1267 microversion: 2.1 time: 0.222343 Feb 12 21:21:06.887840 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2224/4572] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:06 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:06.962621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:06.963551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:06.973549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.974271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:06.976185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:06.977325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.315004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:07.329027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41cc4fce-3f0a-49d8-9962-bd42eac6e751 tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1518 microversion: 2.1 time: 0.368655 Feb 12 21:21:07.342309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2349/4573] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:06 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1518 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:07.398391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:07.407578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-daf5b66d-22ec-4aa7-8e16-054b0f897b72 req-3a178cd7-80fa-47f5-ab36-e42a1049418f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dceb2da3-afd2-4395-a3c8-eaf417cce25b", "name": "network-vif-deleted", "tag": "f5943c26-37c8-4eb7-847d-98d39b953002"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:07.409809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:07.410708 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:07.410708 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:07.421504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.422193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.430402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.430402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.430763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-daf5b66d-22ec-4aa7-8e16-054b0f897b72 req-3a178cd7-80fa-47f5-ab36-e42a1049418f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.430763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-daf5b66d-22ec-4aa7-8e16-054b0f897b72 req-3a178cd7-80fa-47f5-ab36-e42a1049418f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.443327 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-daf5b66d-22ec-4aa7-8e16-054b0f897b72 req-3a178cd7-80fa-47f5-ab36-e42a1049418f service nova] Creating event network-vif-deleted:f5943c26-37c8-4eb7-847d-98d39b953002 for instance dceb2da3-afd2-4395-a3c8-eaf417cce25b on nch1-master-1 Feb 12 21:21:07.453582 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-daf5b66d-22ec-4aa7-8e16-054b0f897b72 req-3a178cd7-80fa-47f5-ab36-e42a1049418f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053032 Feb 12 21:21:07.454779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2350/4574] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:21:07.610137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:07.610876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:07.620697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.621278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.622436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.622977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.724332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:07.740329 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32861c12-19e6-4bc4-8248-3195af39bf1d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1273 microversion: 2.1 time: 0.140043 Feb 12 21:21:07.752903 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2351/4575] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:07 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:07.896316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:07.896996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:07.904554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.908752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.908752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:07.908752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:07.931592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:07.958508 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ba21f59-3405-42c4-af88-c60b6467288b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.566770 Feb 12 21:21:07.969705 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2225/4576] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:07 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:08.274114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:08.282337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb29b350-8018-4a81-b4f3-4651bcc6acf4 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2008615214", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:08.282697 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-263b345f-423f-4232-958d-c8ffddff0330 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.391592 Feb 12 21:21:08.293303 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-fb29b350-8018-4a81-b4f3-4651bcc6acf4 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] HTTP exception thrown: min_count must be <= max_count Feb 12 21:21:08.293303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb29b350-8018-4a81-b4f3-4651bcc6acf4 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Returning 400 to user: min_count must be <= max_count {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:08.293303 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb29b350-8018-4a81-b4f3-4651bcc6acf4 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.197546 Feb 12 21:21:08.293303 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2226/4577] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:08 2022] POST /compute/v2.1/servers => generated 74 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Feb 12 21:21:08.294588 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2352/4578] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:07 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:08.348716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:08.349435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:08.351943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b823dc6e-f16e-4928-becd-57a50fbb2ca6 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-338872730", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "max_count": 0}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:08.353531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b823dc6e-f16e-4928-becd-57a50fbb2ca6 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:08.354422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b823dc6e-f16e-4928-becd-57a50fbb2ca6 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016556 Feb 12 21:21:08.358799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.358799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:08.359314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.360236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:08.370889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2227/4579] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:08 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:21:08.461615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.462600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:08.464867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lazy-loading 'fault' on Instance uuid dceb2da3-afd2-4395-a3c8-eaf417cce25b {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:08.466495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7d8cabc-0541-4699-a2ab-148b545ddb67 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2030170528", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "max_count": 2.5}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:08.468685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7d8cabc-0541-4699-a2ab-148b545ddb67 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:08.469719 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7d8cabc-0541-4699-a2ab-148b545ddb67 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007377 Feb 12 21:21:08.473282 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2228/4580] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:21:08.528610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-850edb8b-e7c3-4c0d-88d5-15110748dc34 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1781536010", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 0}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:08.530232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-850edb8b-e7c3-4c0d-88d5-15110748dc34 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:08.531255 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-850edb8b-e7c3-4c0d-88d5-15110748dc34 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006451 Feb 12 21:21:08.531823 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2229/4581] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:08 2022] POST /compute/v2.1/servers => generated 130 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:21:08.606328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4646bb96-b626-4b4c-9338-3df867662ef9 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1682219402", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "min_count": 2.5}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:08.608422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4646bb96-b626-4b4c-9338-3df867662ef9 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:08.609246 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4646bb96-b626-4b4c-9338-3df867662ef9 tempest-MultipleCreateNegativeTestJSON-1444813883 tempest-MultipleCreateNegativeTestJSON-1444813883-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007241 Feb 12 21:21:08.609913 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2230/4582] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 12 21:21:08.778630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:08.779172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:08.793450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.802700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:08.802700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.802700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:08.905616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf1d1df6d06a430684c3335b89dafd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd5a0b396b5045459fdedb8d4039960a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:08.915555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-933f6917-aa72-487a-aaf8-310557028bdf tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 200 len: 1311 microversion: 2.1 time: 0.571406 Feb 12 21:21:08.916134 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2353/4583] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:08 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 1311 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:08.980277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:08.980899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:08.987785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.988258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:08.989836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:08.990282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:09.144839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:09.157559 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bc34495c-2188-4784-b9fa-76da0e9d94e2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.383350 Feb 12 21:21:09.171084 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2231/4584] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:08 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:09.303526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:09.304148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:09.312644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:09.316415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:09.316545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:09.316677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:09.316892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:09.332397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-041ae4f3-337f-445d-8674-c38b828882cc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.354047 Feb 12 21:21:09.341943 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2354/4585] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:08 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:09.668574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:09.685561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e7718584-b733-4659-a816-25b169eb9856 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.388332 Feb 12 21:21:09.687030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2232/4586] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:09 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:09.932109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:09.932725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] [instance: dceb2da3-afd2-4395-a3c8-eaf417cce25b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:09.939301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:09.939764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:09.950980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:09.951547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:09.982752 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] HTTP exception thrown: Instance dceb2da3-afd2-4395-a3c8-eaf417cce25b could not be found. Feb 12 21:21:09.983988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] Returning 404 to user: Instance dceb2da3-afd2-4395-a3c8-eaf417cce25b could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:09.984910 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-92b80bc1-44a5-462a-8589-86cc066b5b9b tempest-ListServerFiltersTestJSON-555456102 tempest-ListServerFiltersTestJSON-555456102-project] 10.222.0.31 "GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b" status: 404 len: 111 microversion: 2.1 time: 0.056471 Feb 12 21:21:09.989769 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2355/4587] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:09 2022] GET /compute/v2.1/servers/dceb2da3-afd2-4395-a3c8-eaf417cce25b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:10.049062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e66b7fd1-72aa-49e0-b68e-95640cd09825 req-882e4228-ec42-443f-9bac-33213f81068b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439a1e23-2699-4fcc-8ad6-79b45a3f4f60", "tag": "1c5eeeb1-9fcc-4e59-9db5-afccc775aeb6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:10.052055 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:10.052055 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:10.063898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e66b7fd1-72aa-49e0-b68e-95640cd09825 req-882e4228-ec42-443f-9bac-33213f81068b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.077578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e66b7fd1-72aa-49e0-b68e-95640cd09825 req-882e4228-ec42-443f-9bac-33213f81068b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:10.090634 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e66b7fd1-72aa-49e0-b68e-95640cd09825 req-882e4228-ec42-443f-9bac-33213f81068b service nova] Creating event network-changed:1c5eeeb1-9fcc-4e59-9db5-afccc775aeb6 for instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 on nch2-master-1 Feb 12 21:21:10.099195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e66b7fd1-72aa-49e0-b68e-95640cd09825 req-882e4228-ec42-443f-9bac-33213f81068b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053704 Feb 12 21:21:10.100066 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2233/4588] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:10.178269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:10.178961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:10.200069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.200585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:10.201505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.202860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:10.350366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:10.351084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:10.358088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.362843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:10.362843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.362843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:10.553687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:10.564563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9bea2530-fe3f-4619-8e3c-8b2f18061245 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.392173 Feb 12 21:21:10.565499 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2356/4589] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:10 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:10.704780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:10.705507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:10.719488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.720791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:10.725500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:10.727581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:11.071199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:11.080260 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e06d50e-7fd9-4ac5-b5f5-1fec8e011688 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.734439 Feb 12 21:21:11.083729 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2234/4590] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:10 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:11.246646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:11.260476 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d69a4a4f-7bc9-401a-ad0b-2f3e1ba01851 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.560772 Feb 12 21:21:11.262563 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2357/4591] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:10 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:11.584619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:11.584619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:11.613214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:11.613967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:11.614843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:11.615286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:12.107518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:12.110558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:12.123619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:12.124527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:12.125550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:12.126157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:12.358323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:12.362196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:12.366221 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c907317-13e0-45b7-9a47-c2bd061200b1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.787147 Feb 12 21:21:12.366832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2235/4592] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:11 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:12.379315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e7efa257-c19b-46c4-86c8-3225376dad9c tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.284048 Feb 12 21:21:12.380505 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2358/4593] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:12 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:12.385405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:12.389870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1e9f413f-fdde-4321-ad4a-bc9d7a705108 req-fb262113-358a-4e0a-af3d-adb6c07672a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f7fd737-b889-4ec5-970b-9388c850a094", "tag": "a7ca726b-c529-424c-8983-7b7a58cc17cd"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:12.390905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:12.394835 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:12.394835 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:12.404846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:12.410096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:12.411061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:12.411457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1e9f413f-fdde-4321-ad4a-bc9d7a705108 req-fb262113-358a-4e0a-af3d-adb6c07672a8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:12.413655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:12.414114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1e9f413f-fdde-4321-ad4a-bc9d7a705108 req-fb262113-358a-4e0a-af3d-adb6c07672a8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:12.429198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1e9f413f-fdde-4321-ad4a-bc9d7a705108 req-fb262113-358a-4e0a-af3d-adb6c07672a8 service nova] Creating event network-changed:a7ca726b-c529-424c-8983-7b7a58cc17cd for instance 3f7fd737-b889-4ec5-970b-9388c850a094 on nch2-master-1 Feb 12 21:21:12.451869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1e9f413f-fdde-4321-ad4a-bc9d7a705108 req-fb262113-358a-4e0a-af3d-adb6c07672a8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074694 Feb 12 21:21:12.454417 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2236/4594] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:12.758152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:12.779308 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-474a15e8-dc48-4bd9-be08-289b9f742c4d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.390585 Feb 12 21:21:12.791952 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2359/4595] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:12 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:13.397219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:13.403621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:13.404844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:13.414998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:13.415946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:13.417002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:13.417839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:13.420255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:13.458110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:13.473566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:13.488833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:13.488833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:13.884120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:13.894194 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-376bf3da-841a-4a8e-a604-d9f3f36b9417 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.501194 Feb 12 21:21:13.895452 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2360/4596] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:13 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:13.912275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:13.913622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:13.922794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:13.924263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:13.929558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:13.929558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:14.074624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:14.083399 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ae210f7-3a21-414b-b59b-235368704501 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.702272 Feb 12 21:21:14.090549 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2237/4597] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:13 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:14.321424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:14.330957 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-48317032-b4e6-499f-b622-aadd35c027c8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.433994 Feb 12 21:21:14.331882 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2361/4598] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:13 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:14.912768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:14.914892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:14.927525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:14.928260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:14.929344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:14.930435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:15.109098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:15.109957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:15.132153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:15.134770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:15.138766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:15.140943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:15.289480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:15.301149 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f8f29eb8-def3-4ead-bd9b-c99e4f75693e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.391409 Feb 12 21:21:15.306856 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2238/4599] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:14 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:15.349129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:15.349972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:15.366019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:15.370716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:15.371821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:15.372447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:15.388290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:15.401816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a2b7dea-3328-4618-a7e8-9e3a30ddd04f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.297893 Feb 12 21:21:15.403135 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2362/4600] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:15 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:15.604560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:15.623474 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ba88594-296a-4789-96c3-49d2e64bcae7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.278210 Feb 12 21:21:15.625647 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2239/4601] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:15 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:16.324926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:16.328647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:16.343483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:16.344265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:16.345294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:16.345941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:16.422217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:16.422812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:16.435355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:16.436141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:16.437775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:16.438584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:16.674396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:16.687598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98222ec7-b082-4256-b9d7-d0a485b01a28 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.268956 Feb 12 21:21:16.688575 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2240/4602] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:16 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:16.702869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:16.704130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:16.714212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:16.715023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:16.716231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:16.716840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:16.900676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:16.913080 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2530a83b-5cb6-4c9b-830e-7492b938602f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.596864 Feb 12 21:21:16.916871 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2363/4603] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:16 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:16.950697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:16.983123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab7bbcf0-c8b6-4117-8867-a57e84e7b6ff tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.284837 Feb 12 21:21:16.983732 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2241/4604] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:16 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:17.532590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-318056335", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "ffdd30e2-46b6-49d1-9fdc-c70156040c72"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:17.599886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] validate_networks() for [('ffdd30e2-46b6-49d1-9fdc-c70156040c72', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:21:17.719891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:17.722760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:17.739198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:17.739627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:17.740663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:17.741289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:18.398890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:21:18.399612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:21:18.400276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:21:18.400863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:21:18.401501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:21:18.416333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:18.417044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:18.419172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:18.419852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:18.473923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Getting quotas for project 6c20f717879347dcbd23a4234ad72cfb. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:21:18.485838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Getting quotas for user a5af1758a24b47708c528c4383a2669f and project 6c20f717879347dcbd23a4234ad72cfb. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:21:18.519927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:21:18.524465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:21:18.589732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:18.598957 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-327abda1-ac70-45f8-8457-082166d7ad5d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.895421 Feb 12 21:21:18.602120 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2242/4605] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:17 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:18.620761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:18.624248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:18.630962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:18.631759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:18.632750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:18.633460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:18.665851 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ae56bcd-c046-4d1a-8466-c727284c6a14 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.281420 Feb 12 21:21:18.673450 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2364/4606] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:21:18.679429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:18.680372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:18.689693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:18.690615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:18.691822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:18.692558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:19.010107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:19.021574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f728d050-4c9f-464e-b0b4-300f56b1ed07 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.346673 Feb 12 21:21:19.023451 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2365/4607] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:18 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:19.031574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd3eb6e6-741b-4f4e-a308-ae04586a2934 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:19.032971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd3eb6e6-741b-4f4e-a308-ae04586a2934 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:19.046919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:19.057048 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-58c62cb5-d654-4331-8f29-2e1f012f299d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1722 microversion: 2.1 time: 0.445940 Feb 12 21:21:19.062916 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2243/4608] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:18 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:19.084397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-50401f28-21c4-45e5-9430-de4d06d6fd4d req-52a0f93f-9208-4c2e-9ab4-893346100e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f7fd737-b889-4ec5-970b-9388c850a094", "name": "network-vif-plugged", "status": "completed", "tag": "a7ca726b-c529-424c-8983-7b7a58cc17cd"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:19.088514 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:19.088514 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:19.100289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-50401f28-21c4-45e5-9430-de4d06d6fd4d req-52a0f93f-9208-4c2e-9ab4-893346100e50 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:19.102824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-50401f28-21c4-45e5-9430-de4d06d6fd4d req-52a0f93f-9208-4c2e-9ab4-893346100e50 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:19.122097 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-50401f28-21c4-45e5-9430-de4d06d6fd4d req-52a0f93f-9208-4c2e-9ab4-893346100e50 service nova] Creating event network-vif-plugged:a7ca726b-c529-424c-8983-7b7a58cc17cd for instance 3f7fd737-b889-4ec5-970b-9388c850a094 on nch2-master-1 Feb 12 21:21:19.129529 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-50401f28-21c4-45e5-9430-de4d06d6fd4d req-52a0f93f-9208-4c2e-9ab4-893346100e50 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063559 Feb 12 21:21:19.130691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2244/4609] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:19.157733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd3eb6e6-741b-4f4e-a308-ae04586a2934 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:19.171774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd3eb6e6-741b-4f4e-a308-ae04586a2934 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:19.174125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd3eb6e6-741b-4f4e-a308-ae04586a2934 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:19.178081 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd3eb6e6-741b-4f4e-a308-ae04586a2934 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1261 microversion: 2.26 time: 0.151284 Feb 12 21:21:19.179860 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2366/4610] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:19 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:19.619880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:19.620606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:19.648689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:19.649095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:19.651405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:19.659294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.040470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:20.041094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:20.062102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.062577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.066757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.067573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.082077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:20.091955 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad0b2ed6-b24b-4d4f-ab39-59945d1cc405 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1315 microversion: 2.1 time: 0.476134 Feb 12 21:21:20.092822 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2245/4611] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:19 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:20.099589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:20.101516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:20.106813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.107522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.108593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.109254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.369046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:20.380497 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc7c1016-fd3b-408f-a562-66c17ce21213 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.346057 Feb 12 21:21:20.382030 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2367/4612] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:20 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:20.389262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:20.399067 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6deab7de-50e7-4d93-87c3-bc4549db9f6d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1699 microversion: 2.1 time: 0.303228 Feb 12 21:21:20.404836 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2246/4613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:20 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1699 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:20.445110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:20.448078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:20.455877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.457390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.461502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.461502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.514428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1206457491", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "134f1d2e-bf84-4443-b6d9-93050fa7bfac"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:20.569478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:20.580093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:20.582524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:20.587103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0cd70597-441b-46a8-ad68-a3c95f730d01 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1265 microversion: 2.26 time: 0.159286 Feb 12 21:21:20.589704 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2247/4614] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:20 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:20.593898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] validate_networks() for [('134f1d2e-bf84-4443-b6d9-93050fa7bfac', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:21:20.611153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a55febd-f8f5-441e-8f31-031b1f596db6 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:20.633049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a55febd-f8f5-441e-8f31-031b1f596db6 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:20.633454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a55febd-f8f5-441e-8f31-031b1f596db6 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:20.695596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8a55febd-f8f5-441e-8f31-031b1f596db6 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Going to try to start instance {{(pid=141726) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:21:21.005169 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a55febd-f8f5-441e-8f31-031b1f596db6 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action" status: 202 len: 0 microversion: 2.1 time: 0.414004 Feb 12 21:21:21.006412 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2248/4615] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:20 2022] POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:21.031657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:21.034682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:21.044277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.045696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.046905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.047578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.510450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:21:21.510924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:21:21.511041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:21:21.511392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:21:21.511997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:21:21.514944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:21.526495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.529467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.530547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.531169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.537449 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-914c2f5c-9a7d-4dd2-af08-beaf61073f97 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1708 microversion: 2.1 time: 0.524815 Feb 12 21:21:21.541926 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2249/4616] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:21 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1708 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:21.554982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:21.555935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:21.568721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.569547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.570545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.571596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.578580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Getting quotas for project 6dba504471ec4e0dbe571d46f406999b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:21:21.592694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Getting quotas for user 36c1a2ce291d4cc9b8fff116c327d827 and project 6dba504471ec4e0dbe571d46f406999b. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:21:21.617764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:21:21.620470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:21:21.809219 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d30c5ff1-89da-49cd-8762-487227487996 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426033 Feb 12 21:21:21.810456 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2368/4617] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:21:21.816346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bc1db0c2-db82-40bf-92a7-7ee1b805524e req-115c13c3-6d17-4b4e-a86b-9094beb11cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439a1e23-2699-4fcc-8ad6-79b45a3f4f60", "name": "network-vif-plugged", "status": "completed", "tag": "1c5eeeb1-9fcc-4e59-9db5-afccc775aeb6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:21.818471 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:21.818471 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:21.827080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bc1db0c2-db82-40bf-92a7-7ee1b805524e req-115c13c3-6d17-4b4e-a86b-9094beb11cda service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.828685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bc1db0c2-db82-40bf-92a7-7ee1b805524e req-115c13c3-6d17-4b4e-a86b-9094beb11cda service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.843380 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bc1db0c2-db82-40bf-92a7-7ee1b805524e req-115c13c3-6d17-4b4e-a86b-9094beb11cda service nova] Creating event network-vif-plugged:1c5eeeb1-9fcc-4e59-9db5-afccc775aeb6 for instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 on nch2-master-1 Feb 12 21:21:21.849847 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bc1db0c2-db82-40bf-92a7-7ee1b805524e req-115c13c3-6d17-4b4e-a86b-9094beb11cda service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037865 Feb 12 21:21:21.853477 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2369/4618] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:21.859221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:21.860190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:21.867590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.868355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:21.869562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:21.870212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.200063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:22.208853 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8b9b05a-fcfe-4564-875e-81fb9f91add1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1502 microversion: 2.1 time: 0.665720 Feb 12 21:21:22.211758 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2250/4619] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:21 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1502 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:22.220135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:22.223500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:22.230956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:22.231701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.232839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:22.233404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.252779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:22.261553 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e739d969-b163-4db9-8575-7939d24f0212 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.406456 Feb 12 21:21:22.263441 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2370/4620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:21 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:22.276455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c687fc9-c592-4702-af16-627130702d6c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:22.278123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c687fc9-c592-4702-af16-627130702d6c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:22.385956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c687fc9-c592-4702-af16-627130702d6c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:22.409463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c687fc9-c592-4702-af16-627130702d6c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1228 microversion: 2.1 time: 0.140219 Feb 12 21:21:22.415582 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2371/4621] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:22 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:22.423066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:22.429300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:22.448255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:22.449577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.450785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:22.451491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.504036 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9a3df04-f0bc-481f-a104-d3c9deda3ad8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.085627 Feb 12 21:21:22.504719 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2372/4622] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:22 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:22.559248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:22.560046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:22.617708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:22.618888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.621230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:22.625549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:22.913501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:22.927303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:22.929467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:22.930975 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c778d87c-e0cc-4ad0-88a0-3e7f2bc735af tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1331 microversion: 2.26 time: 0.717842 Feb 12 21:21:22.937023 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2251/4623] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:22 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1331 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:23.270303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:23.283157 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3b7ebef-5c90-43b5-8ef2-7889edec8a12 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1708 microversion: 2.1 time: 0.728622 Feb 12 21:21:23.284241 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2373/4624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:22 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1708 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:23.303411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:23.307048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:23.322737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.323331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.324315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.325527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.430982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:23.431953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:23.438958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.439702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.441013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.441676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.572476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:23.584224 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-531bf1ea-a5a8-42d0-9bce-4f7c93760cc3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1232 microversion: 2.1 time: 0.159337 Feb 12 21:21:23.585947 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2374/4625] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:23 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1232 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:23.592935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:23.594701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:23.603569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.605584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.606677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.611123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.689506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-388442ac-df65-4248-9534-c948aff9f600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.101498 Feb 12 21:21:23.690437 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2375/4626] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:23 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:23.849326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:23.859240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d8f8a066-22c0-48c2-b25a-02c42bbb7231 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1309 microversion: 2.1 time: 0.580386 Feb 12 21:21:23.859830 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2252/4627] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:23 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1309 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:23.952711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:23.954583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:23.970499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.970978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:23.981935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:23.982414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.084378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:24.116948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:24.122920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:24.124473 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-22464357-5a59-4198-b17a-903ac0eccbb6 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1319 microversion: 2.26 time: 0.177092 Feb 12 21:21:24.125390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2376/4628] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:23 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:24.302852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:24.303437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:24.316216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.317272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.319540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.335667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.604573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:24.605487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:24.616668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.617590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.618692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.619571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.681990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:24.696453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-33223e19-dc8a-4f5b-8bef-f9b989474b46 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1708 microversion: 2.1 time: 0.398382 Feb 12 21:21:24.707328 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2253/4629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:24 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1708 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:24.713398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:24.716727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:24.725930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.726600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.728094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.728832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.767074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:24.782574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-691047b2-9ff5-4275-9d5b-ba1cab607000 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1280 microversion: 2.1 time: 0.184753 Feb 12 21:21:24.785510 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2377/4630] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:24 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:24.804804 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a66e45e3-e86c-49f3-b74f-3b599cce5432 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.095846 Feb 12 21:21:24.806531 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2254/4631] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:24 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:24.887523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:24.887523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:24.892110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.892634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:24.894324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:24.894905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.135951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:25.145460 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-20a2cf94-535f-4622-ab54-f750a455bf2c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1488 microversion: 2.1 time: 0.265009 Feb 12 21:21:25.146297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:25.147499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:25.152325 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2378/4632] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:24 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1488 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:25.168610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.169062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.169903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.170333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.172972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:25.174811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:25.187922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.188563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.189505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.194229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.374473 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d7f36706-408c-45c8-8034-be4c500ee9bb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "PUT /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1083 microversion: 2.1 time: 0.206274 Feb 12 21:21:25.375322 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2379/4633] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:21:25 2022] PUT /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1083 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:25.390119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:25.391000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:25.397903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.398268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.399077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.399543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.766508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:25.787079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:25.790309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:25.792684 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2eae7a43-b007-48e4-97e9-fde53572f496 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.652305 Feb 12 21:21:25.793738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2255/4634] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:25 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:25.799853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:25.801665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:25.815668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:25.827688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.828520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.829775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81be1f40-060b-4bba-b516-8fdd0b1f2d03 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1509 microversion: 2.1 time: 0.442128 Feb 12 21:21:25.830242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.831770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.832346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2380/4635] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:25 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:25.854358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:25.854979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:25.862856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.864386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:25.865464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:25.866071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.010596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:26.025023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-84ca9458-3375-407f-b70d-6864baa9f3f6 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1286 microversion: 2.1 time: 0.191565 Feb 12 21:21:26.027225 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2381/4636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:25 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1286 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:26.030869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:26.032290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:26.039569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.040269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.041773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.042386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.101332 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-560b9bed-6aba-402e-bd97-110af9981979 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.074112 Feb 12 21:21:26.102379 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2382/4637] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:26 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:26.108205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:26.109111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:26.116869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.117437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.118460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.119128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.263391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:26.271434 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-26f584a2-d814-41e2-85e4-801ddef7b8cd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1509 microversion: 2.1 time: 0.167327 Feb 12 21:21:26.272010 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2383/4638] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:26 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:26.288821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:26.289583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:26.296637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.297255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.298199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.299236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.335216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:21:26.355116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:26.376567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f93d70c6-af20-4ca8-8f47-28501361334e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1712 microversion: 2.1 time: 0.580057 Feb 12 21:21:26.379952 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2256/4639] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:25 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1712 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:26.732850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a99aca2-b05b-4125-a634-3809824f74fa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 204 len: 0 microversion: 2.1 time: 0.448884 Feb 12 21:21:26.734464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2384/4640] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:21:26 2022] DELETE /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:21:26.742981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:26.744169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:26.756963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.757445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.758464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.759070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.812616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:26.813338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:26.820652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.821301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:26.821922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:26.822364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:27.149232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:27.167132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:27.168664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:27.170040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e21f2fe-e948-4c76-9aa2-199b78a0b5a2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.361618 Feb 12 21:21:27.170999 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2385/4641] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:26 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:21:27.183816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:27.184736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:27.193645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:27.195659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:27.196511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:27.196958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:27.273783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:27.282944 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-45023e75-1b4f-4fa6-b4f9-fd8d5c5574e1 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1286 microversion: 2.1 time: 0.110070 Feb 12 21:21:27.284002 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2386/4642] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:27 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:27.285007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:27.290323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:27.291878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:27.298347 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed326275-71fb-4c51-8ab6-6f3cc02f752b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1515 microversion: 2.1 time: 0.559060 Feb 12 21:21:27.300269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:27.300574 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2257/4643] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:26 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1515 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:27.301272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:27.302908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:27.303577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:27.370920 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-093f3d18-fd50-4d35-b55a-32cd6ac37866 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.084383 Feb 12 21:21:27.371583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2387/4644] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:27 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:27.737067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4c30af64-c72e-4fd1-8cae-8354b23d6328 req-4918168b-deff-4054-b8f6-cc69568d03a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea46a96-8ab1-439e-834a-dbebbd5b960e", "tag": "c13fec3c-57ed-4039-8989-e3b710854a87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:27.737067 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:27.737067 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:27.749884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4c30af64-c72e-4fd1-8cae-8354b23d6328 req-4918168b-deff-4054-b8f6-cc69568d03a7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:27.751512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4c30af64-c72e-4fd1-8cae-8354b23d6328 req-4918168b-deff-4054-b8f6-cc69568d03a7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:27.790620 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4c30af64-c72e-4fd1-8cae-8354b23d6328 req-4918168b-deff-4054-b8f6-cc69568d03a7 service nova] Creating event network-changed:c13fec3c-57ed-4039-8989-e3b710854a87 for instance bea46a96-8ab1-439e-834a-dbebbd5b960e on nch1-master-1 Feb 12 21:21:27.802737 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4c30af64-c72e-4fd1-8cae-8354b23d6328 req-4918168b-deff-4054-b8f6-cc69568d03a7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071559 Feb 12 21:21:27.810585 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2258/4645] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:28.190637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:28.193101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:28.200472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.201327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.202187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.203328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.303880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:28.306383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:28.325490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.326241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.331446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.331894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.539145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:28.551381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:28.561680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:28.563113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-85fbb462-cbfb-4b36-913b-c80e6de6eb92 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.377085 Feb 12 21:21:28.564281 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2388/4646] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:28 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:28.570211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:28.580319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:28.590333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.591431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.594495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.603939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.951295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:28.961775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5639609f-f185-401a-9be2-8959f002cc93 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.664510 Feb 12 21:21:28.973584 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2259/4647] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:28 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:28.979646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:28.980462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:28.988282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.988739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:28.989572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:28.990193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:29.043471 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8361ad24-b3e7-4bd7-8dec-9c1e5874b269 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.067249 Feb 12 21:21:29.045548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2260/4648] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:28 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:29.116138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:29.136492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-388ea673-3638-4e1e-b5ef-6d966b12acbc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1515 microversion: 2.1 time: 0.570042 Feb 12 21:21:29.138543 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2389/4649] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:28 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1515 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:29.586202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:29.588896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:29.599305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:29.600015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:29.601151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:29.601685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:29.825438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4f1db4d7-795b-4118-873d-a1e0ae5c876b req-1001ff25-be3c-4a9a-8f81-23a25b376f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439a1e23-2699-4fcc-8ad6-79b45a3f4f60", "name": "network-vif-deleted", "tag": "1c5eeeb1-9fcc-4e59-9db5-afccc775aeb6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:29.827846 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:29.827846 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:29.840038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4f1db4d7-795b-4118-873d-a1e0ae5c876b req-1001ff25-be3c-4a9a-8f81-23a25b376f23 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:29.840505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4f1db4d7-795b-4118-873d-a1e0ae5c876b req-1001ff25-be3c-4a9a-8f81-23a25b376f23 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:29.860151 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4f1db4d7-795b-4118-873d-a1e0ae5c876b req-1001ff25-be3c-4a9a-8f81-23a25b376f23 service nova] Creating event network-vif-deleted:1c5eeeb1-9fcc-4e59-9db5-afccc775aeb6 for instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 on nch2-master-1 Feb 12 21:21:29.866982 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4f1db4d7-795b-4118-873d-a1e0ae5c876b req-1001ff25-be3c-4a9a-8f81-23a25b376f23 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045710 Feb 12 21:21:29.868319 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2390/4650] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:21:29.917976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:29.930191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:29.934411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:29.937431 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-586df06d-e698-4fd6-8252-2567632da2dc tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.359335 Feb 12 21:21:29.939568 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2261/4651] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:29 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:29.981836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:29.983515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:30.001993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.003157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.006539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.010093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.059390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:30.060732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:30.089501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.090259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.095315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.096226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.173722 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ac845366-6d0d-4420-aba6-44ae415afa7f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.120881 Feb 12 21:21:30.175019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2262/4652] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:30 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:30.189204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:30.190635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:30.204293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.204293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.204293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.205277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.250040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.251053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.251789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lazy-loading 'fault' on Instance uuid 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:30.333683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:30.349705 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c566c9b-f227-47bf-9d01-e65b4c8e4d27 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 200 len: 1320 microversion: 2.1 time: 0.173091 Feb 12 21:21:30.350646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2263/4653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:30 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:30.616086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:30.636174 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d161f9e3-a65c-44ab-b882-c97da363fa7b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.659325 Feb 12 21:21:30.649714 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2391/4654] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:29 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:30.963089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:30.964739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:30.978723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.979185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:30.981150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:30.981834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:31.184460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:31.185699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:31.194717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:31.195213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:31.196116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:31.196776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:31.241467 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cbcfac34-e91c-4ebc-9bcc-2729af130027 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.060571 Feb 12 21:21:31.242124 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2392/4655] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:31 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:31.271079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:31.279371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:31.281267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:31.282517 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21cddc7f-1617-4914-bbba-726225030f6c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.327399 Feb 12 21:21:31.283162 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2264/4656] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:30 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:21:31.374687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:31.375561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:31.385490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:31.386029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:31.386893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:31.387327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:31.404722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 could not be found. Feb 12 21:21:31.405458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:31.406384 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f141bf96-818b-43b3-a9af-da0c3502d857 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 404 len: 111 microversion: 2.1 time: 0.035916 Feb 12 21:21:31.407032 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2393/4657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:31 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:31.514889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1891817763", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7099db00-3881-44c3-bb47-3ded394a66e1"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:31.582224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] validate_networks() for [('7099db00-3881-44c3-bb47-3ded394a66e1', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:21:31.657198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:31.658107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:31.666307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:31.667114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:31.668300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:31.669612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.435020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:32.443914 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f15262b7-5459-4b24-962d-969a2066d47e tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.790343 Feb 12 21:21:32.453959 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2394/4658] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:31 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:32.453959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-85ea23bd-400b-4fbb-9853-94fec5a2788d req-0696c6b4-de9c-4352-9b1d-2b9669e259b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b204088d-8c6f-461a-af70-981dc8768350", "tag": "7402c807-58e8-4b88-9d5e-c420043b89ed"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:32.453959 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:32.453959 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:32.459249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-85ea23bd-400b-4fbb-9853-94fec5a2788d req-0696c6b4-de9c-4352-9b1d-2b9669e259b7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.459703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-85ea23bd-400b-4fbb-9853-94fec5a2788d req-0696c6b4-de9c-4352-9b1d-2b9669e259b7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.472796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-85ea23bd-400b-4fbb-9853-94fec5a2788d req-0696c6b4-de9c-4352-9b1d-2b9669e259b7 service nova] Creating event network-changed:7402c807-58e8-4b88-9d5e-c420043b89ed for instance b204088d-8c6f-461a-af70-981dc8768350 on nch1-master-1 Feb 12 21:21:32.478738 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-85ea23bd-400b-4fbb-9853-94fec5a2788d req-0696c6b4-de9c-4352-9b1d-2b9669e259b7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032448 Feb 12 21:21:32.479987 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2395/4659] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:32.486155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:32.488514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:32.495271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.496020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.498284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.499721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.550748 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5a1cfd1-b16b-4956-a234-d51e58edd07b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 14 microversion: 2.1 time: 0.067765 Feb 12 21:21:32.551684 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2396/4660] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:32 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:21:32.557650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:32.558594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:32.567278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.568964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.569117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:21:32.569117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:21:32.569687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.569796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:21:32.569796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:21:32.570101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:21:32.570776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.584022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.584738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.586437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:32.587106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:32.618501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:21:32.624581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Getting quotas for user f6ee941e292e4152a7e4caacb360cdb3 and project 050182e2f578483db86c4ee4d7391365. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:21:32.640166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:21:32.642887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:21:32.769225 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e6b3882d-6530-4af8-91ba-c18788ba57d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257858 Feb 12 21:21:32.769942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2265/4661] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:21:32.780337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5aff3496-4f63-4452-a5d5-c9ad126c91aa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:32.783496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5aff3496-4f63-4452-a5d5-c9ad126c91aa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:32.895708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5aff3496-4f63-4452-a5d5-c9ad126c91aa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:32.907686 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5aff3496-4f63-4452-a5d5-c9ad126c91aa tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1209 microversion: 2.1 time: 0.131036 Feb 12 21:21:32.908272 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2266/4662] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:32 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:33.114481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:33.129045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:33.135993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:33.137532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-584b67f6-aaa4-4320-b156-31ba7ac14749 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.584446 Feb 12 21:21:33.141041 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2397/4663] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:32 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:33.461731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:33.462372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:33.478761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:33.478946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:33.479689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:33.480329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:33.563052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:33.565123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:33.584680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:33.585480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:33.586499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:33.587545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:33.679565 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-049b5aa3-91b2-479a-b696-419043817778 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action" status: 200 len: 8207 microversion: 2.1 time: 0.120791 Feb 12 21:21:33.680758 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2398/4664] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:33 2022] POST /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094/action => generated 8207 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:33.690645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:33.691413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:33.714430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:33.719127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:33.723096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:33.723096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:33.947278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:33.955938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a21cb12-9673-4d4a-bde7-830a34e7e205 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.497926 Feb 12 21:21:33.971983 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2267/4665] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:33 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:33.982101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60605324-e8d1-4ea6-882d-1f4fcd0388f9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:33.985767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60605324-e8d1-4ea6-882d-1f4fcd0388f9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:34.106514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60605324-e8d1-4ea6-882d-1f4fcd0388f9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:34.116977 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60605324-e8d1-4ea6-882d-1f4fcd0388f9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1209 microversion: 2.1 time: 0.141316 Feb 12 21:21:34.117818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2268/4666] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:33 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:34.156194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:34.156903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:34.167370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.168143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:34.169028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.170995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:34.232357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:34.241813 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a0523c1-4489-46a8-83c6-e92a85864d15 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.555891 Feb 12 21:21:34.246798 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2399/4667] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:33 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:34.274613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:34.275253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:34.328310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.331044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:34.341434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.342184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:34.488279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:34.503482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:34.505672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:34.507070 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5002d05e-8bad-4f9a-b381-f10f1929b207 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.354752 Feb 12 21:21:34.507853 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2269/4668] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:34 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:21:34.705284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:34.726612 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6a94a445-4c11-4891-a9e7-d5ede5823c30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.458808 Feb 12 21:21:34.727426 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2400/4669] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:34 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:34.744780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:34.750615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:34.777403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.778017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:34.779688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.780286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:34.983276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:34.983904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:34.998479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:34.998950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.003326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.003875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.056080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:35.064324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3526f339-52bc-4921-b8d5-090d6d8d2e92 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.324284 Feb 12 21:21:35.078895 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2270/4670] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:34 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:35.085006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:35.085984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:35.093549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.097418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.098624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.099365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.355187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:35.368570 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebd0676e-d908-4c30-a7c3-b136a5c911a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.285994 Feb 12 21:21:35.397691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2271/4671] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:35.405897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:35.407339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:35.412496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:35.422090 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3dc417db-2255-470f-8e40-5cd304b92dc5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.443742 Feb 12 21:21:35.423480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.424351 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2401/4672] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:34 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:35.425133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.433643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.433643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.434940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:35.442280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:35.459253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.460162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.461065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.462911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.643837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:35.655561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88fb6771-e34c-47e2-8bca-68b7da51d6f6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1261 microversion: 2.1 time: 0.255880 Feb 12 21:21:35.666642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Locking {{(pid=141727) lock /opt/stack/nova/nova/compute/api.py:4644}} Feb 12 21:21:35.667740 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2272/4673] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:35 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1261 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:35.673537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:35.674894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:35.683059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.683894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.685419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.686041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.933249 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-87e65007-f344-453f-a7d4-5a7da001aa59 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.507517 Feb 12 21:21:35.940419 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2402/4674] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:35 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:35.947397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:35.948320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:35.959812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.960591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:35.962240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:35.968333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.046926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:36.055411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:36.057041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:36.058342 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db302e9b-9204-4e8e-bd87-fc7fa632d34f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.389379 Feb 12 21:21:36.070949 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2273/4675] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:35 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:36.214954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:36.229316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7364d455-b970-449d-89d2-52e8d151182c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.289823 Feb 12 21:21:36.230212 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2403/4676] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:36.252510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b246091a-8c5b-4d71-8b18-84e10e63ba43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:36.269181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b246091a-8c5b-4d71-8b18-84e10e63ba43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.269745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b246091a-8c5b-4d71-8b18-84e10e63ba43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.332730 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b246091a-8c5b-4d71-8b18-84e10e63ba43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] HTTP exception thrown: Instance 8c34707c-1370-4765-a22b-cdab52d7a63e is locked Feb 12 21:21:36.335626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b246091a-8c5b-4d71-8b18-84e10e63ba43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Returning 409 to user: Instance 8c34707c-1370-4765-a22b-cdab52d7a63e is locked {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:36.335754 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b246091a-8c5b-4d71-8b18-84e10e63ba43 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 409 len: 107 microversion: 2.1 time: 0.088209 Feb 12 21:21:36.336676 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2274/4677] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:36 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 107 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:21:36.345271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:36.346040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:36.356363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.356940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.358213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.359020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.440049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:36.445632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:36.454004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.457647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.460413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.464323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.646700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Unlocking {{(pid=141727) unlock /opt/stack/nova/nova/compute/api.py:4673}} Feb 12 21:21:36.897458 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e3c5d00-f5e1-410b-850c-c5a6714449ad tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.556174 Feb 12 21:21:36.901971 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2404/4678] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:36 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:36.907563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:36.907563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:36.923839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.924336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:36.926518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:36.929760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.059867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:37.070057 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0125d328-d5c4-4fe6-a3de-048f11a70494 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1267 microversion: 2.1 time: 0.166588 Feb 12 21:21:37.083535 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2405/4679] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:36 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:37.089280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2d4a7ba5-5d26-4147-a5c0-27c284150121 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:37.105544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d4a7ba5-5d26-4147-a5c0-27c284150121 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:37.106280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d4a7ba5-5d26-4147-a5c0-27c284150121 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.136410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2d4a7ba5-5d26-4147-a5c0-27c284150121 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:21:37.401577 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2d4a7ba5-5d26-4147-a5c0-27c284150121 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.315906 Feb 12 21:21:37.402159 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2406/4680] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:37 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:37.419983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:37.431634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:37.438347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:37.439264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.440171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:37.440622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.462306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:37.472526 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5efc2bee-a5d5-4c61-9727-e86f385cc9c5 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 1.037294 Feb 12 21:21:37.488034 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2275/4681] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:36 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:37.501020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-19eb90f2-891e-4315-97d7-65e1cd40de46 req-90011d7d-87e7-4ac0-bbbf-f2b45550ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea46a96-8ab1-439e-834a-dbebbd5b960e", "name": "network-vif-plugged", "status": "completed", "tag": "c13fec3c-57ed-4039-8989-e3b710854a87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:37.507183 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:37.507183 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:37.517842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-19eb90f2-891e-4315-97d7-65e1cd40de46 req-90011d7d-87e7-4ac0-bbbf-f2b45550ac0f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:37.520381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-19eb90f2-891e-4315-97d7-65e1cd40de46 req-90011d7d-87e7-4ac0-bbbf-f2b45550ac0f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.535906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-19eb90f2-891e-4315-97d7-65e1cd40de46 req-90011d7d-87e7-4ac0-bbbf-f2b45550ac0f service nova] Creating event network-vif-plugged:c13fec3c-57ed-4039-8989-e3b710854a87 for instance bea46a96-8ab1-439e-834a-dbebbd5b960e on nch1-master-1 Feb 12 21:21:37.541963 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-19eb90f2-891e-4315-97d7-65e1cd40de46 req-90011d7d-87e7-4ac0-bbbf-f2b45550ac0f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050476 Feb 12 21:21:37.543549 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2276/4682] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:37.552557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:37.552557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:37.578303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:37.579190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.581052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:37.581816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:37.761429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:37.775258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:37.778503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:37.781607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e20505e-1782-441f-9a82-dd24abb82fe1 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.373016 Feb 12 21:21:37.781939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2407/4683] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:37 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:38.089545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:38.090806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:38.100677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:38.101104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:38.105647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:38.106226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:38.130293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:38.146624 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-876759e4-2b48-4b7a-8f33-332fbef1d7f8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.601401 Feb 12 21:21:38.147220 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2277/4684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:37 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:38.398786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:38.407563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4c9917ee-5886-4014-ace3-fb26c91628fe tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.321825 Feb 12 21:21:38.413931 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2408/4685] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:38 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:38.494827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:38.495456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:38.535771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:38.540577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:38.540577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:38.540781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:38.800774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:38.801456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:38.818720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:38.819188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:38.820009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:38.820904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:39.253419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:39.264760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:39.266822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:39.268584 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1888b1d7-843f-40b9-84e0-8ed62f1e0a7a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1361 microversion: 2.26 time: 0.472392 Feb 12 21:21:39.269557 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2409/4686] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:38 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:39.280256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:39.281475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:39.292185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:39.297098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:39.298196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:39.299538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:39.339845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:39.398009 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a46c355-d773-498c-8fce-2790f695a49c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.907052 Feb 12 21:21:39.399919 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2278/4687] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:38 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:39.431405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:39.432400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:39.450759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:39.452116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:39.461420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:39.462672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:39.771920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:39.784399 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-53aedc73-f6d4-4706-9439-1c5014e362c7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.354072 Feb 12 21:21:39.787230 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2279/4688] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:39 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:39.795393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:39.797472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-39b7b917-a29c-4d0e-9bdd-88a54c9ba56d req-9d98703a-b109-4693-a775-2dc80e1cfdc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b204088d-8c6f-461a-af70-981dc8768350", "name": "network-vif-plugged", "status": "completed", "tag": "7402c807-58e8-4b88-9d5e-c420043b89ed"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:39.806950 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:39.806950 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:39.810104 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1cefb1cb-d5cd-4be3-a045-20df91857bd7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.533618 Feb 12 21:21:39.811117 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2410/4689] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:39 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:39.829179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-39b7b917-a29c-4d0e-9bdd-88a54c9ba56d req-9d98703a-b109-4693-a775-2dc80e1cfdc3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:39.829990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-39b7b917-a29c-4d0e-9bdd-88a54c9ba56d req-9d98703a-b109-4693-a775-2dc80e1cfdc3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:39.850601 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-39b7b917-a29c-4d0e-9bdd-88a54c9ba56d req-9d98703a-b109-4693-a775-2dc80e1cfdc3 service nova] Creating event network-vif-plugged:7402c807-58e8-4b88-9d5e-c420043b89ed for instance b204088d-8c6f-461a-af70-981dc8768350 on nch1-master-1 Feb 12 21:21:39.857664 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-39b7b917-a29c-4d0e-9bdd-88a54c9ba56d req-9d98703a-b109-4693-a775-2dc80e1cfdc3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070824 Feb 12 21:21:39.859082 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2280/4690] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:40.287844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:40.288469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:40.298196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.298660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.310115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.311717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.419724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:40.421167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:40.431539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.432288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.432994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.433458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.577289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:40.599473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:40.604079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:40.606513 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5e3fa642-d1b7-4124-926c-abd1b80675a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1545 microversion: 2.26 time: 0.322910 Feb 12 21:21:40.609379 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2411/4691] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:40 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1545 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:40.628910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa90801dca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:40.638782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.639506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.640300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:40.647417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.648218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.649261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.650104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.690321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.690321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.704042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.704786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.743697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:40.752191 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3c793cd-f616-4b08-b473-4924d9a4ae9c tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1328 microversion: 2.1 time: 0.338307 Feb 12 21:21:40.753539 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2281/4692] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:40 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1328 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:40.806299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:40.808382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:40.824922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.828789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.831068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.831539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.874214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:40.908956 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5d63f82-d9da-4b71-8706-c1fc000181b2 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1302918330" status: 201 len: 0 microversion: 2.26 time: 0.284222 Feb 12 21:21:40.910508 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2412/4693] 10.222.0.31 () {62 vars in 1379 bytes} [Sat Feb 12 21:21:40 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1302918330 => generated 0 bytes in 287 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Feb 12 21:21:40.916287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f32b1060-8781-4e45-9df0-2f26417b11e1 req-a773acbe-a2c5-4036-b3d4-c806d2e313ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c736337-e285-4bb0-b103-f6ff153aa353", "tag": "bc905f84-cd25-4786-b86f-e2c6173d2461"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:40.918162 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:40.918162 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:40.929577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f32b1060-8781-4e45-9df0-2f26417b11e1 req-a773acbe-a2c5-4036-b3d4-c806d2e313ea service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.930787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f32b1060-8781-4e45-9df0-2f26417b11e1 req-a773acbe-a2c5-4036-b3d4-c806d2e313ea service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.942707 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f32b1060-8781-4e45-9df0-2f26417b11e1 req-a773acbe-a2c5-4036-b3d4-c806d2e313ea service nova] Creating event network-changed:bc905f84-cd25-4786-b86f-e2c6173d2461 for instance 0c736337-e285-4bb0-b103-f6ff153aa353 on nch2-master-1 Feb 12 21:21:40.949117 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f32b1060-8781-4e45-9df0-2f26417b11e1 req-a773acbe-a2c5-4036-b3d4-c806d2e313ea service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037208 Feb 12 21:21:40.949854 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2413/4694] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:40.958351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:40.959613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:40.967020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.967492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:40.968934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:40.969405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.147953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:41.166753 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-091aff89-68d0-4425-84b0-0bc1c59b4584 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.367115 Feb 12 21:21:41.167723 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2282/4695] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:40 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:41.183889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e8bbe584-c070-431b-ba45-159ab9c3ff46 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa907e42790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.194956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8bbe584-c070-431b-ba45-159ab9c3ff46 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.195609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8bbe584-c070-431b-ba45-159ab9c3ff46 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.222810 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e8bbe584-c070-431b-ba45-159ab9c3ff46 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1302918330" status: 204 len: 0 microversion: 2.26 time: 0.052081 Feb 12 21:21:41.227939 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2283/4696] 10.222.0.31 () {60 vars in 1360 bytes} [Sat Feb 12 21:21:41 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1302918330 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:21:41.234743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd8931f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.245851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.246363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.246868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:41.256082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.256836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.258776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.259447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.291684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.292388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.382988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:41.393698 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50e88394-b001-40b9-9b91-f11870a10106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.440690 Feb 12 21:21:41.395263 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2414/4697] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:40 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:41.426219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:41.462921 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a31674e5-709f-4a16-ad62-f4dc376178c3 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 204 len: 0 microversion: 2.26 time: 0.234361 Feb 12 21:21:41.465509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2284/4698] 10.222.0.31 () {60 vars in 1294 bytes} [Sat Feb 12 21:21:41 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:21:41.477413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f5caa1ea-7d53-4e37-ba1a-873216debd5a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fea67f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.489572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f5caa1ea-7d53-4e37-ba1a-873216debd5a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.490028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f5caa1ea-7d53-4e37-ba1a-873216debd5a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.503187 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f5caa1ea-7d53-4e37-ba1a-873216debd5a tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 200 len: 12 microversion: 2.26 time: 0.031048 Feb 12 21:21:41.504663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2415/4699] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 21:21:41 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:41.515303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd36edc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.554616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.557526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.558603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:41.574719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.575579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.576795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.577797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.613160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.614346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.628598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.629766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.730429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:41.771536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.772286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:41.776749 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e9f12faa-1b04-4d13-80c7-aac012029b9c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-367047521" status: 201 len: 0 microversion: 2.26 time: 0.254341 Feb 12 21:21:41.784463 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2285/4700] 10.222.0.31 () {62 vars in 1376 bytes} [Sat Feb 12 21:21:41 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-367047521 => generated 0 bytes in 275 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Feb 12 21:21:41.788252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.790897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.795063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.795813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.798329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6bf4d293-298c-493b-976b-3017a6143d0c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd347ca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.819400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf4d293-298c-493b-976b-3017a6143d0c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.821703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bf4d293-298c-493b-976b-3017a6143d0c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.843180 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6bf4d293-298c-493b-976b-3017a6143d0c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 200 len: 35 microversion: 2.26 time: 0.056842 Feb 12 21:21:41.849901 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2286/4701] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 21:21:41 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 35 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:41.866240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd2ede50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:41.877756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.878419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.878769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:41.890962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.891974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.895236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.896372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:41.937300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:41.942965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.093783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:42.118512 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a7ee74d-2280-46f6-8daa-9fcaab61ccda tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-367047521" status: 204 len: 0 microversion: 2.26 time: 0.258894 Feb 12 21:21:42.122765 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2287/4702] 10.222.0.31 () {60 vars in 1360 bytes} [Sat Feb 12 21:21:41 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-367047521 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:21:42.128257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9b5750ba-2c1e-44ea-b437-87e9347373a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fe0e9940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.138266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b5750ba-2c1e-44ea-b437-87e9347373a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.138713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9b5750ba-2c1e-44ea-b437-87e9347373a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.150505 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9b5750ba-2c1e-44ea-b437-87e9347373a5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 200 len: 12 microversion: 2.26 time: 0.026332 Feb 12 21:21:42.152263 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2288/4703] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 21:21:42 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:42.172536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd347820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.183941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.184928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.185886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:42.194992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.198376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.199568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.200074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.226241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.226699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.239776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:42.256057 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d94cd334-a633-4e8d-aa79-4e73e93689fe tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 204 len: 0 microversion: 2.26 time: 0.097022 Feb 12 21:21:42.257198 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2289/4704] 10.222.0.31 () {60 vars in 1294 bytes} [Sat Feb 12 21:21:42 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 12 21:21:42.266571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.267207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:42.275142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.275602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.276426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.276909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.445081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:42.453302 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72fc5916-2b27-466d-a9a4-28c9f2d00918 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.194432 Feb 12 21:21:42.464027 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2290/4705] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:42 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:42.469633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa907e520d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.479333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.479843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.480279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:42.486895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.487351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.488149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.488591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.513153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.519173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.530193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.530897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.598154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:42.606613 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0d60129-f420-4984-85ed-9fb756f12894 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1528 microversion: 2.1 time: 0.840849 Feb 12 21:21:42.617711 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2416/4706] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:41 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1528 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:42.631073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.632007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:42.642018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.642625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.644903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.645721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.677284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:42.699973 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2957dba8-1bdb-4f6a-94e5-235145ba58da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1595514965" status: 201 len: 0 microversion: 2.26 time: 0.234857 Feb 12 21:21:42.701026 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2291/4707] 10.222.0.31 () {62 vars in 1379 bytes} [Sat Feb 12 21:21:42 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1595514965 => generated 0 bytes in 237 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Feb 12 21:21:42.708353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.709382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:42.715977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.716685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.717858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.718466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.895685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:42.907164 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4f2d3735-971b-4e7e-ba54-83d505581ddd tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1528 microversion: 2.1 time: 0.204168 Feb 12 21:21:42.908158 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2292/4708] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:42 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1528 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:42.914820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa907f69550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:42.934099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.934099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.934099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:42.935274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.935958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.936830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.937450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.947086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:42.956180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2b502f95-5910-47d9-97c7-1437de52687f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.332027 Feb 12 21:21:42.957058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2417/4709] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:42 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:42.963966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.964484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:42.990341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:42.990797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.160859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:43.211033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-79274001-3f18-46af-adac-326ff9f730c5 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-447317414" status: 201 len: 0 microversion: 2.26 time: 0.300762 Feb 12 21:21:43.211702 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2293/4710] 10.222.0.31 () {62 vars in 1376 bytes} [Sat Feb 12 21:21:42 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-447317414 => generated 0 bytes in 302 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Feb 12 21:21:43.222420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa907f69280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.232250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.234807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.234807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.240509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.240967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.241809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.242260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.283878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.285110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.287634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.288093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.299889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.303658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.303658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.303658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.323217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] HTTP exception thrown: Instance b204088d-8c6f-461a-af70-981dc8768350 could not be found. Feb 12 21:21:43.324626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Returning 404 to user: Instance b204088d-8c6f-461a-af70-981dc8768350 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:43.325768 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d543be85-f2da-4108-b703-fab125d4c287 tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 404 len: 111 microversion: 2.1 time: 0.367669 Feb 12 21:21:43.332276 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2418/4711] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:21:42 2022] DELETE /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 111 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:43.336920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.337713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.346807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.346970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.347924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.348372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.406973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:43.451477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e25cdb89-c3c8-4b96-ba87-8e927aaa6e47 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 204 len: 0 microversion: 2.26 time: 0.234157 Feb 12 21:21:43.452622 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2294/4712] 10.222.0.31 () {60 vars in 1294 bytes} [Sat Feb 12 21:21:43 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 12 21:21:43.485038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-daf3d8d6-4d84-4dca-a3c1-79266d3c924d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa907f698b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.517030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-daf3d8d6-4d84-4dca-a3c1-79266d3c924d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.517619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-daf3d8d6-4d84-4dca-a3c1-79266d3c924d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.535779 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-daf3d8d6-4d84-4dca-a3c1-79266d3c924d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 200 len: 12 microversion: 2.26 time: 0.064490 Feb 12 21:21:43.537132 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2295/4713] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 21:21:43 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 12 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:43.549391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.549391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.559814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.560707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.563346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.563815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.711606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:43.719296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f6b2ac68-c736-44f1-bc2f-5aea7c9b920b tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1528 microversion: 2.1 time: 0.387103 Feb 12 21:21:43.719889 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2419/4714] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:43 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1528 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:43.726185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fed50ee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.735583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.736046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.736677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.742954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.743417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.744215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.744754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.772653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.772653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.785587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:43.823335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a6b5ccd-7ebe-452f-9d4a-e624bbf34d1c tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 204 len: 0 microversion: 2.26 time: 0.101701 Feb 12 21:21:43.824179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2420/4715] 10.222.0.31 () {60 vars in 1294 bytes} [Sat Feb 12 21:21:43 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:21:43.831439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Action: 'update', calling method: >, body: {"server": {"name": "b204088d-8c6f-461a-af70-981dc8768350_new"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:43.833687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.845193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.849291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.851249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.851957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.870240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:43.876905 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffe12a77-b71b-4c37-8666-52cd5f3c496e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.338489 Feb 12 21:21:43.889819 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2296/4716] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:43 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:43.891684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd2edc10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.898350 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] HTTP exception thrown: Instance b204088d-8c6f-461a-af70-981dc8768350 could not be found. Feb 12 21:21:43.899477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] Returning 404 to user: Instance b204088d-8c6f-461a-af70-981dc8768350 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:43.900884 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb8888ee-bcf7-4ad4-a2c5-603c4af990df tempest-ServersNegativeTestMultiTenantJSON-85997271 tempest-ServersNegativeTestMultiTenantJSON-85997271-project] 10.222.0.31 "PUT /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 404 len: 111 microversion: 2.1 time: 0.075258 Feb 12 21:21:43.902232 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2421/4717] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:21:43 2022] PUT /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:43.911344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.911825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.912278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.913386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:43.914161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:43.933068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.933686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.934383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.934837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.935003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.938129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.941071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.941744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:43.980131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:43.980596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.004619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.005092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.023687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:21:44.107407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:44.150030 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2e462965-6088-459a-b47c-99fd1decb645 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1093164358" status: 201 len: 0 microversion: 2.26 time: 0.262911 Feb 12 21:21:44.150778 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2297/4718] 10.222.0.31 () {62 vars in 1379 bytes} [Sat Feb 12 21:21:43 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-1093164358 => generated 0 bytes in 264 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Feb 12 21:21:44.172835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:44.173153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:44.180139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.180602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.181602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.182047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.416557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5ce3c2c-8979-4814-86ea-f7bcc96fcdd9 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 204 len: 0 microversion: 2.1 time: 0.509204 Feb 12 21:21:44.420123 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2422/4719] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:21:43 2022] DELETE /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:21:44.427852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fea67ee0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:44.437181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.437682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.438273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:44.447297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.447297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.448032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.448525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.477644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.478411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.489678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.490160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.554103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:44.562493 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3471b63a-0f93-4af9-b924-cab514be9600 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.410612 Feb 12 21:21:44.563218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2298/4720] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:44 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:44.576317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:44.581674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:44.586098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.586568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.587421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.587884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.637343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:44.654270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ac7c2e7-585f-4cba-a833-4567e38bac58 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-379186922" status: 201 len: 0 microversion: 2.26 time: 0.232509 Feb 12 21:21:44.655213 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2423/4721] 10.222.0.31 () {62 vars in 1376 bytes} [Sat Feb 12 21:21:44 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags/tempest-tag-379186922 => generated 0 bytes in 234 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Feb 12 21:21:44.669111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Action: 'update_all', calling method: .version_select at 0x7fa90801d670>, body: {"tags": ["tempest-tag-906103863", "tempest-tag-484564306"]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:44.678200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.678768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.679324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:44.685732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.686294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.687244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.687752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.725683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.726327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.825692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:44.869092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9951005f-9f63-4204-bb77-8760a3e40782 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 200 len: 60 microversion: 2.26 time: 0.207999 Feb 12 21:21:44.870631 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2424/4722] 10.222.0.31 () {62 vars in 1311 bytes} [Sat Feb 12 21:21:44 2022] PUT /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 60 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:44.879940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80985fd7-138e-4c62-bd2d-94ef6dec0f7f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fec89280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:44.888474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80985fd7-138e-4c62-bd2d-94ef6dec0f7f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.888846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80985fd7-138e-4c62-bd2d-94ef6dec0f7f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.901033 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80985fd7-138e-4c62-bd2d-94ef6dec0f7f tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 200 len: 60 microversion: 2.26 time: 0.025102 Feb 12 21:21:44.906109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2425/4723] 10.222.0.31 () {60 vars in 1291 bytes} [Sat Feb 12 21:21:44 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 60 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:44.912201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:44.912830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:44.919415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.919924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:44.920943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:44.921411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.027101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:45.038651 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8d292e3-7e88-46e0-a053-68bbb7add5b3 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1534 microversion: 2.1 time: 0.467490 Feb 12 21:21:45.044698 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2299/4724] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:44 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1534 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:45.056378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '.version_select at 0x7fa8fd2f6ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:45.067924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.075357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.075985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:45.084597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.085348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.087129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.087764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.115889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.117626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.190683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:45.196469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4673c4c5-0abe-4fef-8ff9-a38d1807f0cf tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.288894 Feb 12 21:21:45.198081 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2426/4725] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:44 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:45.265711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'flavor' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:45.279930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-853b2320-564d-4a6c-bac1-dc16a3662772 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags" status: 204 len: 0 microversion: 2.26 time: 0.233699 Feb 12 21:21:45.280820 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2300/4726] 10.222.0.31 () {60 vars in 1294 bytes} [Sat Feb 12 21:21:45 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e/tags => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:21:45.294461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:45.295587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:45.303220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.309498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.310671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.311324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.347037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:21:45.581740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:45.582542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:45.594905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.602263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.602263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.602263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.756027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ebc450bf-8e03-4b02-af9e-6014ad4b14bb tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 204 len: 0 microversion: 2.26 time: 0.469050 Feb 12 21:21:45.759765 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2427/4727] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:21:45 2022] DELETE /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:21:45.766125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:45.766868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:45.786066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.786440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:45.791558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:45.793125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:46.047861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:46.059326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:46.060939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:46.062324 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d29731e-bc0d-422e-996d-369b6a790a9e tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1551 microversion: 2.26 time: 0.301239 Feb 12 21:21:46.063274 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2428/4728] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:45 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1551 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:21:46.075014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:46.075763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:46.088197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:46.090712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:46.091606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:46.092280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:46.111174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:46.122049 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d3a2c76d-a2e4-4c24-9753-d7478a02fe86 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.545945 Feb 12 21:21:46.125777 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2301/4729] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:45 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:46.215657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:46.215998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:46.231905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:46.235841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:46.238265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:46.242141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:46.413216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:46.422344 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58acb441-ba5e-409b-aaed-c5aafa4b4174 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1534 microversion: 2.1 time: 0.358005 Feb 12 21:21:46.426562 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2429/4730] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:46 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1534 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:46.764695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:46.777460 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d4b8f4bd-54b2-4096-b0c3-235515bbff39 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.567968 Feb 12 21:21:46.789729 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2302/4731] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:46 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:47.086478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:47.087614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:47.097279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.098893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.100077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.101021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.142271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:47.143643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:47.152419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.153197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.154618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.155247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.545619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:47.559273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:47.561598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:47.562990 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27f3ad9b-8b5e-463b-82a7-b6093b7c579b tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1551 microversion: 2.26 time: 0.483946 Feb 12 21:21:47.563780 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2430/4732] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:47 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1551 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:47.569880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:47.570759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:47.584562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.584562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.584562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.584562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.889091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:47.915556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54500375-4ae1-4e59-9265-fd438922c1c3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.777330 Feb 12 21:21:47.917581 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2303/4733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:47 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:47.919593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:47.923132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:47.924533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:47.932304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.933220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.934931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:47.940030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:47.941682 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc80a338-7df6-45da-8124-ce5d7269479d tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1534 microversion: 2.1 time: 0.376490 Feb 12 21:21:47.944032 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2431/4734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:47 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1534 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:48.258012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-457a03bd-de2c-4a5d-965a-0f33a1531ad0 req-63e629c6-2716-4ebb-aafd-d4d26a263453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b204088d-8c6f-461a-af70-981dc8768350", "name": "network-vif-deleted", "tag": "7402c807-58e8-4b88-9d5e-c420043b89ed"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:48.261052 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:48.261052 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:48.273163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-457a03bd-de2c-4a5d-965a-0f33a1531ad0 req-63e629c6-2716-4ebb-aafd-d4d26a263453 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.273832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-457a03bd-de2c-4a5d-965a-0f33a1531ad0 req-63e629c6-2716-4ebb-aafd-d4d26a263453 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:48.291222 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-457a03bd-de2c-4a5d-965a-0f33a1531ad0 req-63e629c6-2716-4ebb-aafd-d4d26a263453 service nova] Creating event network-vif-deleted:7402c807-58e8-4b88-9d5e-c420043b89ed for instance b204088d-8c6f-461a-af70-981dc8768350 on nch1-master-1 Feb 12 21:21:48.298584 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-457a03bd-de2c-4a5d-965a-0f33a1531ad0 req-63e629c6-2716-4ebb-aafd-d4d26a263453 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045857 Feb 12 21:21:48.300491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2432/4735] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:48.589694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:48.593324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:48.601246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:48.610257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.611066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:48.613614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.614279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:48.626104 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd5448f9-c1d7-45fb-9590-8637b6fd2821 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.704915 Feb 12 21:21:48.630086 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2304/4736] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:47 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:48.860498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:48.874266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:48.875818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:48.877167 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1fb4d2a5-0b3c-4d43-b946-a46816fd52da tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1551 microversion: 2.26 time: 0.299342 Feb 12 21:21:48.878217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2433/4737] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:48 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1551 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:21:48.934211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:48.934841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:48.941533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.942341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:48.943543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.944225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:48.961169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:48.961865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:48.974002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.974463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:48.975296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:48.975741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:49.020708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:49.021377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:49.022367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lazy-loading 'fault' on Instance uuid b204088d-8c6f-461a-af70-981dc8768350 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:49.101691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c1a2ce291d4cc9b8fff116c327d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dba504471ec4e0dbe571d46f406999b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:49.110952 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-118325de-e800-48b6-a7f0-69b4d7515484 tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 200 len: 1318 microversion: 2.1 time: 0.156010 Feb 12 21:21:49.121167 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2434/4738] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:48 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:49.341756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:49.353970 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5b63c9f5-5d69-4c4a-8261-4e627965220c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1656 microversion: 2.1 time: 0.423636 Feb 12 21:21:49.367394 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2305/4739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:48 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1656 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:49.372284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0678e18-65e6-4910-bbcc-9732cd5719b8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:49.379790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0678e18-65e6-4910-bbcc-9732cd5719b8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:49.380471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0678e18-65e6-4910-bbcc-9732cd5719b8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:49.430028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0678e18-65e6-4910-bbcc-9732cd5719b8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Going to try to start instance {{(pid=141727) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:21:49.649293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:49.652403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:49.678072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:49.678576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:49.682043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:49.683323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:49.780883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0678e18-65e6-4910-bbcc-9732cd5719b8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.412118 Feb 12 21:21:49.783619 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2435/4740] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:49 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:49.803590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:49.809277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:49.841488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:49.841488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:49.841488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:49.841488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.055755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:50.066166 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3351c100-c8cb-4811-82cd-f0d740f1e513 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1665 microversion: 2.1 time: 0.267208 Feb 12 21:21:50.067338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2436/4741] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:49 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1665 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:50.082592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:50.085779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:50.099733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:50.100204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.101057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:50.101534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.222842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:50.223706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.224706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lazy-loading 'fault' on Instance uuid bea46a96-8ab1-439e-834a-dbebbd5b960e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:50.238566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:50.253117 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80b60726-7c83-42b3-b212-59156b4f8e38 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.609057 Feb 12 21:21:50.268308 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2306/4742] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:49 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:50.274630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:50.275611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] [instance: b204088d-8c6f-461a-af70-981dc8768350] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:50.285625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:50.286336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.287327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:50.287944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.302214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:50.305922 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] HTTP exception thrown: Instance b204088d-8c6f-461a-af70-981dc8768350 could not be found. Feb 12 21:21:50.306715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] Returning 404 to user: Instance b204088d-8c6f-461a-af70-981dc8768350 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:50.308286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82a66eac-ad69-46fe-bbd3-de97d3d128ab tempest-ServersNegativeTestMultiTenantJSON-1390857246 tempest-ServersNegativeTestMultiTenantJSON-1390857246-project] 10.222.0.31 "GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350" status: 404 len: 111 microversion: 2.1 time: 0.044493 Feb 12 21:21:50.309097 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2307/4743] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:50 2022] GET /compute/v2.1/servers/b204088d-8c6f-461a-af70-981dc8768350 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:21:50.318903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:50.320827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5af1758a24b47708c528c4383a2669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c20f717879347dcbd23a4234ad72cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:50.322103 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b08dac0-a0ee-465b-9e39-332d260ff12d tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 200 len: 1351 microversion: 2.26 time: 0.253721 Feb 12 21:21:50.322684 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2437/4744] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:50 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 1351 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:50.434383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ec806c2a-32a7-406b-8407-dbd6e910a063 req-ddac5e03-daef-4cce-b745-a2bac4bbcf39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea46a96-8ab1-439e-834a-dbebbd5b960e", "name": "network-vif-deleted", "tag": "c13fec3c-57ed-4039-8989-e3b710854a87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:50.437777 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:50.437777 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:21:50.452803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ec806c2a-32a7-406b-8407-dbd6e910a063 req-ddac5e03-daef-4cce-b745-a2bac4bbcf39 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:50.453584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ec806c2a-32a7-406b-8407-dbd6e910a063 req-ddac5e03-daef-4cce-b745-a2bac4bbcf39 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:50.476537 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ec806c2a-32a7-406b-8407-dbd6e910a063 req-ddac5e03-daef-4cce-b745-a2bac4bbcf39 service nova] Creating event network-vif-deleted:c13fec3c-57ed-4039-8989-e3b710854a87 for instance bea46a96-8ab1-439e-834a-dbebbd5b960e on nch1-master-1 Feb 12 21:21:50.489617 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ec806c2a-32a7-406b-8407-dbd6e910a063 req-ddac5e03-daef-4cce-b745-a2bac4bbcf39 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058729 Feb 12 21:21:50.491224 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2308/4745] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:51.084670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:51.085490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:51.101166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.101780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.105746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.106339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.280588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:51.281461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:51.301712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.301712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.301712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.301712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.570200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:51.580770 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-963b7c93-72af-4a27-a37b-47a28998f437 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1665 microversion: 2.1 time: 0.499474 Feb 12 21:21:51.581391 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2438/4746] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:51 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1665 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:51.592493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:51.593114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] [instance: bea46a96-8ab1-439e-834a-dbebbd5b960e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:51.609551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.610012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.610818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.611292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.662998 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] HTTP exception thrown: Instance bea46a96-8ab1-439e-834a-dbebbd5b960e could not be found. Feb 12 21:21:51.663749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] Returning 404 to user: Instance bea46a96-8ab1-439e-834a-dbebbd5b960e could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:21:51.664745 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5fca8d3-bb6e-4f2c-83c2-aa831b5c1633 tempest-ServerTagsTestJSON-457399291 tempest-ServerTagsTestJSON-457399291-project] 10.222.0.31 "GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e" status: 404 len: 111 microversion: 2.26 time: 0.082056 Feb 12 21:21:51.673291 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2439/4747] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:51 2022] GET /compute/v2.1/servers/bea46a96-8ab1-439e-834a-dbebbd5b960e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:21:51.684667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2d3160ba-d8e9-41b6-8dbb-f29b6188cd7e req-d4c5cd1c-27e7-4272-8df9-1ad537c3ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c736337-e285-4bb0-b103-f6ff153aa353", "name": "network-vif-plugged", "status": "completed", "tag": "bc905f84-cd25-4786-b86f-e2c6173d2461"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:51.689928 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:21:51.689928 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:21:51.713705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2d3160ba-d8e9-41b6-8dbb-f29b6188cd7e req-d4c5cd1c-27e7-4272-8df9-1ad537c3ca14 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:51.713705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2d3160ba-d8e9-41b6-8dbb-f29b6188cd7e req-d4c5cd1c-27e7-4272-8df9-1ad537c3ca14 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:51.734152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2d3160ba-d8e9-41b6-8dbb-f29b6188cd7e req-d4c5cd1c-27e7-4272-8df9-1ad537c3ca14 service nova] Creating event network-vif-plugged:bc905f84-cd25-4786-b86f-e2c6173d2461 for instance 0c736337-e285-4bb0-b103-f6ff153aa353 on nch2-master-1 Feb 12 21:21:51.740702 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2d3160ba-d8e9-41b6-8dbb-f29b6188cd7e req-d4c5cd1c-27e7-4272-8df9-1ad537c3ca14 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065637 Feb 12 21:21:51.753154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2440/4748] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:21:52.406950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:52.415263 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fbd7a341-8e11-413e-a377-a65ea943f8a3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 1.139889 Feb 12 21:21:52.419432 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2309/4749] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:51 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:52.599892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:52.600595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:52.618587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:52.619048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:52.619907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:52.620352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:52.957649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:52.966085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25899a64-5cc5-4584-8e2c-e14d75be1dcb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1665 microversion: 2.1 time: 0.371593 Feb 12 21:21:52.967191 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2441/4750] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:52 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1665 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:53.432694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:53.433576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:53.449799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:53.459126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:53.460129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:53.460602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:53.989810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:53.990537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:53.998130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:53.998651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:53.999644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:54.000086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:54.266014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:54.293300 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1937c4c9-b5b0-42c9-9f0a-fd8a318b92b5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.312885 Feb 12 21:21:54.293945 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2442/4751] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:53 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:54.318703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:54.319633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:54.331911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:54.334385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:54.340545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:54.341441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:54.354840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:54.366521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f3cedd4-1a17-4f9f-9faf-647a30af53e8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1309 microversion: 2.1 time: 0.937319 Feb 12 21:21:54.376378 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2310/4752] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:53 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1309 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:54.995217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:55.005927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce41b239-9b11-4e23-a55b-8fe0d1552685 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.691922 Feb 12 21:21:55.023454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:55.024028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:55.027772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2443/4753] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:54 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:55.032496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.033568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.034841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.035460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.386872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:55.387488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:55.402013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.402533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.403389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.403821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.503852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Unlocking {{(pid=141726) unlock /opt/stack/nova/nova/compute/api.py:4673}} Feb 12 21:21:55.776441 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7fa089a7-5f42-41f5-ace9-2204768d1421 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.755582 Feb 12 21:21:55.777268 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2311/4754] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:55 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:55.794015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:55.794983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:55.812508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.817814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.819781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.823190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.897883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:55.907242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf5fed23-52fd-46b0-8275-efb0d4bd2be9 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1489 microversion: 2.1 time: 0.523931 Feb 12 21:21:55.908527 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2444/4755] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:55 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1489 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:55.931181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-563256606"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:55.933665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:55.943608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.944074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:55.944950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:55.945413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.122176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:56.135451 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c07f30d-55a9-43ec-9eb2-73a1da5aa77f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.346791 Feb 12 21:21:56.136301 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2312/4756] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:55 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:56.162874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:56.164433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:56.174337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8337d69e-c56b-468f-a279-6d54bd8e0844 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "PUT /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1073 microversion: 2.1 time: 0.245268 Feb 12 21:21:56.177383 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2445/4757] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:21:55 2022] PUT /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1073 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:56.192930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.195032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.198414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.198893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.200189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:56.200827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:56.238540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.241398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.245370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.245888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.502332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:56.510506 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-240f2eba-c92c-4407-84b6-268bc13204f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.360269 Feb 12 21:21:56.511099 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2313/4758] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:56 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:21:56.530652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:56.531277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:56.540733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.542458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.543692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.544189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.810043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:56.818481 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0ad538a9-2087-46eb-9f1f-062007a1c69d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1499 microversion: 2.1 time: 0.630318 Feb 12 21:21:56.819079 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2446/4759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:56 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1499 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:56.840323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:56.844097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:56.857593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.858409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:56.860364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.861730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.865183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.868425 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45694c06-4745-4a63-a43c-cd2e1c447192 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.344081 Feb 12 21:21:56.870425 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2314/4760] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:56 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:56.894675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:56.896373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:56.909092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.910944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:56.917327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:56.919037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:57.242657 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96ea8099-7c5e-428e-aed0-d83ac94fd52f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.355250 Feb 12 21:21:57.244304 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2315/4761] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:56 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:57.274154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:57.280791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:57.291294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:57.292649 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72be33c6-e2e8-4fc8-9c60-4bc22f21b678 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1499 microversion: 2.1 time: 0.455186 Feb 12 21:21:57.305569 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2447/4762] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:56 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1499 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:57.309537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98fb13f1-da96-455c-8280-e004c8f183fd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:57.316298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98fb13f1-da96-455c-8280-e004c8f183fd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:57.316765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98fb13f1-da96-455c-8280-e004c8f183fd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:57.323393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:57.327661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:57.327661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:57.327661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:57.364528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98fb13f1-da96-455c-8280-e004c8f183fd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:21:57.638943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98fb13f1-da96-455c-8280-e004c8f183fd tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "POST /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353/action" status: 202 len: 0 microversion: 2.1 time: 0.333048 Feb 12 21:21:57.652222 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2448/4763] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:57 2022] POST /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:21:57.682433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:57.684312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:57.696213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:57.696917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:57.698086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:57.698687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:58.173045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:58.184320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ffbe2a48-941f-4146-82d9-9e92ddc32fc1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.523364 Feb 12 21:21:58.186029 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2449/4764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:57 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:58.398148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:58.413573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d8c55bba-faf4-49b3-a31d-3ea3341df831 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1674 microversion: 2.1 time: 1.162228 Feb 12 21:21:58.422444 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2316/4765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:57 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1674 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:58.518263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-957871285", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": "none"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:58.586941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:21:58.587554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:21:58.588256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:21:58.588657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:21:58.589076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:21:58.599989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:58.600365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:58.601454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:58.602074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:58.621018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Getting quotas for project e3ae1e5d4d3e40c6b1b0fe463115441c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:21:58.626319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Getting quotas for user abe99a19622b4fca8c80febbc97a92a6 and project e3ae1e5d4d3e40c6b1b0fe463115441c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:21:58.640841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:21:58.643692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:21:58.770064 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c45b94cd-e5e9-4599-ae44-76a1d174bbc4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.475301 Feb 12 21:21:58.771576 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2450/4766] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 12 21:21:58.782745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-997147cb-ae6f-407d-a6d2-aea0ad78d0fb tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:58.783836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-997147cb-ae6f-407d-a6d2-aea0ad78d0fb tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:58.859987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-997147cb-ae6f-407d-a6d2-aea0ad78d0fb tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:58.873938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-997147cb-ae6f-407d-a6d2-aea0ad78d0fb tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:58.875672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-997147cb-ae6f-407d-a6d2-aea0ad78d0fb tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:58.878222 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-997147cb-ae6f-407d-a6d2-aea0ad78d0fb tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1277 microversion: 2.57 time: 0.100388 Feb 12 21:21:58.881025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2317/4767] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:58 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:21:59.204127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:59.205157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:59.211669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.212131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.212933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.213397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.226056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:59.226669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:59.237310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.238274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.240036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.240610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.407118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:59.417887 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60428808-aa94-4306-a859-c83b3d32d1ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.218317 Feb 12 21:21:59.432447 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2451/4768] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:59 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:59.433106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lazy-loading 'services' on Instance uuid 245ee706-32b5-4ae4-bf28-f1e5139ea077 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:21:59.433618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:59.433618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:59.440228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.441161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.442299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.442813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.616885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:21:59.631267 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05aed5a4-2666-45a2-a80a-808430b1f2b7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1654 microversion: 2.1 time: 0.203742 Feb 12 21:21:59.632313 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2452/4769] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:21:59 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1654 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:21:59.652823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:21:59.653521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:59.660894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.661642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.662611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:21:59.663220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:21:59.725316 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25397b95-b884-4d31-ba73-64452aec508b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-volume_attachments/e4776652-3b7a-4b3e-8749-56e170786d32" status: 202 len: 0 microversion: 2.1 time: 0.505428 Feb 12 21:21:59.726017 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2318/4770] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:21:59 2022] DELETE /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-volume_attachments/e4776652-3b7a-4b3e-8749-56e170786d32 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:21:59.902849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cea64e57-612d-4a1b-85c1-1f7da7ac8767 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:21:59.903848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cea64e57-612d-4a1b-85c1-1f7da7ac8767 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:21:59.952278 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f538286-9ac1-4b04-a553-7003c1da95e0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.303256 Feb 12 21:21:59.955423 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2453/4771] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:21:59 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:22:00.051737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cea64e57-612d-4a1b-85c1-1f7da7ac8767 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:00.062600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cea64e57-612d-4a1b-85c1-1f7da7ac8767 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:00.066126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cea64e57-612d-4a1b-85c1-1f7da7ac8767 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:00.067601 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cea64e57-612d-4a1b-85c1-1f7da7ac8767 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1277 microversion: 2.57 time: 0.169091 Feb 12 21:22:00.079117 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2319/4772] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:21:59 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:00.085947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:00.086773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:00.097831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:00.098341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:00.099570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:00.099990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:00.134539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-872c691e-c672-47cf-b367-aecfbd878ccc tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Action: 'create', calling method: .version_select at 0x7fa8fea67040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-585061658", "metadata": {"Type": "work"}}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:00.148375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-872c691e-c672-47cf-b367-aecfbd878ccc tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:00.149535 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-872c691e-c672-47cf-b367-aecfbd878ccc tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.195009 Feb 12 21:22:00.160768 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2454/4773] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 21:21:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:22:00.186214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90b1ed7e-7e64-40fb-8100-0000b5a84f24 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Action: 'create', calling method: .version_select at 0x7fa8fe87e0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1463089389", "metadata": {"Type": "work"}}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:00.186214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90b1ed7e-7e64-40fb-8100-0000b5a84f24 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:00.186214 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-90b1ed7e-7e64-40fb-8100-0000b5a84f24 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009918 Feb 12 21:22:00.186214 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2455/4774] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 21:22:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:22:00.201233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ba32d02-caf8-4355-954a-aab46215defb tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Action: 'create', calling method: .version_select at 0x7fa8febef4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-693125438", "metadata": {"Type": "work"}}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:00.202404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ba32d02-caf8-4355-954a-aab46215defb tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:00.203220 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ba32d02-caf8-4355-954a-aab46215defb tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006963 Feb 12 21:22:00.203760 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2456/4775] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 21:22:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:22:00.219247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ebac86d-8222-4166-8191-dcf651999679 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Calling method '.version_select at 0x7fa8fe87e820>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:00.281432 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0ebac86d-8222-4166-8191-dcf651999679 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] HTTP exception thrown: Volume tempest-invalid-2093910702 could not be found. Feb 12 21:22:00.282044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ebac86d-8222-4166-8191-dcf651999679 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Returning 404 to user: Volume tempest-invalid-2093910702 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:00.282916 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0ebac86d-8222-4166-8191-dcf651999679 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2093910702" status: 404 len: 99 microversion: 2.1 time: 0.073230 Feb 12 21:22:00.284597 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2457/4776] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:22:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2093910702 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 12 21:22:00.296765 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-87bd7b49-ef03-46be-a2b6-630126344bbe tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004876 Feb 12 21:22:00.297458 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2458/4777] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 21:22:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 21:22:00.308300 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6452bfea-9ad9-497a-a474-6a2f2caab905 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004154 Feb 12 21:22:00.309785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2459/4778] 10.222.0.31 () {58 vars in 1136 bytes} [Sat Feb 12 21:22:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 12 21:22:00.318770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-baadacd5-7d88-41bf-946d-db7292f59c89 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Calling method '.version_select at 0x7fa8feada160>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:00.343815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:00.354419 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-baadacd5-7d88-41bf-946d-db7292f59c89 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] HTTP exception thrown: Volume 4f3f63d8-ede3-4b5c-acb4-a0c6c068bdaa could not be found. Feb 12 21:22:00.355026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-baadacd5-7d88-41bf-946d-db7292f59c89 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Returning 404 to user: Volume 4f3f63d8-ede3-4b5c-acb4-a0c6c068bdaa could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:00.362539 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-baadacd5-7d88-41bf-946d-db7292f59c89 tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/4f3f63d8-ede3-4b5c-acb4-a0c6c068bdaa" status: 404 len: 109 microversion: 2.1 time: 0.047638 Feb 12 21:22:00.363822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2460/4779] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:22:00 2022] DELETE /compute/v2.1/os-volumes/4f3f63d8-ede3-4b5c-acb4-a0c6c068bdaa => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:00.364649 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2340191-de7c-40f4-957f-b1c659b5cbf4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1661 microversion: 2.1 time: 0.284097 Feb 12 21:22:00.365517 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2320/4780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:00 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1661 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:00.377009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e58d6a82-251e-4701-9e03-de3371522eca tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Calling method '.version_select at 0x7fa8feafba60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:00.404599 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-e58d6a82-251e-4701-9e03-de3371522eca tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] HTTP exception thrown: Volume ddaa9a73-42c7-4510-ab9a-6d856a2592f9 could not be found. Feb 12 21:22:00.405202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e58d6a82-251e-4701-9e03-de3371522eca tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] Returning 404 to user: Volume ddaa9a73-42c7-4510-ab9a-6d856a2592f9 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:00.406081 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e58d6a82-251e-4701-9e03-de3371522eca tempest-VolumesNegativeTest-1323587642 tempest-VolumesNegativeTest-1323587642-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/ddaa9a73-42c7-4510-ab9a-6d856a2592f9" status: 404 len: 109 microversion: 2.1 time: 0.037605 Feb 12 21:22:00.406644 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2461/4781] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:22:00 2022] GET /compute/v2.1/os-volumes/ddaa9a73-42c7-4510-ab9a-6d856a2592f9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:00.436437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:00.440525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:00.444561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:00.445746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:00.446729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:00.447232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:00.754002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:00.763850 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e5687e4-8bd8-4b11-af0a-4a1c39e61514 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.331968 Feb 12 21:22:00.764442 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2321/4782] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:00 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:01.088776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:01.089672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:01.102575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.104560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.106757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.109899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.208281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:01.219796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:01.222214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:01.223404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31523883-7f92-4781-a435-d5ed504a5e9d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1329 microversion: 2.57 time: 0.140321 Feb 12 21:22:01.224572 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2462/4783] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:01 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:01.382546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:01.383535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:01.391675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.392131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.393651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.394275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.635532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:01.650596 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c250752-b18e-46df-aa69-1d82c558d882 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.271807 Feb 12 21:22:01.675088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:01.677874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:01.690125 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2322/4784] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:01.699552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.700333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.701040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.712101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.781942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:01.782660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:01.789224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.789801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:01.790601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:01.791311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.062122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:02.074843 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-83ddbe91-674f-463a-a6bb-dbb2d5fad69a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.407952 Feb 12 21:22:02.077234 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2463/4785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:01 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:02.099776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-08e16942-d24b-437f-ac41-87540f54d541 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:02.113698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08e16942-d24b-437f-ac41-87540f54d541 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.116351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-08e16942-d24b-437f-ac41-87540f54d541 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.166407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-08e16942-d24b-437f-ac41-87540f54d541 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:22:02.204327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:02.227556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fbfd050e-4557-4a4f-8cfc-16d34db6a62f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.446955 Feb 12 21:22:02.237688 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2323/4786] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:01 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:02.247840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:02.248464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:02.256617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.269933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.269933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.269933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.522730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:02.531894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-902dccaa-73a0-4354-b9c7-15cd480580a4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.293038 Feb 12 21:22:02.532122 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-08e16942-d24b-437f-ac41-87540f54d541 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action" status: 202 len: 0 microversion: 2.1 time: 0.451178 Feb 12 21:22:02.533514 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2464/4787] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:22:02 2022] POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:22:02.533907 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2324/4788] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:02 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:02.551314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:02.552773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:02.555361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:02.556741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:02.561675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.562215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.563288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.563944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.565664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.568851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.576052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.576052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.683413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:02.694686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:02.708966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:02.709675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-beb148cd-ce6a-4a42-8357-7a138b7858e2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1335 microversion: 2.57 time: 0.163510 Feb 12 21:22:02.710274 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2465/4789] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:02 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:02.734958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:02.735598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:02.757631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.759929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.761699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:02.762200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:02.997589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.006578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.007865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9cf4ef1a-ad4e-4a2e-befe-2d300118e9c0 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.296543 Feb 12 21:22:03.009701 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2466/4790] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:02 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:03.020464 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aca60fa1-461e-4ec1-b787-39974c2f28a1 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.475330 Feb 12 21:22:03.021074 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2325/4791] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:02 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:03.032451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:03.032451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:03.041496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.041960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.042766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.043205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.244231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:03.245407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:03.254704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.262056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.262056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.262056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.354458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.365082 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a79e53e2-59e7-4b6f-82a9-64aa25169dc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.341704 Feb 12 21:22:03.366164 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2467/4792] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:03 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:03.382724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:03.383769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:03.394464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.395142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.397530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.398228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.621342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.631607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ebd0ff3-9487-4a3d-8acf-a879ca4d3106 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.252660 Feb 12 21:22:03.632821 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2468/4793] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:03 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:03.734078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:03.735105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:03.754281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.754858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.756141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:03.756790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:03.842442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.854446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.856418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.857988 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00823eff-2109-4225-933b-b20667967536 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1335 microversion: 2.57 time: 0.131175 Feb 12 21:22:03.858561 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2469/4794] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:03 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:03.895215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:03.913850 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b69286d9-7cff-4384-a80c-9a3ad0d1199f tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.673651 Feb 12 21:22:03.914907 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2326/4795] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:03 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:04.040784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:04.041429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:04.047969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:04.049207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:04.050259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:04.050909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:04.322506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:04.332628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9ce53066-8547-4989-b360-7fc38470f0c9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.296062 Feb 12 21:22:04.344476 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2470/4796] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:04 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:04.880294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:04.881097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:04.888242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:04.888697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:04.890293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:04.891359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:04.933187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:04.933836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:04.950024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:04.950024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:04.950024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:04.957316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:05.041584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:05.050645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:05.052184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:05.053453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fb5dfec8-e7cf-449e-86aa-3af25e678e66 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1335 microversion: 2.57 time: 0.178387 Feb 12 21:22:05.054347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2327/4797] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:04 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1335 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:05.131724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:05.151054 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e6dced5-a589-49b4-9e23-018190b29b66 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.212294 Feb 12 21:22:05.151054 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2471/4798] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:04 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:05.359305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:05.359934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:05.368240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:05.368908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:05.370186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:05.370498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:05.566894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:05.575534 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-79f04966-8bdb-4a22-84d7-a1f5beaf788b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.225982 Feb 12 21:22:05.576565 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2328/4799] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:05 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:06.076579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:06.078622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:06.098835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.100574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.101077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.101632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.163402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:06.164059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:06.177435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.177563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.178623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.179138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.252642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.261304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.263074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.264461 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2821c426-6c1a-46ef-941e-029d3fb4f838 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1356 microversion: 2.57 time: 0.194485 Feb 12 21:22:06.269515 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2472/4800] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:06 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:06.285714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:06.287656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:06.299684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.300269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.301535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.302036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.406959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:22:06.409055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:22:06.409950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:22:06.411007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:22:06.412409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:22:06.558843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.566782 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-19930dcf-e6bc-446f-a844-ec9e97bba370 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.411601 Feb 12 21:22:06.567371 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2329/4801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:06 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:06.594431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:06.595682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:06.604837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.605252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.607547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.608567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.698580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:06.706316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.707237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.708275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.708723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.759776 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-75b61059-70f1-4e4a-aa84-a77d26a27aa4 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "POST /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc/action" status: 202 len: 1137 microversion: 2.57 time: 0.479311 Feb 12 21:22:06.760729 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2473/4802] 10.222.0.31 () {62 vars in 1319 bytes} [Sat Feb 12 21:22:06 2022] POST /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc/action => generated 1137 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Feb 12 21:22:06.776509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:06.777134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:06.784226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.784707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.785791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:06.786421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:06.898160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.912059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.917341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.924125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:06.925193 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1eeb88b1-ffb0-4f6a-9593-b22df3b54fa3 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.149759 Feb 12 21:22:06.926753 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2474/4803] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:06 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:06.941707 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f1027838-0707-46bb-a13e-f2fd55b09c75 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.351282 Feb 12 21:22:06.942540 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2330/4804] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:06 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:07.585267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:07.585922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:07.597658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:07.599954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:07.606177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:07.606177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:07.850223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:07.859092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-110e5210-83d5-409a-a9b9-40653cc3d9e2 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.278486 Feb 12 21:22:07.859959 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2475/4805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:07 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:07.945305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:07.946014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:07.960069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:07.960453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:07.960984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:07.961506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:07.962510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:07.963129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:07.968005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:07.968773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:07.971456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:07.972178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:08.091969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:08.105718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:08.113463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:08.115044 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c59d68d-71bd-4811-95f1-933b103f3c52 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.173449 Feb 12 21:22:08.116219 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2331/4806] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:07 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:08.269255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:08.279181 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3de92a1-1432-411e-a310-1b6542450242 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.322754 Feb 12 21:22:08.279999 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2476/4807] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:07 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:08.877732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:08.878681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:08.889842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:08.889842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:08.889842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:08.889842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:09.137583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:09.141608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:09.142464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:09.151084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:09.152933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:09.154396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:09.155106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:09.157584 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98b77db2-f93a-4873-84f8-990f72f04ed0 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.284042 Feb 12 21:22:09.165107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2332/4808] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:08 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:09.268909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:09.291005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:09.296223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:09.296578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:09.297526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:09.300325 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ad30717-9842-465d-a2ab-6557a5c0581b tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.166891 Feb 12 21:22:09.313384 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2477/4809] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:09 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:09.318315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:09.321567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:09.324953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:09.325845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:09.843710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:09.855542 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71aaf739-e981-430e-aa13-b914cd529aba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.563048 Feb 12 21:22:09.866375 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2333/4810] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:09 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:10.200389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:10.201481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:10.219144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:10.228715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:10.229510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:10.230061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:10.324896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:10.326305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:10.333830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:10.346127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:10.346127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:10.346127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:10.464162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:10.480824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:10.485277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:10.489056 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d44c351a-d2d5-4539-b1eb-056cbde2e611 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.167375 Feb 12 21:22:10.491733 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2334/4811] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:10 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:10.667380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:10.685531 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5defdadc-570b-48a0-b453-9307f9412714 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.492454 Feb 12 21:22:10.688109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2478/4812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:10 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:10.877090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:10.878250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:10.897161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:10.897161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:10.897161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:10.897161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:11.266976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:11.304093 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4e718bfa-3bb5-4993-b14c-98f4fa90ae77 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.426844 Feb 12 21:22:11.305489 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2335/4813] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:10 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:11.508537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:11.509933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:11.518152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:11.518769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:11.519586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:11.520024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:11.647010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:11.659098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:11.660920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:11.664575 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1eb09102-352d-4d6f-8b43-9d20d0ad2ef2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.158156 Feb 12 21:22:11.667896 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2479/4814] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:11 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:11.704516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:11.705178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:11.720016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:11.720016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:11.720016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:11.720016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:11.936095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:11.945033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-39707542-874d-4ac8-beff-75a44ce18964 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.244381 Feb 12 21:22:11.946137 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2336/4815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:11 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:12.322669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:12.323296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:12.332429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:12.332957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:12.333891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:12.334455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:12.525103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:12.533045 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3d2c183-9b37-4c96-81a8-40b34eb704a3 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1676 microversion: 2.1 time: 0.216232 Feb 12 21:22:12.534217 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2480/4816] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:12 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:12.687605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:12.688234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:12.696859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:12.697328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:12.698486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:12.698951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:12.818111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:12.832381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:12.838021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:12.838021 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f2247da7-e67f-404a-a346-7ef45009cfc8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.153485 Feb 12 21:22:12.849042 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2337/4817] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:12 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:12.964152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:12.966201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:12.974872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:12.975937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:12.977998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:12.978552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:13.544844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:13.552068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:13.552694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:13.556620 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0c26d118-1a8e-4c30-9ac4-f5a531d340f4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.597528 Feb 12 21:22:13.570865 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2481/4818] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:12 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:13.571216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:13.571216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:13.571216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:13.571216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:13.796954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:13.818997 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-46bec3d0-3337-463d-ad66-5d0c2a9cc542 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1653 microversion: 2.1 time: 0.271739 Feb 12 21:22:13.821080 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2338/4819] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:13 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1653 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:13.838547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01e8f984-376e-4d77-ab68-1181e2cab63a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:13.846471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01e8f984-376e-4d77-ab68-1181e2cab63a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:13.846471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01e8f984-376e-4d77-ab68-1181e2cab63a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:13.855586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:13.856739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:13.864424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:13.865133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:13.866167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:13.866785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:13.874461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-01e8f984-376e-4d77-ab68-1181e2cab63a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Going to try to start instance {{(pid=141727) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:22:13.963591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:13.973481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:13.975319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:13.976523 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d949f1bd-9931-4421-9d1a-627758a1f102 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.124986 Feb 12 21:22:13.977412 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2339/4820] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:13 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:14.109203 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-01e8f984-376e-4d77-ab68-1181e2cab63a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action" status: 202 len: 0 microversion: 2.1 time: 0.274503 Feb 12 21:22:14.110159 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2482/4821] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:22:13 2022] POST /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:22:14.119371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:14.120398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:14.135744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:14.135744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:14.135744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:14.135744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:14.452600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:14.467379 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce245914-e918-48e5-b4d4-edb996c13173 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1662 microversion: 2.1 time: 0.352386 Feb 12 21:22:14.468525 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2340/4822] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:14 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1662 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:14.580506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:14.581573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:14.590332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:14.590525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:14.591533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:14.592185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:14.920036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:14.933676 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab10d6f4-3cd1-4836-a300-d9e24c1141d8 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.358915 Feb 12 21:22:14.934824 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2483/4823] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:14 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:14.996510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:14.997245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:15.012829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:15.013299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:15.015346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:15.017930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:15.118209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:15.128863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:15.132189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:15.134749 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe82bab6-06ff-4c96-8717-6dee6b9d1c58 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.142446 Feb 12 21:22:15.136527 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2341/4824] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:14 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:15.493002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:15.493990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:15.504354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:15.505026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:15.506357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:15.506951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:15.792347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:15.804407 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-22acdb5f-4fc8-41e2-ad8b-6f28dfa698bc tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1662 microversion: 2.1 time: 0.321957 Feb 12 21:22:15.805879 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2484/4825] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:15 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:15.955951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:15.957973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:15.993149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:15.999322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:16.004248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:16.004884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:16.154511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:16.155153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:16.162499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:16.170761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:16.171673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:16.172126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:16.434583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:16.443455 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03bd03f9-cb3d-4aec-a14a-c2d9cf27e99b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.494931 Feb 12 21:22:16.448696 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2342/4826] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:15 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:16.572279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:16.584126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:16.592514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:16.593814 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-edd508d5-ba32-4546-9f18-73fe76b9abe6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.443075 Feb 12 21:22:16.595566 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2485/4827] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:16 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:16.825686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:16.825686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:16.833966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:16.834969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:16.835798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:16.836809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:17.088350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:17.100033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8fc9d456-ec48-4181-9691-f206bb0ac337 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1666 microversion: 2.1 time: 0.280091 Feb 12 21:22:17.100618 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2343/4828] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:16 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1666 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:17.466222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:17.466838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:17.476021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:17.476708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:17.480957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:17.480957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:17.612517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:17.613347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:17.621390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:17.621851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:17.627089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:17.627089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:17.698154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:17.716618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db9296b4-e631-4d0a-91de-a96d5f5f51ba tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.253965 Feb 12 21:22:17.717227 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2486/4829] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:17 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:17.853383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:17.863570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:17.865106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:17.866588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-905847ce-09f0-4608-8596-2006509a2c88 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.258440 Feb 12 21:22:17.878567 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2344/4830] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:17 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:18.733668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:18.735206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:18.751128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:18.751984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:18.756102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:18.756102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:18.886200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:18.887318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:18.899318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:18.899935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:18.901061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:18.901825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:19.007328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:19.015792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c0da4a4-1951-4bff-834c-f61e597cca37 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.286330 Feb 12 21:22:19.023658 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2487/4831] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:18 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:19.038391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:19.046921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:19.048967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:19.050461 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8b62c69-bdde-4738-9890-01814111d2ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.168460 Feb 12 21:22:19.051032 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2345/4832] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:18 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:20.043512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:20.044109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:20.060235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:20.060767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:20.061924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:20.062523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:20.069379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:20.070249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:20.081970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:20.082649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:20.083463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:20.083906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:20.177598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:20.190012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:20.192082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:20.193639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2958a9a3-e9ba-4f10-b1e9-9ce7bda7eeb2 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.127759 Feb 12 21:22:20.195134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2346/4833] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:20 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:20.373864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:20.382854 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-01194e63-d3cc-414b-a9b8-144d7c1b80b7 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.344571 Feb 12 21:22:20.383443 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2488/4834] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:20 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:21.212858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:21.213542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:21.221194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:21.222112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:21.223108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:21.223750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:21.330927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:21.341585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:21.343194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:21.344429 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31a404b5-ebc5-4edb-aae8-103bd2e096ea tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.135223 Feb 12 21:22:21.353426 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2347/4835] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:21 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:21.403789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:21.404413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:21.415355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:21.415854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:21.416665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:21.417127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:21.714000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:21.723427 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6ffb89a2-fc36-49c4-b645-6db5c37f123b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.323392 Feb 12 21:22:21.729551 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2489/4836] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:21 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:22.364568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:22.365447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:22.381184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:22.381889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:22.382771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:22.383725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:22.470688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:22.482079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:22.483812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:22.485056 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0391bde6-904a-4ba6-9c06-3aa91c26a876 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.124529 Feb 12 21:22:22.485707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2348/4837] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:22 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:22.754534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:22.755677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:22.772051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:22.772881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:22.774394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:22.780203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:23.094659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:23.105619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3460f26d-3e0b-4c82-bb1c-006b9431667b tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1509 microversion: 2.1 time: 0.364119 Feb 12 21:22:23.106763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2490/4838] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:22 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:23.503510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:23.504161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:23.511507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:23.511970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:23.512770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:23.514189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:23.642438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:23.651407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:23.652919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:23.654135 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf0205bb-e212-4d13-88d1-2378b90539ed tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.154446 Feb 12 21:22:23.665322 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2349/4839] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:23 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:24.124810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:24.125699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:24.134887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.135494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.136398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.136854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.458039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:24.466528 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f826188-4a45-49ab-9fbe-0da9e55a07af tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1486 microversion: 2.1 time: 0.346434 Feb 12 21:22:24.468435 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2491/4840] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:24 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1486 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:24.491984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1012046522"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:24.493315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:24.502438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.503111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.504449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.506655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.678568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:24.679744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:24.681105 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6a26081-13e3-463a-9fdc-740044be3e9d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "PUT /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1060 microversion: 2.1 time: 0.192837 Feb 12 21:22:24.681830 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2350/4841] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:22:24 2022] PUT /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1060 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:24.691226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.691913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.699877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.700043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:24.700043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:24.700605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.710361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.715075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.715919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.726102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.814846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:24.825205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:24.827542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:24.830410 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-71ae71a7-4796-49eb-a8d0-a3a428a4a0c8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.160252 Feb 12 21:22:24.833933 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2492/4842] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:24 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:24.952562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:24.960732 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a763a729-519d-44c0-9d88-3a285e610cb4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1487 microversion: 2.1 time: 0.265780 Feb 12 21:22:24.961431 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2351/4843] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:24 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1487 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:24.977332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:24.978080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:24.984354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.984815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:24.986408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:24.990917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.221312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:25.230026 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07b9f154-c009-4e1e-9f99-4317284887f1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1487 microversion: 2.1 time: 0.256300 Feb 12 21:22:25.232094 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2493/4844] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:24 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1487 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:25.248008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:25.248877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:25.257267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:25.258051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.259093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:25.259839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.294604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:22:25.722508 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-944730fc-fff0-4e59-97e4-6500ec903915 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 204 len: 0 microversion: 2.1 time: 0.477138 Feb 12 21:22:25.725063 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2352/4845] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:25 2022] DELETE /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:22:25.743851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:25.744615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:25.758686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:25.759176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.759980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:25.762034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.854170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:25.856742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:25.865785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:25.866502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.867647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:25.868232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:25.948691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:25.958160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:25.959767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:25.963371 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ac94ce30-9770-43d7-ad1b-7363738b0139 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.112344 Feb 12 21:22:25.963371 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2353/4846] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:25 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:26.007794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:26.016239 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c9611ce-04d1-40d1-8ec3-0b5b491796c6 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1493 microversion: 2.1 time: 0.289823 Feb 12 21:22:26.017907 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2494/4847] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:25 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1493 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:26.983713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:26.984352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:27.009809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:27.010219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:27.011038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:27.011482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:27.034205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:27.035107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:27.068213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:27.069120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:27.070449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:27.071377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:27.148658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:27.161257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:27.166249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:27.166249 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a02f25c4-c15f-44fb-a00a-e7d7c38a12d7 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.185038 Feb 12 21:22:27.167257 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2354/4848] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:26 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:27.524490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:27.552580 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7276cafa-7fa3-4f65-883a-5bcf83bef6fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1493 microversion: 2.1 time: 0.521356 Feb 12 21:22:27.554731 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2495/4849] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:27 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1493 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:27.878839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-81f63f63-30fb-44b6-a7d5-a1a9652b9559 req-0ded9f2e-7fb0-4dba-b938-a50aecbda78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c736337-e285-4bb0-b103-f6ff153aa353", "name": "network-vif-deleted", "tag": "bc905f84-cd25-4786-b86f-e2c6173d2461"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:27.880845 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:22:27.880845 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:22:27.891216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81f63f63-30fb-44b6-a7d5-a1a9652b9559 req-0ded9f2e-7fb0-4dba-b938-a50aecbda78e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:27.892331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-81f63f63-30fb-44b6-a7d5-a1a9652b9559 req-0ded9f2e-7fb0-4dba-b938-a50aecbda78e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:27.910164 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-81f63f63-30fb-44b6-a7d5-a1a9652b9559 req-0ded9f2e-7fb0-4dba-b938-a50aecbda78e service nova] Creating event network-vif-deleted:bc905f84-cd25-4786-b86f-e2c6173d2461 for instance 0c736337-e285-4bb0-b103-f6ff153aa353 on nch2-master-1 Feb 12 21:22:27.919174 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-81f63f63-30fb-44b6-a7d5-a1a9652b9559 req-0ded9f2e-7fb0-4dba-b938-a50aecbda78e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047311 Feb 12 21:22:27.920991 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2355/4850] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:28.191103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:28.192449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:28.203944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:28.207141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:28.208518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:28.211443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:28.332890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:28.362688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:28.386646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:28.387903 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-511aa95a-47ad-41a8-bb9e-218afdccb2e0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.201578 Feb 12 21:22:28.402633 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2496/4851] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:28 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:28.574432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:28.575933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:28.619645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:28.620651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:28.622171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:28.623005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:28.693789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:28.694266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:28.703927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lazy-loading 'fault' on Instance uuid 0c736337-e285-4bb0-b103-f6ff153aa353 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:22:28.767735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:28.775952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6a188cb8-c771-43c8-b645-4aeca651d8ee tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 200 len: 1310 microversion: 2.1 time: 0.208414 Feb 12 21:22:28.776785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2356/4852] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:28 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 1310 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:29.413570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:29.415015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:29.433839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.436359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.440718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.442164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.562644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:29.575802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:29.577757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:29.580218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bdb51e94-1611-4078-87ed-179fcd749d0d tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.173606 Feb 12 21:22:29.581254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2497/4853] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:29 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:29.793903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:29.794696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:29.805228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.806044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.807232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.808293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.833901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 0c736337-e285-4bb0-b103-f6ff153aa353 could not be found. Feb 12 21:22:29.834746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 0c736337-e285-4bb0-b103-f6ff153aa353 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:29.836377 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5ee45008-f9f3-4cf1-bf75-f2ae5952bc2d tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 404 len: 111 microversion: 2.1 time: 0.046326 Feb 12 21:22:29.837504 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2357/4854] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:29 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:29.856465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:29.856465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:29.864140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.870094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.871079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.872031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.896444 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 0c736337-e285-4bb0-b103-f6ff153aa353 could not be found. Feb 12 21:22:29.897316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 0c736337-e285-4bb0-b103-f6ff153aa353 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:29.898529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4491b67c-049f-4d10-9e37-f46953255d6c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 404 len: 111 microversion: 2.1 time: 0.048321 Feb 12 21:22:29.902909 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2498/4855] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:29 2022] DELETE /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:29.909280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:29.917226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 0c736337-e285-4bb0-b103-f6ff153aa353] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:29.924042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.924540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.925576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.926227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.960437 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 0c736337-e285-4bb0-b103-f6ff153aa353 could not be found. Feb 12 21:22:29.961235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 0c736337-e285-4bb0-b103-f6ff153aa353 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:29.962769 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cdfd7460-ae94-415c-8afc-7a6ef4ebab32 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353" status: 404 len: 111 microversion: 2.1 time: 0.059052 Feb 12 21:22:29.963874 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2358/4856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:29 2022] GET /compute/v2.1/servers/0c736337-e285-4bb0-b103-f6ff153aa353 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:22:29.975866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:29.976598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:29.985179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.986054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:29.987041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:29.988169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.025296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 could not be found. Feb 12 21:22:30.026129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.027242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9428f02c-fbd1-4d34-895c-d4f79d09d03e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 404 len: 111 microversion: 2.1 time: 0.058873 Feb 12 21:22:30.031727 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2499/4857] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:29 2022] DELETE /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.036963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.037646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 439a1e23-2699-4fcc-8ad6-79b45a3f4f60] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.050931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.051398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.052202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.052640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.073023 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 could not be found. Feb 12 21:22:30.073661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 439a1e23-2699-4fcc-8ad6-79b45a3f4f60 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.074511 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ba7b8f87-2fe4-4b25-832b-1bc4afbf2164 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60" status: 404 len: 111 microversion: 2.1 time: 0.041342 Feb 12 21:22:30.089155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.092901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.098137 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2359/4858] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/439a1e23-2699-4fcc-8ad6-79b45a3f4f60 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.110289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.110819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.111723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.114360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.164349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 could not be found. Feb 12 21:22:30.164963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.189795 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9b2783f-1b14-49a6-b8b7-4f09c6c12f63 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 404 len: 111 microversion: 2.1 time: 0.099584 Feb 12 21:22:30.191499 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2500/4859] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:30 2022] DELETE /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.200004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.200620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 41a7af65-ec45-4aa1-88d6-0034f7a4eed6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.215180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.215871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.216846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.218446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.250248 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 could not be found. Feb 12 21:22:30.255433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 41a7af65-ec45-4aa1-88d6-0034f7a4eed6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.256586 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4145689d-549a-40a9-b76c-d0589f942ade tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6" status: 404 len: 111 microversion: 2.1 time: 0.060361 Feb 12 21:22:30.257303 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2360/4860] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/41a7af65-ec45-4aa1-88d6-0034f7a4eed6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.272786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.273922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.289265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.299030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.299030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.299030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.325289 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 614e2dee-b81e-4a15-91f6-be8faf694be7 could not be found. Feb 12 21:22:30.327010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 614e2dee-b81e-4a15-91f6-be8faf694be7 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.329916 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98d7906d-5d6f-4045-85fd-11645119a8e1 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 404 len: 111 microversion: 2.1 time: 0.066730 Feb 12 21:22:30.332682 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2501/4861] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:30 2022] DELETE /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:22:30.342089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.342878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 614e2dee-b81e-4a15-91f6-be8faf694be7] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.352244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.355433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.358851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.359389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.389658 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 614e2dee-b81e-4a15-91f6-be8faf694be7 could not be found. Feb 12 21:22:30.390573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 614e2dee-b81e-4a15-91f6-be8faf694be7 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.392844 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2a6e85a-11cc-4383-bc71-368903c0c71c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7" status: 404 len: 111 microversion: 2.1 time: 0.056061 Feb 12 21:22:30.393786 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2361/4862] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/614e2dee-b81e-4a15-91f6-be8faf694be7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.406806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.410392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.417575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.418243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.420276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.420276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.437161 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 could not be found. Feb 12 21:22:30.437936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.443232 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-95c011e1-be7b-46f0-9e99-a509f1e46119 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 404 len: 111 microversion: 2.1 time: 0.039203 Feb 12 21:22:30.443232 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2502/4863] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:30 2022] DELETE /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.448327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.449052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 1d926e2b-0f1a-45c6-aeff-35800faf7d40] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.456311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.456868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.457765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.458435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.490227 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 could not be found. Feb 12 21:22:30.490535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 1d926e2b-0f1a-45c6-aeff-35800faf7d40 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.491224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68f029b3-f52e-4735-8117-76137f21e875 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40" status: 404 len: 111 microversion: 2.1 time: 0.046756 Feb 12 21:22:30.491801 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2362/4864] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/1d926e2b-0f1a-45c6-aeff-35800faf7d40 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.500460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.501348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.518507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.519350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.520370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.520833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.538222 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance e3522148-f16e-43ef-973c-6033239d0aad could not be found. Feb 12 21:22:30.539078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance e3522148-f16e-43ef-973c-6033239d0aad could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.543646 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03f27d9d-4d31-439b-b10f-bf50a019e2fc tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 404 len: 111 microversion: 2.1 time: 0.043999 Feb 12 21:22:30.543646 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2503/4865] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:30 2022] DELETE /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.549780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.550413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e3522148-f16e-43ef-973c-6033239d0aad] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.557336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.557856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.558827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.559281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.576821 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance e3522148-f16e-43ef-973c-6033239d0aad could not be found. Feb 12 21:22:30.577629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance e3522148-f16e-43ef-973c-6033239d0aad could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.578702 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3027e3fd-380b-49ec-a029-7c54609d3b5e tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad" status: 404 len: 111 microversion: 2.1 time: 0.033869 Feb 12 21:22:30.579878 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2363/4866] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/e3522148-f16e-43ef-973c-6033239d0aad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:22:30.589249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-633c02dc-4e5a-4207-9e28-060372336f40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.592887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-633c02dc-4e5a-4207-9e28-060372336f40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e5f0bff2-ccca-4137-b397-1212abad0f68] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.600012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.600926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.602578 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-633c02dc-4e5a-4207-9e28-060372336f40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance e5f0bff2-ccca-4137-b397-1212abad0f68 could not be found. Feb 12 21:22:30.603450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-633c02dc-4e5a-4207-9e28-060372336f40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance e5f0bff2-ccca-4137-b397-1212abad0f68 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.605267 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-633c02dc-4e5a-4207-9e28-060372336f40 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68" status: 404 len: 111 microversion: 2.1 time: 0.021203 Feb 12 21:22:30.609282 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2504/4867] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:30 2022] DELETE /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.612184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.613792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.615463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.616301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8589e97b-16f8-4952-99c4-2c58cc3f389c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.617223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8589e97b-16f8-4952-99c4-2c58cc3f389c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: e5f0bff2-ccca-4137-b397-1212abad0f68] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.617861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.624729 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8589e97b-16f8-4952-99c4-2c58cc3f389c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance e5f0bff2-ccca-4137-b397-1212abad0f68 could not be found. Feb 12 21:22:30.625840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8589e97b-16f8-4952-99c4-2c58cc3f389c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance e5f0bff2-ccca-4137-b397-1212abad0f68 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:30.628165 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8589e97b-16f8-4952-99c4-2c58cc3f389c tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68" status: 404 len: 111 microversion: 2.1 time: 0.016399 Feb 12 21:22:30.632169 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2505/4868] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/e5f0bff2-ccca-4137-b397-1212abad0f68 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:30.637514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:30.638516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.647706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.651858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.651858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.651858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.689885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:22:30.767018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:30.779275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:30.781048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:30.783100 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-833a7431-e8ab-45dc-ae46-45b1e3624ca0 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.187365 Feb 12 21:22:30.785833 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2364/4869] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:30 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:30.933031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:30.934687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:30.963841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.964297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:30.965121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:30.974136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.073717 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19bb3748-5706-4974-bd1e-ff7be5e9cf02 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "DELETE /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 204 len: 0 microversion: 2.1 time: 0.439902 Feb 12 21:22:31.074328 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2506/4870] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:30 2022] DELETE /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:22:31.084909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:31.085659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:31.099006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:31.099652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.103997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:31.104687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.346864 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-286e64ec-85e9-42a6-b717-443186ff9e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.418239 Feb 12 21:22:31.357536 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2365/4871] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:22:30 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:22:31.358102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:31.368491 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b19a3914-e849-4179-9c5e-e3bc37db48a4 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1478 microversion: 2.1 time: 0.289340 Feb 12 21:22:31.383482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:31.384215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:31.387049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2507/4872] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:31 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1478 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:31.398421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:31.398880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.400012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:31.400606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.797421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:31.804174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:31.805037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:31.811424 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09dac4f7-a6a9-4466-b389-1af067976ef7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1671 microversion: 2.1 time: 0.451738 Feb 12 21:22:31.812030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2366/4873] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:31 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1671 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:31.819194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:31.819833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.823515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:31.825892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:31.997721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:32.007887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:32.020444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:32.024507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-628bb065-852d-42e1-971d-91cc9479e399 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.225302 Feb 12 21:22:32.025523 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2508/4874] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:31 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:32.388275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:32.392463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:32.403865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:32.404874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:32.406154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:32.407255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:32.873632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:32.888196 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed9e75d4-4933-4d0f-8976-2ad42d1178eb tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1478 microversion: 2.1 time: 0.501771 Feb 12 21:22:32.889015 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2367/4875] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:32 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1478 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:33.044372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:33.045210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:33.056066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.058862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:33.059884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.060479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:33.203256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:33.220354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:33.228229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:33.230671 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-40c95284-63ca-443a-9bf8-fddf3f902e13 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.190409 Feb 12 21:22:33.232368 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2368/4876] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:33 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:22:33.354650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:33.355746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:33.364734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.374069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:33.375156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.375745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:33.524457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e7c4e863-f8dd-498d-9c1e-c3f0f9e007b1 req-fb61cba9-9395-462e-9964-6c8d527b2609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265e978d-6902-435c-9dc8-2977135fa92a", "name": "network-vif-deleted", "tag": "38352d0d-4c76-4e91-9225-8c4272270ad6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:33.528066 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:22:33.528066 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:22:33.537473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e7c4e863-f8dd-498d-9c1e-c3f0f9e007b1 req-fb61cba9-9395-462e-9964-6c8d527b2609 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.538250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e7c4e863-f8dd-498d-9c1e-c3f0f9e007b1 req-fb61cba9-9395-462e-9964-6c8d527b2609 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:33.568307 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e7c4e863-f8dd-498d-9c1e-c3f0f9e007b1 req-fb61cba9-9395-462e-9964-6c8d527b2609 service nova] Creating event network-vif-deleted:38352d0d-4c76-4e91-9225-8c4272270ad6 for instance 265e978d-6902-435c-9dc8-2977135fa92a on nch2-master-1 Feb 12 21:22:33.579359 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e7c4e863-f8dd-498d-9c1e-c3f0f9e007b1 req-fb61cba9-9395-462e-9964-6c8d527b2609 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058856 Feb 12 21:22:33.581754 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2369/4877] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:22:33.768319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:33.778362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ecb7d079-b492-44a6-917d-1974b7b6daa6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1676 microversion: 2.1 time: 0.954070 Feb 12 21:22:33.779744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2509/4878] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:32 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1676 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:33.907693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:33.908644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:33.915218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.915912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:33.916875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:33.917523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:34.059760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6ee941e292e4152a7e4caacb360cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050182e2f578483db86c4ee4d7391365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:34.067868 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bf6d1a8c-26eb-4e2e-af5e-234025519ae3 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 200 len: 1278 microversion: 2.1 time: 0.165375 Feb 12 21:22:34.072665 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2370/4879] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:33 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:34.255706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:34.255706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:34.267724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:34.268191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:34.269044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:34.269472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:34.374297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:34.384703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:34.386237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:34.387600 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9eaf8841-82e0-44f2-a100-3cfcdddc8809 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.139494 Feb 12 21:22:34.388445 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2510/4880] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:34 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:34.798847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:34.800678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:34.814372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:34.814893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:34.816019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:34.816460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:34.987834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:34.995453 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3bc6cd1e-904f-46dc-80b9-ac5ea56489dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.202034 Feb 12 21:22:34.996032 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2371/4881] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:34 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:35.088747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:35.089386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] [instance: 265e978d-6902-435c-9dc8-2977135fa92a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:35.097188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:35.097485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:35.098532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:35.099161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:35.114930 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] HTTP exception thrown: Instance 265e978d-6902-435c-9dc8-2977135fa92a could not be found. Feb 12 21:22:35.115536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] Returning 404 to user: Instance 265e978d-6902-435c-9dc8-2977135fa92a could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:35.116460 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5a0050b-7f09-4c3f-babc-2d419e1a2583 tempest-ServersTestJSON-501635626 tempest-ServersTestJSON-501635626-project] 10.222.0.31 "GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a" status: 404 len: 111 microversion: 2.1 time: 0.031696 Feb 12 21:22:35.117403 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2511/4882] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:35 2022] GET /compute/v2.1/servers/265e978d-6902-435c-9dc8-2977135fa92a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:35.411716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:35.412768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:35.423669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:35.424576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:35.426061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:35.426866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:35.579127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:35.602122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:35.603939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:35.605307 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-917846ac-9b43-4ef0-aaa8-61a9f7c8435f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.201365 Feb 12 21:22:35.605913 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2372/4883] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:35 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:36.625377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:36.626769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:36.652003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:36.654650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:36.659775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:36.660520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:36.767415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:36.779930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:36.779930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:36.780604 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d12a41a0-cb20-4dcf-89c3-9322f45cf15c tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.160232 Feb 12 21:22:36.794939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2512/4884] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:36 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:37.802671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:37.803293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:37.816181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:37.816643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:37.817479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:37.818085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:38.061550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:38.082237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:38.086837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:38.089228 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78f9eda0-ebae-44e4-a73f-fd85a68e8099 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1365 microversion: 2.57 time: 0.290126 Feb 12 21:22:38.090768 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2373/4885] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:37 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:39.113911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:39.114523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:39.121502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:39.121962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:39.122966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:39.123472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:39.217095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:39.227498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:39.229593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:39.231071 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d835e6fb-87b8-4ca7-8e22-b80e953d7457 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1383 microversion: 2.57 time: 0.121937 Feb 12 21:22:39.231655 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2513/4886] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:39 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1383 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:39.518781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4048d47a-4f5c-47f3-82f5-e86b0be48337 tempest-ExtensionsTest-2022586192 tempest-ExtensionsTest-2022586192-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:39.520327 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4048d47a-4f5c-47f3-82f5-e86b0be48337 tempest-ExtensionsTest-2022586192 tempest-ExtensionsTest-2022586192-project] 10.222.0.31 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.139218 Feb 12 21:22:39.520910 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2374/4887] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:22:39 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:22:39.530425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d73beebb-daa8-4666-b894-c65fdb1b5762 tempest-ExtensionsTest-2022586192 tempest-ExtensionsTest-2022586192-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:39.533948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d73beebb-daa8-4666-b894-c65fdb1b5762 tempest-ExtensionsTest-2022586192 tempest-ExtensionsTest-2022586192-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007248 Feb 12 21:22:39.535103 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2514/4888] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 21:22:39 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:22:40.253828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:40.254548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:40.260963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:40.261496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:40.262303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:40.262750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:40.335035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:40.347101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:40.348678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:40.349888 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e6dcec92-db76-4113-ae28-eaa94b32e108 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1371 microversion: 2.57 time: 0.101603 Feb 12 21:22:40.350463 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2375/4889] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:40 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:41.379504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:41.380173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:41.393777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:41.394405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:41.395540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:41.396113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:41.608557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:41.632309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:41.636279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:41.638994 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb742b16-b5dc-4fda-b823-df78a128319f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1371 microversion: 2.57 time: 0.266647 Feb 12 21:22:41.640302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2515/4890] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:41 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:42.663949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:42.664564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:42.680173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:42.680643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:42.681588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:42.682236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:42.826787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:42.839214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:42.840771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:42.842621 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2281bc97-d72b-430b-bf6a-c8ac0d4795aa tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1356 microversion: 2.57 time: 0.182309 Feb 12 21:22:42.849907 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2376/4891] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:42 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:42.873009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:42.873703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:42.886173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:42.886838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:42.887941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:42.888711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:42.921641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:22:43.348259 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b39b130c-adc3-4083-b980-67d129a44239 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "DELETE /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 204 len: 0 microversion: 2.57 time: 0.481225 Feb 12 21:22:43.357181 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2516/4892] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:22:42 2022] DELETE /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:22:43.365666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:43.366505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:43.399751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:43.402677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:43.407929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:43.407929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:43.513690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:43.527227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:43.530061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:43.531501 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ad49e327-bc4b-4966-b94b-26f70c1df3a8 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1362 microversion: 2.57 time: 0.170289 Feb 12 21:22:43.533974 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2377/4893] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:43 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:44.550787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:44.551487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:44.559273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:44.559726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:44.561269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:44.561933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:44.635175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:44.643734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:44.646639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:44.646639 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f82177c-8f9c-4a54-961c-a54527a86a2f tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1362 microversion: 2.57 time: 0.100644 Feb 12 21:22:44.647162 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2517/4894] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:44 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1362 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:45.561556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bdb044ca-f780-4cc4-87d7-1079cc4173a9 tempest-ComputeTenantNetworksTest-598134816 tempest-ComputeTenantNetworksTest-598134816-project] Calling method '.version_select at 0x7fa8fe5d88b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:45.666684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:45.672478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:45.681574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:45.682030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:45.683494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:45.684256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:45.729722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:45.731468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:45.732258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lazy-loading 'fault' on Instance uuid 10abb71f-8c54-48cd-adaf-47312950d2bc {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:22:45.832533 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bdb044ca-f780-4cc4-87d7-1079cc4173a9 tempest-ComputeTenantNetworksTest-598134816 tempest-ComputeTenantNetworksTest-598134816-project] 10.222.0.31 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.433227 Feb 12 21:22:45.834393 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2378/4895] 10.222.0.31 () {58 vars in 1157 bytes} [Sat Feb 12 21:22:45 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:45.844809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38072664-4f48-4973-b597-bec10d4596ae tempest-ComputeTenantNetworksTest-598134816 tempest-ComputeTenantNetworksTest-598134816-project] Calling method '.version_select at 0x7fa8fe7e7280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:46.011198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-38072664-4f48-4973-b597-bec10d4596ae tempest-ComputeTenantNetworksTest-598134816 tempest-ComputeTenantNetworksTest-598134816-project] 10.222.0.31 "GET /compute/v2.1/os-tenant-networks/012433af-8332-4c86-938d-2ba35f1ff366" status: 200 len: 140 microversion: 2.1 time: 0.171675 Feb 12 21:22:46.012567 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2379/4896] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:22:45 2022] GET /compute/v2.1/os-tenant-networks/012433af-8332-4c86-938d-2ba35f1ff366 => generated 140 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:46.095889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:46.108526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:46.110346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe99a19622b4fca8c80febbc97a92a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3ae1e5d4d3e40c6b1b0fe463115441c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:46.112786 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-516ce7ab-26a2-4eca-bde9-5dab4acd51e6 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 200 len: 1367 microversion: 2.57 time: 0.449987 Feb 12 21:22:46.128822 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2518/4897] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:45 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:22:47.134929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:47.135595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] [instance: 10abb71f-8c54-48cd-adaf-47312950d2bc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:47.150876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:47.151068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:47.152273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:47.153492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:47.173781 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] HTTP exception thrown: Instance 10abb71f-8c54-48cd-adaf-47312950d2bc could not be found. Feb 12 21:22:47.174675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] Returning 404 to user: Instance 10abb71f-8c54-48cd-adaf-47312950d2bc could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:47.175779 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93d9d3e4-cc4b-4337-b79d-984814ba9f67 tempest-ServerShowV257Test-486877399 tempest-ServerShowV257Test-486877399-project] 10.222.0.31 "GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc" status: 404 len: 111 microversion: 2.57 time: 0.046969 Feb 12 21:22:47.177496 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2380/4898] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:22:47 2022] GET /compute/v2.1/servers/10abb71f-8c54-48cd-adaf-47312950d2bc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:22:50.311672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:50.313118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:50.331508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:50.332050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:50.332913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:50.333391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:50.415152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db2d4ee3-7edb-44a6-bb7a-9c3a7fb25117 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107096 Feb 12 21:22:50.415152 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2519/4899] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:22:50 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:22:50.478727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:50.479336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:50.486607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:50.487908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:50.488793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:50.489252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:50.525222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:22:50.982799 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4a6ac78-0b0e-40e9-92b1-7bf2ed014c53 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 204 len: 0 microversion: 2.1 time: 0.507528 Feb 12 21:22:50.984634 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2381/4900] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:22:50 2022] DELETE /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:22:50.992945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:50.993605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:51.002314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:51.008903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:51.010111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:51.012410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:51.239203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:51.247871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0888a400-320f-4884-b71c-13ac03fb951f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1672 microversion: 2.1 time: 0.258623 Feb 12 21:22:51.252335 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2520/4901] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:50 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:52.271849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:52.273562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:52.297058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:52.302516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:52.303938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:52.305775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:52.736287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:52.750399 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cce12b89-ef6d-4440-b9bd-e09c23280c6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1672 microversion: 2.1 time: 0.484096 Feb 12 21:22:52.763537 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2382/4902] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:52 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1672 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:53.246452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c28f668a-1bfb-4224-937c-9fde8682b66d tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] Calling method '.version_select at 0x7fa8fe164f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:53.430613 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c28f668a-1bfb-4224-937c-9fde8682b66d tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.485832 Feb 12 21:22:53.431630 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2521/4903] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:22:52 2022] GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f/defaults => generated 371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:53.443387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1efd417b-1b07-4fc5-a059-e31136f30b4c tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] Calling method '.version_select at 0x7fa90800c9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:53.772762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:53.773413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:53.790164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:53.790529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:53.791343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:53.791790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:53.818353 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1efd417b-1b07-4fc5-a059-e31136f30b4c tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f" status: 200 len: 371 microversion: 2.1 time: 0.378923 Feb 12 21:22:53.825255 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2383/4904] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:22:53 2022] GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f => generated 371 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:53.844408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4925c83-971c-45f2-9379-f0104a220584 tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] Calling method '.version_select at 0x7fa8fd2f6550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:54.025194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:54.035976 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b84215d0-7ea3-4911-8e89-3639ebc5d937 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1672 microversion: 2.1 time: 0.266550 Feb 12 21:22:54.037257 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2522/4905] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:53 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1672 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:54.443368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4925c83-971c-45f2-9379-f0104a220584 tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.608939 Feb 12 21:22:54.458278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37e62980-1157-40e9-8c09-6c22fc06e257 tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] Calling method '.version_select at 0x7fa8fe87e4c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:54.461610 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2384/4906] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:22:53 2022] GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f/defaults => generated 371 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:55.052801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:55.053856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:55.062040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:55.062500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:55.063301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:55.063737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:55.190531 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37e62980-1157-40e9-8c09-6c22fc06e257 tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f" status: 200 len: 371 microversion: 2.1 time: 0.737044 Feb 12 21:22:55.193940 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2523/4907] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:22:54 2022] GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f => generated 371 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:55.210094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b490dfe8-debe-4b7e-a86c-9429da4f02e7 tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] Calling method '.version_select at 0x7fa8fea2d280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:55.347076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:55.359918 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fa39b957-0e8e-47ab-843b-7a44f5124dad tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1605 microversion: 2.1 time: 0.310968 Feb 12 21:22:55.360523 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2385/4908] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:55 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1605 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:22:55.633175 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b490dfe8-debe-4b7e-a86c-9429da4f02e7 tempest-QuotasTestJSON-130510113 tempest-QuotasTestJSON-130510113-project] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f?user_id=61f1ccaf69d64c7e99b8fe45888aa56b" status: 200 len: 371 microversion: 2.1 time: 0.432357 Feb 12 21:22:55.638146 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2524/4909] 10.222.0.31 () {58 vars in 1322 bytes} [Sat Feb 12 21:22:55 2022] GET /compute/v2.1/os-quota-sets/f10b57b77ff84c8b818927a90954bd2f?user_id=61f1ccaf69d64c7e99b8fe45888aa56b => generated 371 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:56.385347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:56.386117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:56.415383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:56.415850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:56.416711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:56.417266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:56.462562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:56.463309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:56.463797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lazy-loading 'fault' on Instance uuid 245ee706-32b5-4ae4-bf28-f1e5139ea077 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:22:56.513038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:22:56.524806 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3a9f4ad-2cbf-4bb6-b18f-bc2984ff18b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 200 len: 1326 microversion: 2.1 time: 0.143529 Feb 12 21:22:56.528069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2525/4910] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:56 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:22:56.866186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-24664729-84c3-4926-a003-e6aa58105cff req-b04cd036-0526-4820-b450-e34c22d35943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "245ee706-32b5-4ae4-bf28-f1e5139ea077", "name": "network-vif-deleted", "tag": "6f7bc51a-17c9-4327-a4af-7e41ba429351"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:56.869787 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:22:56.869787 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:22:56.884459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-24664729-84c3-4926-a003-e6aa58105cff req-b04cd036-0526-4820-b450-e34c22d35943 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:56.888382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-24664729-84c3-4926-a003-e6aa58105cff req-b04cd036-0526-4820-b450-e34c22d35943 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:56.920392 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-24664729-84c3-4926-a003-e6aa58105cff req-b04cd036-0526-4820-b450-e34c22d35943 service nova] Creating event network-vif-deleted:6f7bc51a-17c9-4327-a4af-7e41ba429351 for instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 on nch1-master-1 Feb 12 21:22:56.931351 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-24664729-84c3-4926-a003-e6aa58105cff req-b04cd036-0526-4820-b450-e34c22d35943 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.003556 Feb 12 21:22:56.935985 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2386/4911] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:22:57.545185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:57.545901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:22:57.558472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:57.560926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:57.569911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:22:57.571844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:22:57.604397 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] HTTP exception thrown: Instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 could not be found. Feb 12 21:22:57.605617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Returning 404 to user: Instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:22:57.607098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3331f63b-b9fc-4cb9-a6af-d05479b25bfd tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 404 len: 111 microversion: 2.1 time: 0.066320 Feb 12 21:22:57.608534 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2526/4912] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:22:57 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:22:57.618777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd70ce51-40e5-4b0f-bbf5-f269b45c4f1d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '.version_select at 0x7fa8fe551b80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:22:57.768138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd70ce51-40e5-4b0f-bbf5-f269b45c4f1d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-697650077" status: 202 len: 0 microversion: 2.1 time: 0.154233 Feb 12 21:22:57.768990 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2387/4913] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-697650077 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:22:59.102856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: .version_select at 0x7fa8fe0dc790>, body: {"keypair": {"name": "tempest-keypair-934995220"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:22:59.125801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:22:59.132888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for user b2f827b7e9bd4d3c9b1062b67179782d and project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:22:59.585993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:22:59.593272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for user b2f827b7e9bd4d3c9b1062b67179782d and project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:22:59.628713 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.526048 Feb 12 21:22:59.630144 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2527/4914] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:22:59 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:01.094751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd70ce51-40e5-4b0f-bbf5-f269b45c4f1d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:01.097123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd70ce51-40e5-4b0f-bbf5-f269b45c4f1d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004398 Feb 12 21:23:01.103235 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2388/4915] 10.222.0.31 () {56 vars in 885 bytes} [Sat Feb 12 21:23:01 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 12 21:23:01.108785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:01.112304 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.007510 Feb 12 21:23:01.118941 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2528/4916] 10.222.0.31 () {54 vars in 1034 bytes} [Sat Feb 12 21:23:01 2022] GET /compute/v2/ => generated 379 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Feb 12 21:23:01.124409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd70ce51-40e5-4b0f-bbf5-f269b45c4f1d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:01.125499 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd70ce51-40e5-4b0f-bbf5-f269b45c4f1d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001493 Feb 12 21:23:01.126242 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2389/4917] 10.222.0.31 () {54 vars in 1040 bytes} [Sat Feb 12 21:23:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:01.133879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:01.135154 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f20776b-f0a0-455b-80aa-78bf22e921ba tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001678 Feb 12 21:23:01.136015 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2529/4918] 10.222.0.31 () {56 vars in 885 bytes} [Sat Feb 12 21:23:01 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Feb 12 21:23:03.883212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-34904869", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d3223c4-7d3e-45d4-827e-f74909602e0e"}], "security_groups": [{"name": "tempest-securitygroup--1666685400"}], "key_name": "tempest-keypair-934995220", "user_data": "}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:04.000140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] validate_networks() for [('3d3223c4-7d3e-45d4-827e-f74909602e0e', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:23:04.603091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:23:04.603801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:23:04.604432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:23:04.605024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:23:04.605612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:23:04.616976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:04.617524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:04.618536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:04.619117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:04.640758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:23:04.648564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Getting quotas for user b2f827b7e9bd4d3c9b1062b67179782d and project 1dda620b49344bdaa8408d14a9e44acd. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:23:04.669854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:23:04.672474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:23:04.785280 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c4e3295-506a-4b5e-b8e1-ebe5d54b9bde tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.906727 Feb 12 21:23:04.787494 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2390/4919] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:23:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:23:04.797413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6d994c6-f373-4c18-b9db-e32d0e2e58e5 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:04.798637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6d994c6-f373-4c18-b9db-e32d0e2e58e5 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:04.872748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6d994c6-f373-4c18-b9db-e32d0e2e58e5 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:04.872748 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6d994c6-f373-4c18-b9db-e32d0e2e58e5 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1235 microversion: 2.1 time: 0.076918 Feb 12 21:23:04.872748 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2530/4920] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:04 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1235 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:05.887957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-623434b4-af15-4a79-8c93-74775e85b0ca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:05.888807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-623434b4-af15-4a79-8c93-74775e85b0ca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:05.968380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-623434b4-af15-4a79-8c93-74775e85b0ca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:05.976710 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-623434b4-af15-4a79-8c93-74775e85b0ca tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1235 microversion: 2.1 time: 0.092509 Feb 12 21:23:05.986966 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2531/4921] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:05 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:06.177477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Action: 'create', calling method: .version_select at 0x7fa8fe7e7280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-430221098"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:06.994364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:06.995692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:07.012452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:07.013132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:07.013999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:07.014532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:07.162267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:07.174563 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e9468e6-111b-46b8-80dd-b8be06394a79 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1287 microversion: 2.1 time: 0.183753 Feb 12 21:23:07.177961 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2532/4922] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:06 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:07.319116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-95e5e6d8-0278-43cf-b4b3-fb87c095d561 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 1.504333 Feb 12 21:23:07.320750 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2391/4923] 10.222.0.31 () {60 vars in 1154 bytes} [Sat Feb 12 21:23:05 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 1507 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 12 21:23:07.338406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-41c007e8-bb24-4d46-8ea8-0bc76284e68d tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fea7c700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:07.425284 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-41c007e8-bb24-4d46-8ea8-0bc76284e68d tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.090256 Feb 12 21:23:07.425936 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2533/4924] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:07 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:08.198410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:08.199044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:08.220283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:08.227009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:08.227009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:08.227009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:08.350090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:08.358622 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f2a5d3c-c56d-4adb-bfd6-19c1c508fe65 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1305 microversion: 2.1 time: 0.167476 Feb 12 21:23:08.359253 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2392/4925] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:08 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:08.439587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-263d3edf-95d1-46d0-96c3-b3f1a5f0b1cf tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdf0e280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:08.538794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-263d3edf-95d1-46d0-96c3-b3f1a5f0b1cf tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.104688 Feb 12 21:23:08.540590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2534/4926] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:08 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:09.376016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:09.376718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:09.387432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:09.388125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:09.389100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:09.389717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:09.554898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27dabe1c-971b-4013-bd6d-0ba6cde783c7 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe0dc1f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:09.624569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27dabe1c-971b-4013-bd6d-0ba6cde783c7 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.076185 Feb 12 21:23:09.625178 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2535/4927] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:09 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:09.831269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:09.843020 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77926f2e-0320-4c72-aa07-14b3b16c5963 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.466792 Feb 12 21:23:09.843020 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2393/4928] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:09 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:09.904224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:09.906046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:09.919327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:09.920249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:09.922766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:09.923511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:10.269491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:10.278371 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f246b02-1e36-4859-8c0f-bea1413fe913 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.379255 Feb 12 21:23:10.279047 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2536/4929] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:09 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:10.304028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:10.304776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:10.320908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:10.321674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:10.322547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:10.323428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:10.637302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd8c83b0-b892-4762-83e7-1f386e39a3cb tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdf31ca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:10.729772 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd8c83b0-b892-4762-83e7-1f386e39a3cb tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.089341 Feb 12 21:23:10.729772 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2537/4930] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:10 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:10.859355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:10.860580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:10.869989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:10.873277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:10.874602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:10.875428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:10.952774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:10.965921 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea9a7fbb-f54d-4d17-af89-12d6dc241b30 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.671289 Feb 12 21:23:10.977780 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2394/4931] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:10 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:10.987560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-297c13e7-ea49-45e4-a101-e94ea5acc962 req-55d1e68f-b37d-4704-92c8-2204ce8df9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0039e4f0-8954-4956-88f8-0e7da9b04f05", "tag": "35690731-24a6-462a-972e-d7eb40390ef6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:10.989200 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:10.989200 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:23:11.006777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-297c13e7-ea49-45e4-a101-e94ea5acc962 req-55d1e68f-b37d-4704-92c8-2204ce8df9f7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:11.007289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-297c13e7-ea49-45e4-a101-e94ea5acc962 req-55d1e68f-b37d-4704-92c8-2204ce8df9f7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:11.021529 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-297c13e7-ea49-45e4-a101-e94ea5acc962 req-55d1e68f-b37d-4704-92c8-2204ce8df9f7 service nova] Creating event network-changed:35690731-24a6-462a-972e-d7eb40390ef6 for instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 on nch1-master-1 Feb 12 21:23:11.032792 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-297c13e7-ea49-45e4-a101-e94ea5acc962 req-55d1e68f-b37d-4704-92c8-2204ce8df9f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049876 Feb 12 21:23:11.039190 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2395/4932] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:11.054724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:11.055478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:11.063365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:11.063861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:11.071112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:11.075077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:11.142277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:11.147676 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c099c9d-8247-46ed-830b-fc2b55193158 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.292838 Feb 12 21:23:11.148495 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2538/4933] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:10 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:11.615576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:11.626048 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1089cc1a-28a4-4c63-9b97-7fdf91a45d45 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.585473 Feb 12 21:23:11.626832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2396/4934] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:11 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:11.644026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:11.645566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:11.653181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:11.654129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:11.655152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:11.655879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:11.737222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e283f2ee-4b01-4670-9bfa-cedf741af5dc tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe402550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:11.830845 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e283f2ee-4b01-4670-9bfa-cedf741af5dc tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.097991 Feb 12 21:23:11.833060 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2397/4935] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:11 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:11.861251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:11.870798 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f792f0b5-8d3a-47b7-9ff9-7c0359fcf31c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.230733 Feb 12 21:23:11.887530 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2539/4936] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:11 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:12.014595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-704633217", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2d2fb25f-a576-44b7-8aec-e44f4519d495"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:12.118184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] validate_networks() for [('2d2fb25f-a576-44b7-8aec-e44f4519d495', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:23:12.164750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:12.165647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:12.173269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:12.175047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:12.178921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:12.178921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:12.374549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:12.388926 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4709909f-3f20-49a8-b671-1cff0c267ef2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.227476 Feb 12 21:23:12.390418 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2540/4937] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:12 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:12.844181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0734c1f0-4cca-40ad-83ca-6bc69d35aaa0 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdf0edc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:12.934671 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0734c1f0-4cca-40ad-83ca-6bc69d35aaa0 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.094946 Feb 12 21:23:12.936986 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2541/4938] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:12 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:12.976447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:23:12.976987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:23:12.977497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:23:12.977905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:23:12.978321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:23:12.994141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:12.996223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:12.999276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:12.999703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:13.055209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:23:13.060564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:23:13.078217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:23:13.081438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:23:13.244565 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6b02df92-6c75-49cc-927d-1f2646c2bf9f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226300 Feb 12 21:23:13.245321 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2398/4939] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:23:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:23:13.260334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90bd129a-e771-4bc8-999e-3b5d213cc6b3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:13.261137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-90bd129a-e771-4bc8-999e-3b5d213cc6b3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:13.331924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-90bd129a-e771-4bc8-999e-3b5d213cc6b3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:13.340457 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-90bd129a-e771-4bc8-999e-3b5d213cc6b3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1214 microversion: 2.1 time: 0.087369 Feb 12 21:23:13.342303 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2542/4940] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:13 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:13.409064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:13.409822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:13.417927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:13.418658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:13.419675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:13.420134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:13.622385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:13.631556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e77d976f-c62d-4589-ada9-766a9ce2a661 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.227582 Feb 12 21:23:13.641802 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2399/4941] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:13 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:13.953604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b6c7a9a3-66da-408c-b35c-b7f938454d07 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe87e700>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:14.020160 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b6c7a9a3-66da-408c-b35c-b7f938454d07 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 338 microversion: 2.1 time: 0.071632 Feb 12 21:23:14.020792 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2543/4942] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:13 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 338 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:14.039663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a4e3d3d-7191-4804-b5f5-d006bf0c6e0b tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Action: 'create', calling method: .version_select at 0x7fa8fe551430>, body: {"snapshot": {"volume_id": "132dabd2-a864-4525-9a31-66d563ade93d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1578015896"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:14.357853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13bba866-06d1-4f6b-b950-21ff7954a118 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:14.358467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-13bba866-06d1-4f6b-b950-21ff7954a118 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:14.455570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-13bba866-06d1-4f6b-b950-21ff7954a118 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:14.462987 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13bba866-06d1-4f6b-b950-21ff7954a118 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1214 microversion: 2.1 time: 0.109022 Feb 12 21:23:14.484610 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2544/4943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:14 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:14.650467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:14.651434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:14.659180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:14.660172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:14.661234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:14.662436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:14.734998 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a4e3d3d-7191-4804-b5f5-d006bf0c6e0b tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.706687 Feb 12 21:23:14.736509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2400/4944] 10.222.0.31 () {60 vars in 1161 bytes} [Sat Feb 12 21:23:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:14.747624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f5e11f6d-3dd0-4a48-a8ea-da08de94ed33 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe548e50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:14.803154 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f5e11f6d-3dd0-4a48-a8ea-da08de94ed33 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.060111 Feb 12 21:23:14.803969 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2401/4945] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:14 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:14.814457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd08ff31-3b68-4c9f-90c7-df991c3df6a0 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa907ff0700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:14.871419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd08ff31-3b68-4c9f-90c7-df991c3df6a0 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.061258 Feb 12 21:23:14.872480 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2402/4946] 10.222.0.31 () {58 vars in 1139 bytes} [Sat Feb 12 21:23:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:14.883561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ca0698d-5e0a-437a-8650-e51f15eaa410 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe551790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:14.921202 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ca0698d-5e0a-437a-8650-e51f15eaa410 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.041433 Feb 12 21:23:14.922310 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2403/4947] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:14 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:14.946844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:14.958762 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65ef14a0-3cbd-4fcd-81fd-29613e08b435 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.311837 Feb 12 21:23:14.959721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2545/4948] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:14 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:15.481198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:15.482171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:15.492775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:15.493498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:15.494485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:15.494930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:15.934180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-771ce7b7-9cba-4ab5-9fe6-90bdb93fd6e5 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe92d670>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:16.001850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-771ce7b7-9cba-4ab5-9fe6-90bdb93fd6e5 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.070432 Feb 12 21:23:16.003712 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2546/4949] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:15 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:16.008709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:16.009336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:16.023496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:16.027306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:16.027306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:16.027306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:16.124130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:16.140612 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57133ca1-576a-4439-8493-ef42e8f0dbb3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1266 microversion: 2.1 time: 0.664253 Feb 12 21:23:16.141218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2404/4950] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:15 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1266 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:16.396475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:16.411552 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cec12d0b-01c3-4c95-90ac-5bbd4902c763 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.406341 Feb 12 21:23:16.415478 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2547/4951] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:16 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:17.016205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e013aa69-7e65-431b-b770-634c6d65d608 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fd36e820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:17.069206 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e013aa69-7e65-431b-b770-634c6d65d608 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.057287 Feb 12 21:23:17.073414 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2405/4952] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:17 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:17.158027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:17.159358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:17.173645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:17.175642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:17.176666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:17.177461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:17.320928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:17.331900 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1890bbdf-5873-4817-92d1-61599479e1e3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1272 microversion: 2.1 time: 0.177626 Feb 12 21:23:17.332862 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2548/4953] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:17 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:17.434031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:17.437690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:17.455983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:17.460819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:17.460819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:17.460819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:17.847698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1d5fd8c9-c2a8-4411-b947-64f81d757bc7 req-00e8fa70-4a31-4d9f-8042-9c9ba1785fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0039e4f0-8954-4956-88f8-0e7da9b04f05", "name": "network-vif-plugged", "status": "completed", "tag": "35690731-24a6-462a-972e-d7eb40390ef6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:17.852659 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:17.852659 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:23:17.872793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1d5fd8c9-c2a8-4411-b947-64f81d757bc7 req-00e8fa70-4a31-4d9f-8042-9c9ba1785fff service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:17.878300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1d5fd8c9-c2a8-4411-b947-64f81d757bc7 req-00e8fa70-4a31-4d9f-8042-9c9ba1785fff service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:17.896747 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1d5fd8c9-c2a8-4411-b947-64f81d757bc7 req-00e8fa70-4a31-4d9f-8042-9c9ba1785fff service nova] Creating event network-vif-plugged:35690731-24a6-462a-972e-d7eb40390ef6 for instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 on nch1-master-1 Feb 12 21:23:17.902964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1d5fd8c9-c2a8-4411-b947-64f81d757bc7 req-00e8fa70-4a31-4d9f-8042-9c9ba1785fff service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313431 Feb 12 21:23:17.904100 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2549/4954] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:17.956538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:17.965133 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55c93ad1-0cc9-4eff-81d7-310744ac8873 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.535262 Feb 12 21:23:17.968341 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2406/4955] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:17 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:18.089904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58bd899e-31bc-4629-9eee-88dc4b9fa675 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8feaef1f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:18.165939 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58bd899e-31bc-4629-9eee-88dc4b9fa675 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.087917 Feb 12 21:23:18.168156 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2550/4956] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:18 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:18.355891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:18.357393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:18.367051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:18.367763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:18.369421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:18.370035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:18.857619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:18.870813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70290b3f-0a1c-4a77-b54b-68776edd826b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.518675 Feb 12 21:23:18.871646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2407/4957] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:18 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:18.985025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:18.991303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:18.995241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:18.995714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:18.996530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:18.996975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:19.157522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:19.169004 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee05ed4c-865c-4445-b6f0-287dcd1b7440 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1361 microversion: 2.1 time: 0.188490 Feb 12 21:23:19.169666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2551/4958] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:18 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:19.179620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c7023ca-02bf-4dc9-a299-b0c3d35b2661 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe551790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:19.220855 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c7023ca-02bf-4dc9-a299-b0c3d35b2661 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.044952 Feb 12 21:23:19.221459 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2408/4959] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:19 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:19.888316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:19.889221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:19.898386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:19.899132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:19.900250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:19.900908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:20.113885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:20.124548 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6ab9551-0637-47a1-b89b-c44befdf7e63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.239752 Feb 12 21:23:20.125905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2552/4960] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:19 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:20.188867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d43b1b7b-c86b-40a3-94d2-87a47db4c487 req-58e3e711-c072-420f-a864-484ad7b29a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d7cfd2-6923-4882-bbbe-97069905bcba", "tag": "6c240f75-9cf6-4ab7-9416-73a6c32cc739"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:20.189349 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:20.189349 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:23:20.194263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:20.195444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:20.206217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:20.210829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:20.210829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:20.210829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:20.215232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d43b1b7b-c86b-40a3-94d2-87a47db4c487 req-58e3e711-c072-420f-a864-484ad7b29a88 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:20.218997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d43b1b7b-c86b-40a3-94d2-87a47db4c487 req-58e3e711-c072-420f-a864-484ad7b29a88 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:20.251361 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d43b1b7b-c86b-40a3-94d2-87a47db4c487 req-58e3e711-c072-420f-a864-484ad7b29a88 service nova] Creating event network-changed:6c240f75-9cf6-4ab7-9416-73a6c32cc739 for instance 93d7cfd2-6923-4882-bbbe-97069905bcba on nch2-master-1 Feb 12 21:23:20.258516 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d43b1b7b-c86b-40a3-94d2-87a47db4c487 req-58e3e711-c072-420f-a864-484ad7b29a88 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075584 Feb 12 21:23:20.261265 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2409/4961] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:20.273525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8d12dc75-4ff2-476d-bde4-fda0a2913af7 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdeaa790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:20.355079 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8d12dc75-4ff2-476d-bde4-fda0a2913af7 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.086050 Feb 12 21:23:20.360482 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2410/4962] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:20 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:20.491878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:20.506790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e8ae7dd1-73a0-48a4-b7d2-6c9327a05194 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1548 microversion: 2.1 time: 0.316203 Feb 12 21:23:20.507645 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2553/4963] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:20 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1548 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:20.560165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:20.560165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:20.583128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:20.583694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:20.588258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:20.588758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:20.956145 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85ce5052-d470-4a20-8d87-d79e4464ce74 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.412405 Feb 12 21:23:20.959709 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2411/4964] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:23:20 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-interface => generated 285 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:21.144871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:21.145783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:21.156085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:21.160478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:21.161954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:21.162738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:21.373867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96ca38d8-feff-4e21-b07d-66a32a3380f6 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdeaa9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:21.379096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:21.395661 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-12e5ae6c-3b18-44c7-bd74-4c933ac6a687 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.257700 Feb 12 21:23:21.399066 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2554/4965] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:21 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:21.409145 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96ca38d8-feff-4e21-b07d-66a32a3380f6 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.039294 Feb 12 21:23:21.410010 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2412/4966] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:21 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:22.420244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:22.422480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:22.423183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e1e97372-dbff-4413-9eb1-43ee4cc1dd74 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa908045700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:22.455992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:22.456458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:22.458961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:22.466704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:22.490906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e1e97372-dbff-4413-9eb1-43ee4cc1dd74 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.072921 Feb 12 21:23:22.495936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2413/4967] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:22 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:22.871793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:22.883914 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-24ffa06d-0f24-41ed-917d-ba175208c6f9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.471905 Feb 12 21:23:22.886146 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2555/4968] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:22 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:23.508214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aff0a5d1-1ea8-46f2-837c-3b607545ac7d tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa908045b80>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:23.560129 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aff0a5d1-1ea8-46f2-837c-3b607545ac7d tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 288 microversion: 2.1 time: 0.059915 Feb 12 21:23:23.561769 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2414/4969] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:23 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 288 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:23.587869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe9e9dc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:23.786754 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-727cecd9-f84a-40f9-89ff-c53e0805f7d7 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 202 len: 0 microversion: 2.1 time: 0.217551 Feb 12 21:23:23.788469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2556/4970] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 21:23:23 2022] DELETE /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:23.798982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-863684f4-b498-45e3-8f84-e9d9ab34f69e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa90428e9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:23.846288 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-863684f4-b498-45e3-8f84-e9d9ab34f69e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.053024 Feb 12 21:23:23.846592 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2415/4971] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:23 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:23.907267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:23.914021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:23.938964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:23.941950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:23.956041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:23.961462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:24.343932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:24.356258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:24.356704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:24.363718 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-20a1e1bb-7950-4fdd-89b2-ed97e337a970 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.464307 Feb 12 21:23:24.369264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:24.369750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:24.370554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:24.370997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:24.380757 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2557/4972] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:23 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:24.387048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-62a30386-ac01-4aab-a97d-999b9cc0e866 req-1ab29b63-65a1-45c8-bb7b-d314ef74f501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0039e4f0-8954-4956-88f8-0e7da9b04f05", "tag": "35690731-24a6-462a-972e-d7eb40390ef6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:24.388879 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:24.388879 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:23:24.409294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-62a30386-ac01-4aab-a97d-999b9cc0e866 req-1ab29b63-65a1-45c8-bb7b-d314ef74f501 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:24.409769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-62a30386-ac01-4aab-a97d-999b9cc0e866 req-1ab29b63-65a1-45c8-bb7b-d314ef74f501 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:24.430682 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-62a30386-ac01-4aab-a97d-999b9cc0e866 req-1ab29b63-65a1-45c8-bb7b-d314ef74f501 service nova] Creating event network-changed:35690731-24a6-462a-972e-d7eb40390ef6 for instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 on nch1-master-1 Feb 12 21:23:24.436980 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4f62a37-82dc-4d98-92d2-ee723948a2b8 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/ips" status: 200 len: 107 microversion: 2.1 time: 0.084396 Feb 12 21:23:24.443118 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2416/4973] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:23:24 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/ips => generated 107 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:24.446871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-62a30386-ac01-4aab-a97d-999b9cc0e866 req-1ab29b63-65a1-45c8-bb7b-d314ef74f501 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064688 Feb 12 21:23:24.451302 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2558/4974] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:24.862768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04afd790-676d-4d5c-8883-f05c50246c65 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdeaaa60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:24.968817 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04afd790-676d-4d5c-8883-f05c50246c65 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.110094 Feb 12 21:23:24.973608 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2417/4975] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:24 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:25.385506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:25.385506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:25.399791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:25.400354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:25.401836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:25.409628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:25.686818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:25.725665 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e2800ca-a322-40f9-917f-e285f705ad1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.346079 Feb 12 21:23:25.745468 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2559/4976] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:25 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:25.981507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-69408c67-cdb4-4cde-ad04-afaca690ed1e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa907fe2ee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:26.051067 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-69408c67-cdb4-4cde-ad04-afaca690ed1e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.074407 Feb 12 21:23:26.053805 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2418/4977] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:25 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:26.760459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:26.761748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:26.772574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:26.773042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:26.773877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:26.774401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:27.042892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:27.056983 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-51335cb0-c8bb-4f78-b9cc-ab629a6ef9a8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.310893 Feb 12 21:23:27.058968 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2560/4978] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:26 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:27.066068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a47a96f-41dc-4c4b-93cc-87927d419ca1 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe6f3dc0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:27.103894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a47a96f-41dc-4c4b-93cc-87927d419ca1 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.043165 Feb 12 21:23:27.104644 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2419/4979] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:27 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:27.509558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd3ab2d-19da-4502-a2c8-54bdbfdda994"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:27.512856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:27.525269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:27.525775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:27.526603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:27.527049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:28.081766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:28.083183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:28.090765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:28.091410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:28.092250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:28.092692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:28.310084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:28.318330 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d97ad4cb-e220-45d8-a78d-92ee7454d34b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.247606 Feb 12 21:23:28.331204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2420/4980] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:28 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:28.337310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9e87c73d-62f1-4598-836f-5529e0298aec tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe1b6820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:28.413540 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9e87c73d-62f1-4598-836f-5529e0298aec tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.080826 Feb 12 21:23:28.414191 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2421/4981] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:28 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:28.578707 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-25431f0e-b083-4a5b-a3ec-627fbdd2350b tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.072717 Feb 12 21:23:28.586315 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2561/4982] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:23:27 2022] POST /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:29.280138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7ae1575a-5295-4474-bc26-2e3e7835b3c8 req-b9ca2287-a646-4398-8e05-777978ab2933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d7cfd2-6923-4882-bbbe-97069905bcba", "name": "network-vif-plugged", "status": "completed", "tag": "6c240f75-9cf6-4ab7-9416-73a6c32cc739"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:29.282627 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:29.282627 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:23:29.298786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ae1575a-5295-4474-bc26-2e3e7835b3c8 req-b9ca2287-a646-4398-8e05-777978ab2933 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:29.300563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ae1575a-5295-4474-bc26-2e3e7835b3c8 req-b9ca2287-a646-4398-8e05-777978ab2933 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:29.327479 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7ae1575a-5295-4474-bc26-2e3e7835b3c8 req-b9ca2287-a646-4398-8e05-777978ab2933 service nova] Creating event network-vif-plugged:6c240f75-9cf6-4ab7-9416-73a6c32cc739 for instance 93d7cfd2-6923-4882-bbbe-97069905bcba on nch2-master-1 Feb 12 21:23:29.335237 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7ae1575a-5295-4474-bc26-2e3e7835b3c8 req-b9ca2287-a646-4398-8e05-777978ab2933 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059181 Feb 12 21:23:29.337774 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2422/4983] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:29.338199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:29.338927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:29.361895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:29.363114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:29.364239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:29.364793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:29.427497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a493f7d-aba9-4948-bf91-1f8e1f311b31 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fd36e820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:29.492639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a493f7d-aba9-4948-bf91-1f8e1f311b31 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 200 len: 287 microversion: 2.1 time: 0.070071 Feb 12 21:23:29.493476 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2423/4984] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:29 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:29.604392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:29.613305 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-636deb22-51c3-4348-902b-cc52193c0b38 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.280955 Feb 12 21:23:29.615092 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2562/4985] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:29 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:30.510598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b027749f-9eac-46a2-87d2-ea95fbde0500 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe1b6ca0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:30.567365 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b027749f-9eac-46a2-87d2-ea95fbde0500 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] HTTP exception thrown: Snapshot 5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab could not be found. Feb 12 21:23:30.567992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b027749f-9eac-46a2-87d2-ea95fbde0500 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Returning 404 to user: Snapshot 5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:23:30.568849 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b027749f-9eac-46a2-87d2-ea95fbde0500 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab" status: 404 len: 111 microversion: 2.1 time: 0.068300 Feb 12 21:23:30.570204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2424/4986] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 21:23:30 2022] GET /compute/v2.1/os-snapshots/5c6f3be1-fbfb-44ee-abfc-ec05cc94c0ab => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:23:30.582359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b35ef887-f124-4d79-9b1b-784e1a777903 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe9e9dc0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:30.633677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:30.634278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:30.642056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:30.643251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:30.669345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:30.669853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:30.971014 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b35ef887-f124-4d79-9b1b-784e1a777903 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 202 len: 0 microversion: 2.1 time: 0.394671 Feb 12 21:23:30.973524 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2563/4987] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:23:30 2022] DELETE /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:30.990110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6655392-3613-4feb-bc3e-430f87c08483 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdf6c5e0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:31.091977 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6655392-3613-4feb-bc3e-430f87c08483 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.114392 Feb 12 21:23:31.092684 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2564/4988] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:30 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:31.152479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:31.160424 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ed8a633-6938-40cc-ad30-972e4eb0f281 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1314 microversion: 2.1 time: 0.530897 Feb 12 21:23:31.161017 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2425/4989] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:30 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:32.107333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81c5513b-840a-45bf-91e7-b85308e8ff31 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fde1d3a0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:32.182534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:32.183215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:32.199923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:32.200406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:32.201246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:32.201784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:32.247189 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81c5513b-840a-45bf-91e7-b85308e8ff31 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.146573 Feb 12 21:23:32.247861 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2565/4990] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:32 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:32.432197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:32.440994 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-650d0960-14ab-40e4-b03d-44558e1e9795 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1500 microversion: 2.1 time: 0.267297 Feb 12 21:23:32.441659 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2426/4991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:32 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1500 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:32.467193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:32.468610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:32.478727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:32.479411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:32.480593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:32.481214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:32.820883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.network.security_group_api [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Removing security group ee4da649-b0ba-4234-a2a7-29cdf6c33b3d from port 6c240f75-9cf6-4ab7-9416-73a6c32cc739 Feb 12 21:23:33.261827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1baefb26-126d-4520-b4c0-ae73d8f5f8c9 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fd2ed1f0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:33.335081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1baefb26-126d-4520-b4c0-ae73d8f5f8c9 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.077762 Feb 12 21:23:33.336550 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2427/4992] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:33 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:33.844701 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab314440-3b46-49e9-8479-e881014ec1be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba/action" status: 202 len: 0 microversion: 2.1 time: 1.383493 Feb 12 21:23:33.846353 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2566/4993] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:23:32 2022] POST /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba/action => generated 0 bytes in 1386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:33.854539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:33.855183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:33.866765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:33.867234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:33.868073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:33.868528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.285683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:34.295923 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f61a134e-4e0a-4e8f-946d-fc45e2fd0ad3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1458 microversion: 2.1 time: 0.443942 Feb 12 21:23:34.299343 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2428/4994] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:33 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1458 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:34.314533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:34.317334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:34.343752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.346319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.365065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.366711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.450598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7879f66b-dc75-46ce-8681-e00020f57fe4 req-7f9c062c-c61d-4d8e-98f7-ee1024270f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d7cfd2-6923-4882-bbbe-97069905bcba", "tag": "6c240f75-9cf6-4ab7-9416-73a6c32cc739"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:34.452186 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:34.452186 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:23:34.461302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7879f66b-dc75-46ce-8681-e00020f57fe4 req-7f9c062c-c61d-4d8e-98f7-ee1024270f9b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.462090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7879f66b-dc75-46ce-8681-e00020f57fe4 req-7f9c062c-c61d-4d8e-98f7-ee1024270f9b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.482405 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7879f66b-dc75-46ce-8681-e00020f57fe4 req-7f9c062c-c61d-4d8e-98f7-ee1024270f9b service nova] Creating event network-changed:6c240f75-9cf6-4ab7-9416-73a6c32cc739 for instance 93d7cfd2-6923-4882-bbbe-97069905bcba on nch2-master-1 Feb 12 21:23:34.487509 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7879f66b-dc75-46ce-8681-e00020f57fe4 req-7f9c062c-c61d-4d8e-98f7-ee1024270f9b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583165 Feb 12 21:23:34.488427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2567/4995] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:34.515351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9d7372d-1154-4836-a477-38e68d516912 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdf294c0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:34.603157 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9d7372d-1154-4836-a477-38e68d516912 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.113181 Feb 12 21:23:34.603805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2568/4996] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:34 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:34.608377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:34.609636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:34.616486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.618911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.618911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.618911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.663224 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4fe8409b-7bc0-4148-ab63-96634d6fd98d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058255 Feb 12 21:23:34.663761 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2569/4997] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:23:34 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:34.675880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:34.676593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:34.683815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.684556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.685522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:34.686214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:34.728805 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5ae6540-0ff4-4557-8b4f-e7a9c9649f07 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/5fd3ab2d-19da-4502-a2c8-54bdbfdda994" status: 200 len: 194 microversion: 2.1 time: 0.058964 Feb 12 21:23:34.730169 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2570/4998] 10.222.0.31 () {58 vars in 1412 bytes} [Sat Feb 12 21:23:34 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/5fd3ab2d-19da-4502-a2c8-54bdbfdda994 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:35.361280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:35.383954 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc49131b-be22-4b38-bed4-2b2885696e7b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 1.074030 Feb 12 21:23:35.384985 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2429/4999] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:34 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:35.425951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:35.428421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:35.444402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:35.445684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:35.449007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:35.450381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:35.616765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6bc84ac-c59b-4729-bed9-93e920593c14 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fd2f6040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:35.708798 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b6bc84ac-c59b-4729-bed9-93e920593c14 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.094769 Feb 12 21:23:35.715502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2430/5000] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:35 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:35.852411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:35.862217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-048852fb-c76f-4234-865e-05eb7d5b53c8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.444124 Feb 12 21:23:35.864343 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2571/5001] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:35.879147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:35.879769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:35.894648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:35.895116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:35.895944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:35.896394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:36.247356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:36.255542 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-21602363-b96e-43e2-89be-a8068bf29c24 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.380829 Feb 12 21:23:36.256204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2431/5002] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:36.273122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:36.273914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:36.280095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:36.280558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:36.281377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:36.281824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:36.453063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:36.468672 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3f323789-8b3d-4186-b211-14bbcaa4fb63 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.198001 Feb 12 21:23:36.469547 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2572/5003] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:36 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:36.661890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-80884723", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2d2fb25f-a576-44b7-8aec-e44f4519d495"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:36.724051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a949d18b-d764-4dee-9c8a-720e0f04c25a tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fde1d430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:36.805827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] validate_networks() for [('2d2fb25f-a576-44b7-8aec-e44f4519d495', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:23:36.811265 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a949d18b-d764-4dee-9c8a-720e0f04c25a tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.092208 Feb 12 21:23:36.811855 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2573/5004] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:36 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:37.287006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:23:37.287442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:23:37.287924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:23:37.288690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:23:37.288783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:23:37.311771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:37.313153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:37.314902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:37.321202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:37.373688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:23:37.391070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Getting quotas for user 5b461f428c844982ac3fa24b0f80dc08 and project 63fc5569c8334523aa6dff77b1d79015. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:23:37.418362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:23:37.423036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:23:37.604857 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ce8c3bfb-4b83-47bc-b058-68efe986096c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945271 Feb 12 21:23:37.608762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2432/5005] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:23:37.617944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8709a470-c180-4af5-8c33-dd763514dc4e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:37.618646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8709a470-c180-4af5-8c33-dd763514dc4e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:37.817180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8709a470-c180-4af5-8c33-dd763514dc4e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:37.824987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9667d79-0328-4d47-bdf9-4b0013f1dcb4 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa9042b79d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:37.825798 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8709a470-c180-4af5-8c33-dd763514dc4e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1213 microversion: 2.1 time: 0.212891 Feb 12 21:23:37.826604 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2574/5006] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:37 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1213 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:37.900022 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9667d79-0328-4d47-bdf9-4b0013f1dcb4 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.073815 Feb 12 21:23:37.900022 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2433/5007] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:37 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:38.843578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:38.844737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:38.864432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:38.866492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:38.866492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:38.868191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:38.907317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f579da3-bf40-42e9-a5f3-db6b9f5d7e96 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fdeaa9d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:38.997058 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f579da3-bf40-42e9-a5f3-db6b9f5d7e96 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.094218 Feb 12 21:23:38.997867 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2434/5008] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:38 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:39.100686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:39.108932 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d06c606-20fb-4e65-a5c0-b016ed7a3de3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1217 microversion: 2.1 time: 0.269626 Feb 12 21:23:39.110099 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2575/5009] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:38 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1217 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:40.011147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c9a23ae-7972-4b2a-8c5d-56386f165c0b tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fd2f6310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:40.080138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c9a23ae-7972-4b2a-8c5d-56386f165c0b tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.072859 Feb 12 21:23:40.082635 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2435/5010] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:40 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:40.129574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:40.130003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:40.138905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:40.139614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:40.140912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:40.141538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:40.229587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:40.240224 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b267f68f-d351-427d-8f23-4d435409473e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1265 microversion: 2.1 time: 0.116817 Feb 12 21:23:40.250711 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2576/5011] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:40 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:41.102650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b4fd4c9-a891-4cee-a19d-d1e3be68be8c tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa908045700>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:41.168006 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b4fd4c9-a891-4cee-a19d-d1e3be68be8c tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.067619 Feb 12 21:23:41.168006 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2436/5012] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:41 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:41.259721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:41.261008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:41.270537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:41.271926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:41.273441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:41.274703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:41.352889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:41.363792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a58a226-e27a-4143-9f60-7fe545149e3f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1271 microversion: 2.1 time: 0.109612 Feb 12 21:23:41.365395 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2577/5013] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:41 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:42.185180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-33f91cff-35c5-4f13-95bb-40243a729536 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fd2f6310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:42.279567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-33f91cff-35c5-4f13-95bb-40243a729536 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 200 len: 337 microversion: 2.1 time: 0.104686 Feb 12 21:23:42.280455 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2437/5014] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:42 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:42.384297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:42.384968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:42.396981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:42.397507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:42.398667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:42.399425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:42.653033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:42.662311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee1f736e-e97c-4d8a-aef9-cae18565ce50 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.281955 Feb 12 21:23:42.663236 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2578/5015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:42 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:43.233691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbcb87d0-7039-4000-860e-900ca1b07f9d"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:43.234778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:43.243013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:43.243478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:43.244293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:43.244736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:43.292814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e0a7019-bd24-467a-afad-c20153bd85ac tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fe1641f0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:43.377805 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8e0a7019-bd24-467a-afad-c20153bd85ac tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] HTTP exception thrown: Volume 132dabd2-a864-4525-9a31-66d563ade93d could not be found. Feb 12 21:23:43.379371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e0a7019-bd24-467a-afad-c20153bd85ac tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Returning 404 to user: Volume 132dabd2-a864-4525-9a31-66d563ade93d could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:23:43.381577 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e0a7019-bd24-467a-afad-c20153bd85ac tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 404 len: 109 microversion: 2.1 time: 0.092621 Feb 12 21:23:43.382734 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2579/5016] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:43 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:23:43.397595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c673dc3-30ff-49f2-b8f1-b5df8e967a7e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa8fde1dd30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:43.442297 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9c673dc3-30ff-49f2-b8f1-b5df8e967a7e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] HTTP exception thrown: Volume 132dabd2-a864-4525-9a31-66d563ade93d could not be found. Feb 12 21:23:43.442297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c673dc3-30ff-49f2-b8f1-b5df8e967a7e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Returning 404 to user: Volume 132dabd2-a864-4525-9a31-66d563ade93d could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:23:43.442297 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c673dc3-30ff-49f2-b8f1-b5df8e967a7e tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 404 len: 109 microversion: 2.1 time: 0.053134 Feb 12 21:23:43.443831 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2580/5017] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:23:43 2022] DELETE /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:23:43.451585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89469397-9e47-43bc-bb19-c62fd4b960e6 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Calling method '.version_select at 0x7fa904feaca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:43.479593 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-89469397-9e47-43bc-bb19-c62fd4b960e6 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] HTTP exception thrown: Volume 132dabd2-a864-4525-9a31-66d563ade93d could not be found. Feb 12 21:23:43.480275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89469397-9e47-43bc-bb19-c62fd4b960e6 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] Returning 404 to user: Volume 132dabd2-a864-4525-9a31-66d563ade93d could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:23:43.482037 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89469397-9e47-43bc-bb19-c62fd4b960e6 tempest-VolumesSnapshotsTestJSON-342743143 tempest-VolumesSnapshotsTestJSON-342743143-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d" status: 404 len: 109 microversion: 2.1 time: 0.033682 Feb 12 21:23:43.482680 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2581/5018] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:43 2022] GET /compute/v2.1/os-volumes/132dabd2-a864-4525-9a31-66d563ade93d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:23:43.682994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:43.683597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:43.690831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:43.691290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:43.692085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:43.692519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:43.872768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:43.884092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8f88d50f-fbef-4262-b3dd-9dda0376fa11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.205391 Feb 12 21:23:43.884898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2582/5019] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:43 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:43.891293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-54871f09-2849-4af5-887a-c5fff79cbb8b req-f0bbbdb6-3244-472b-9afd-6718b1aff920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955f9962-b43e-40fa-af91-d85da806dad0", "tag": "7e592411-155b-4647-a7b6-b5174ceee7ec"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:43.892053 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:43.892053 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:23:43.899771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-54871f09-2849-4af5-887a-c5fff79cbb8b req-f0bbbdb6-3244-472b-9afd-6718b1aff920 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:43.900513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-54871f09-2849-4af5-887a-c5fff79cbb8b req-f0bbbdb6-3244-472b-9afd-6718b1aff920 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:43.912850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-54871f09-2849-4af5-887a-c5fff79cbb8b req-f0bbbdb6-3244-472b-9afd-6718b1aff920 service nova] Creating event network-changed:7e592411-155b-4647-a7b6-b5174ceee7ec for instance 955f9962-b43e-40fa-af91-d85da806dad0 on nch1-master-1 Feb 12 21:23:43.918372 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-54871f09-2849-4af5-887a-c5fff79cbb8b req-f0bbbdb6-3244-472b-9afd-6718b1aff920 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Feb 12 21:23:43.919006 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2583/5020] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:44.421188 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fcc9dddf-942a-4a84-b6b5-539ce04f249e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "POST /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.192342 Feb 12 21:23:44.421839 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2438/5021] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:23:43 2022] POST /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments => generated 194 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:44.911934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:44.912771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:44.922116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:44.922895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:44.924391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:44.925108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:45.104489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:45.115456 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b777204-c5b8-4d99-b47c-8384acf3103d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.211010 Feb 12 21:23:45.116583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2584/5022] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:44 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:46.132728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:46.138677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:46.143563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:46.144028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:46.144914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:46.145397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:46.380942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:46.380942 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-06370aee-9c4d-4671-9bf3-b4d10554f718 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.249006 Feb 12 21:23:46.380942 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2439/5023] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:46 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:47.405260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:47.406235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:47.414998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:47.421024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:47.423061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:47.425616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:47.495618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Action: 'create', calling method: .version_select at 0x7fa8fde1d3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-279508129", "metadata": {"Type": "work"}}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:47.620079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:47.629094 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1eb0cbe1-0911-47d3-9e82-d14e769f0880 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.230309 Feb 12 21:23:47.633394 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2440/5024] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:47 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:48.388963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d09bb6b-60d3-42c9-8289-86a4ccab9bc1 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.106418 Feb 12 21:23:48.389783 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2585/5025] 10.222.0.31 () {60 vars in 1155 bytes} [Sat Feb 12 21:23:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1108 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 12 21:23:48.402770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93b673bb-c497-4899-a03f-00a8f949d82b tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa904075310>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:48.475971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93b673bb-c497-4899-a03f-00a8f949d82b tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.077807 Feb 12 21:23:48.476591 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2441/5026] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:48 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:48.647868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:48.648485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:48.656879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:48.657345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:48.659554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:48.664371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:48.948272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:48.969180 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-203ea628-879c-4310-8bf1-30ab8f519716 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.324805 Feb 12 21:23:48.975849 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2586/5027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:48 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:49.495948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-036ce912-ba89-4818-837f-7be4e2c550b8 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe1ea670>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:49.560943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-036ce912-ba89-4818-837f-7be4e2c550b8 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.076599 Feb 12 21:23:49.561583 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2442/5028] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:49 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:49.990342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:49.991097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:50.010826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:50.010826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:50.010826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:50.010826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:50.303159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Calling method '.version_select at 0x7fa9042b7c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:50.304082 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:50.304082 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:23:50.305675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:50.306140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:50.329231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:50.330655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:50.343252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:50.343970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:50.354702 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d5b4282-1d13-435c-9fa3-ba079ab4957c tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1035025693-project-admin] 10.222.0.31 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.230891 Feb 12 21:23:50.355628 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2443/5029] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:23:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:50.364893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-dea0b6e1-12d4-4584-b85c-8f0a9f9d3add req-11bc7d1b-0947-4773-b49a-c26085681598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955f9962-b43e-40fa-af91-d85da806dad0", "name": "network-vif-plugged", "status": "completed", "tag": "7e592411-155b-4647-a7b6-b5174ceee7ec"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:50.374722 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:23:50.374722 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:23:50.387328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-dea0b6e1-12d4-4584-b85c-8f0a9f9d3add req-11bc7d1b-0947-4773-b49a-c26085681598 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:50.388592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-dea0b6e1-12d4-4584-b85c-8f0a9f9d3add req-11bc7d1b-0947-4773-b49a-c26085681598 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:50.389051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:50.408308 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b811687c-c60d-4f7c-85a9-b6997a88e410 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.424417 Feb 12 21:23:50.408537 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-dea0b6e1-12d4-4584-b85c-8f0a9f9d3add req-11bc7d1b-0947-4773-b49a-c26085681598 service nova] Creating event network-vif-plugged:7e592411-155b-4647-a7b6-b5174ceee7ec for instance 955f9962-b43e-40fa-af91-d85da806dad0 on nch1-master-1 Feb 12 21:23:50.408928 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2587/5030] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:49 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:50.415048 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-dea0b6e1-12d4-4584-b85c-8f0a9f9d3add req-11bc7d1b-0947-4773-b49a-c26085681598 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054204 Feb 12 21:23:50.417696 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2444/5031] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:50.573522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-15f30f03-b38b-48cf-b4a8-a098656842c7 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fdf29a60>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:50.684306 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-15f30f03-b38b-48cf-b4a8-a098656842c7 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 346 microversion: 2.1 time: 0.114452 Feb 12 21:23:50.684876 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2588/5032] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:50 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:50.697581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-94e61d7e-102e-491d-9ab1-1910a9d681f2 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe29ad30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:50.763867 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-94e61d7e-102e-491d-9ab1-1910a9d681f2 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 346 microversion: 2.1 time: 0.071138 Feb 12 21:23:50.764956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2445/5033] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:50 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:50.776753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c28757f-4dc3-41f5-989c-4d451dccbc02 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fdf29af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:51.068950 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c28757f-4dc3-41f5-989c-4d451dccbc02 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 202 len: 0 microversion: 2.1 time: 0.295065 Feb 12 21:23:51.070232 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2589/5034] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:23:50 2022] DELETE /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:51.080461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-098e1df0-c072-4f85-bb51-3f3324063b40 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe651820>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:51.136198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-098e1df0-c072-4f85-bb51-3f3324063b40 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.061095 Feb 12 21:23:51.136771 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2446/5035] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:51 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:51.427111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:51.428486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:51.438114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:51.439481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:51.440670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:51.441537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:51.604717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:51.613806 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f3fbdf16-cec9-49c3-9cc9-566c121a19dc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1313 microversion: 2.1 time: 0.191213 Feb 12 21:23:51.614717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2590/5036] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:51 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:52.150977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a4e53d6-46d7-4b6f-bd8f-4ca2b07d37b6 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fd347040>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:52.235015 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a4e53d6-46d7-4b6f-bd8f-4ca2b07d37b6 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.089708 Feb 12 21:23:52.235933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2447/5037] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:52 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:52.631707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:52.636552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:52.640249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:52.640710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:52.641542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:52.642773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:52.855176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:52.866362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-818692d9-3319-45ae-a2ef-f4872f3dcdc6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1499 microversion: 2.1 time: 0.238554 Feb 12 21:23:52.868130 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2591/5038] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:52 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:52.885596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:52.886618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:52.894956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:52.895710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:52.896774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:52.897407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:53.211820 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7bd18e7-cdfb-41ae-a931-5c0e7f770816 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0/action" status: 202 len: 0 microversion: 2.1 time: 0.330211 Feb 12 21:23:53.214278 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2448/5039] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:23:52 2022] POST /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:53.228376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:53.229230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:53.243953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:53.244860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:53.245909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:53.247196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:53.254763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8cf663e5-4614-46ce-8eff-137624291d8d tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa904529430>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:53.319464 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8cf663e5-4614-46ce-8eff-137624291d8d tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.075029 Feb 12 21:23:53.320271 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2449/5040] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:53 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:53.709683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:53.721759 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea38170d-4421-427a-99ab-f9f5db0a28ea tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1504 microversion: 2.1 time: 0.502961 Feb 12 21:23:53.722368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2592/5041] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:53 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:54.333185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fa9a249-51db-47b0-b511-480f77798785 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe1ea0d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:54.452708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fa9a249-51db-47b0-b511-480f77798785 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.124388 Feb 12 21:23:54.453440 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2450/5042] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:54 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:54.739932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:54.740636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:54.760245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:54.760866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:54.762532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:54.764553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:55.467310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-088a75f8-3cd1-41cf-ae52-3d03f91f2d60 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe1b6af0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:55.557144 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-088a75f8-3cd1-41cf-ae52-3d03f91f2d60 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.095439 Feb 12 21:23:55.557988 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2451/5043] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:55 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:55.565033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:55.566348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:55.575812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:55.581802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:55.581802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:55.581802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:55.636140 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7463bffe-8174-4f0a-abe0-82813633cd6a tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.075067 Feb 12 21:23:55.637392 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2452/5044] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:23:55 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:55.735917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:55.748758 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e03e3a6-b279-4365-833b-8c6dc3e3d5cf tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1484 microversion: 2.1 time: 1.013315 Feb 12 21:23:55.751842 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2593/5045] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:54 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1484 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:55.779977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:23:55.780978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:55.793279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:55.794456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:55.795815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:55.796739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:55.869418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lazy-loading 'flavor' on Instance uuid 955f9962-b43e-40fa-af91-d85da806dad0 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:23:55.978823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:55.979589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:56.000550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:56.000550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:56.001296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:56.002622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:56.078599 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f968e9ad-f653-438b-b850-b66f29cfb55f tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/5fd3ab2d-19da-4502-a2c8-54bdbfdda994" status: 200 len: 194 microversion: 2.1 time: 0.104036 Feb 12 21:23:56.082814 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2594/5046] 10.222.0.31 () {58 vars in 1412 bytes} [Sat Feb 12 21:23:55 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/5fd3ab2d-19da-4502-a2c8-54bdbfdda994 => generated 194 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:23:56.096455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:56.098105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:56.135850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:56.136799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:56.137087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:56.137579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:56.292620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lazy-loading 'services' on Instance uuid 0039e4f0-8954-4956-88f8-0e7da9b04f05 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:23:56.655936 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6448b2a7-95e7-4133-88a9-6ade32df5525 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/5fd3ab2d-19da-4502-a2c8-54bdbfdda994" status: 202 len: 0 microversion: 2.1 time: 0.566760 Feb 12 21:23:56.660087 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2595/5047] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:23:56 2022] DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/5fd3ab2d-19da-4502-a2c8-54bdbfdda994 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:56.674821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44339d5d-018b-4c4e-b4d4-139db36e6d7d tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe901c10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:56.799385 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44339d5d-018b-4c4e-b4d4-139db36e6d7d tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.136895 Feb 12 21:23:56.801559 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2596/5048] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:56 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:56.868469 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4c53241-9e4e-43a0-8fba-b1f7cc74dcde tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0/action" status: 202 len: 0 microversion: 2.1 time: 1.101106 Feb 12 21:23:56.875809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2453/5049] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:23:55 2022] POST /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0/action => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:56.878299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:56.884861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:56.890811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:56.891268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:56.903508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:56.905763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:57.491509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:57.503462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-65a6db32-0479-49fe-81aa-a9ca594d0474 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1490 microversion: 2.1 time: 0.629294 Feb 12 21:23:57.517934 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2597/5050] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:56 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1490 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:23:57.826800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6ed3cb61-7c1d-40d7-a73a-60d0d4385513 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa908045af0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:57.891260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:57.904007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:57.912277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:57.913009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:57.914101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:57.914636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:57.934454 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6ed3cb61-7c1d-40d7-a73a-60d0d4385513 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.123643 Feb 12 21:23:57.935187 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2454/5051] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:57 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:57.956868 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4fb49c49-6707-448c-a434-a2fe77bc4e63 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/dbcb87d0-7039-4000-860e-900ca1b07f9d" status: 200 len: 194 microversion: 2.1 time: 0.069803 Feb 12 21:23:57.963155 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2598/5052] 10.222.0.31 () {58 vars in 1412 bytes} [Sat Feb 12 21:23:57 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/dbcb87d0-7039-4000-860e-900ca1b07f9d => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:57.968743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:57.969393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:57.994967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:57.994967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:57.994967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:57.995591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:58.093784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lazy-loading 'services' on Instance uuid 0039e4f0-8954-4956-88f8-0e7da9b04f05 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:23:58.374325 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-87b3fe3f-414b-4a1a-a9c7-560d929426a9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/dbcb87d0-7039-4000-860e-900ca1b07f9d" status: 202 len: 0 microversion: 2.1 time: 0.409218 Feb 12 21:23:58.375093 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2455/5053] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:23:57 2022] DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments/dbcb87d0-7039-4000-860e-900ca1b07f9d => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:23:58.523004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:58.523938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:58.536072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:58.536816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:58.537933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:58.538460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:58.936639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:23:58.947391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-24fbca84-ca91-4e38-835f-9fdb5be221eb tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1511 microversion: 2.1 time: 0.428712 Feb 12 21:23:58.950331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2599/5054] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:58 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1511 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:23:58.958925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-49ede179-6726-4c73-924a-6059d0e90e59 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa907fb1790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:59.031187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-49ede179-6726-4c73-924a-6059d0e90e59 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.087005 Feb 12 21:23:59.032062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2456/5055] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:23:58 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:23:59.604094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:59.605114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:59.616590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.617257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.618969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.619863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.675928 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d80846fb-873f-4488-8fb5-6f91de039a55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073125 Feb 12 21:23:59.682475 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2600/5056] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:23:59 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:23:59.793825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:59.794877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:59.802961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.803678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.804679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.805128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.848444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea0971b2-b3d2-48c5-aed6-0a315974ff2e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058524 Feb 12 21:23:59.849121 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2457/5057] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:23:59 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:23:59.911699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:59.912402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:59.919131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.919797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.921256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.921256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.948846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:23:59.972146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:23:59.972871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:23:59.991183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.991808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:23:59.992702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:23:59.993209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:00.249441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-612f711c-8d9d-40db-9a83-f166983a79d0 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 204 len: 0 microversion: 2.1 time: 0.342023 Feb 12 21:24:00.250299 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2601/5058] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:23:59 2022] DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:24:00.259757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1089274-cd63-4ee0-9a0a-33a89fdaebd9 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fdf29af0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:00.280607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:00.291266 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-08b0dfe0-535a-474b-8030-be71e459a916 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1511 microversion: 2.1 time: 0.324378 Feb 12 21:24:00.291865 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2458/5059] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:23:59 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:00.298241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:00.299875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:00.306295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:00.306970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:00.307771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:00.308372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:00.313321 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1089274-cd63-4ee0-9a0a-33a89fdaebd9 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.057811 Feb 12 21:24:00.314921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2602/5060] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:24:00 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:00.602305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:00.631159 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a4fa158-0e90-4a1d-ab96-2a64a40dba55 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1672 microversion: 2.1 time: 0.338232 Feb 12 21:24:00.631751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2459/5061] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:00 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:01.309122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:01.311573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:01.325796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6dcd089e-6818-4301-be0a-7820cb6708b9 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa8fe5513a0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:01.329814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:01.330812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:01.333428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:01.334567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:01.432969 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6dcd089e-6818-4301-be0a-7820cb6708b9 tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 200 len: 345 microversion: 2.1 time: 0.110745 Feb 12 21:24:01.433861 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2460/5062] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:24:01 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:01.649176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:01.649844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:01.665506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:01.666185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:01.667011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:01.667599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:01.929861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:01.940929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d3017bcc-f5d6-470b-85fa-ee97b90f75aa tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1672 microversion: 2.1 time: 0.295047 Feb 12 21:24:01.941940 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2461/5063] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:01 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1672 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:01.946120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:01.946687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8ca01de1-8d22-4a74-9cfa-97c863745e23 req-a98cc051-544e-4373-9be3-8ef899a38b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955f9962-b43e-40fa-af91-d85da806dad0", "name": "network-vif-plugged", "status": "completed", "tag": "7e592411-155b-4647-a7b6-b5174ceee7ec"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:01.948684 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:24:01.948684 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:24:01.955831 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d030e2e7-f3a9-4d63-a13e-871a74e452bd tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.651629 Feb 12 21:24:01.960255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8ca01de1-8d22-4a74-9cfa-97c863745e23 req-a98cc051-544e-4373-9be3-8ef899a38b65 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:01.960716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8ca01de1-8d22-4a74-9cfa-97c863745e23 req-a98cc051-544e-4373-9be3-8ef899a38b65 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:01.965692 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2603/5064] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:01 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:01.986611 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8ca01de1-8d22-4a74-9cfa-97c863745e23 req-a98cc051-544e-4373-9be3-8ef899a38b65 service nova] Creating event network-vif-plugged:7e592411-155b-4647-a7b6-b5174ceee7ec for instance 955f9962-b43e-40fa-af91-d85da806dad0 on nch1-master-1 Feb 12 21:24:01.988481 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8ca01de1-8d22-4a74-9cfa-97c863745e23 req-a98cc051-544e-4373-9be3-8ef899a38b65 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045280 Feb 12 21:24:01.990199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2462/5065] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:02.449247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8931cbd0-e247-4ecd-832c-eecdcbc3f30f tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Calling method '.version_select at 0x7fa904feae50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:02.505830 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-8931cbd0-e247-4ecd-832c-eecdcbc3f30f tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] HTTP exception thrown: Volume e6878bfe-9b60-48d8-b3cc-077d51327ca2 could not be found. Feb 12 21:24:02.507191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8931cbd0-e247-4ecd-832c-eecdcbc3f30f tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] Returning 404 to user: Volume e6878bfe-9b60-48d8-b3cc-077d51327ca2 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:24:02.508262 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8931cbd0-e247-4ecd-832c-eecdcbc3f30f tempest-VolumesGetTestJSON-426322536 tempest-VolumesGetTestJSON-426322536-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2" status: 404 len: 109 microversion: 2.1 time: 0.063071 Feb 12 21:24:02.509332 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2604/5066] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:24:02 2022] GET /compute/v2.1/os-volumes/e6878bfe-9b60-48d8-b3cc-077d51327ca2 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:24:02.961386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:02.962801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:02.974567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:02.975216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:02.987635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:02.988067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:02.988894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:02.989341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:02.996471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:02.999765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:03.002658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:03.002658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:03.556722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:03.569466 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89f2d649-5f9a-4c74-acdd-ef27f3442ed9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.597296 Feb 12 21:24:03.570296 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2605/5067] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:02 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:03.670861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:03.690436 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-52b5d0b7-685e-4179-865b-d8b0d68916c2 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1672 microversion: 2.1 time: 0.733126 Feb 12 21:24:03.692135 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2463/5068] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:02 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1672 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:04.597380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:04.599207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:04.625899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:04.627839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:04.631040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:04.633855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:04.709393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:04.710968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:04.719415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:04.721804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:04.724308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:04.726559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:04.980544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:04.988651 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1aae808c-4775-4f3d-ba0b-fdb01f86fd4d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1604 microversion: 2.1 time: 0.284362 Feb 12 21:24:04.993686 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2464/5069] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:04 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:06.009037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:06.011011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:06.023696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:06.024819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:06.026139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:06.027506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:06.194816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:06.204905 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-09c4c0fe-d640-4c17-bb98-29686af849b6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 1.616066 Feb 12 21:24:06.206382 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2606/5070] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:04 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:06.213172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-12702599-b42f-48e0-aa69-7a1591ffbe30 req-488f3f96-bcda-40f3-98af-e56c35069c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0039e4f0-8954-4956-88f8-0e7da9b04f05", "name": "network-vif-deleted", "tag": "35690731-24a6-462a-972e-d7eb40390ef6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:06.216645 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:24:06.216645 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:24:06.225855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-12702599-b42f-48e0-aa69-7a1591ffbe30 req-488f3f96-bcda-40f3-98af-e56c35069c5d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:06.226679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-12702599-b42f-48e0-aa69-7a1591ffbe30 req-488f3f96-bcda-40f3-98af-e56c35069c5d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:06.241859 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-12702599-b42f-48e0-aa69-7a1591ffbe30 req-488f3f96-bcda-40f3-98af-e56c35069c5d service nova] Creating event network-vif-deleted:35690731-24a6-462a-972e-d7eb40390ef6 for instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 on nch1-master-1 Feb 12 21:24:06.248521 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-12702599-b42f-48e0-aa69-7a1591ffbe30 req-488f3f96-bcda-40f3-98af-e56c35069c5d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040217 Feb 12 21:24:06.249845 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2607/5071] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:06.253237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:06.263269 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2fad01c-d1c8-42c0-be1d-90bc744f9d93 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1604 microversion: 2.1 time: 0.258986 Feb 12 21:24:06.268006 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2465/5072] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:06 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:07.233744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:07.235384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:07.249009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:07.249009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:07.249009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:07.249009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:07.293225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:07.294800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:07.313090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:07.317099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:07.318394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:07.319051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:07.415383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:07.415383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:07.415383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lazy-loading 'fault' on Instance uuid 0039e4f0-8954-4956-88f8-0e7da9b04f05 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:24:07.513839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f827b7e9bd4d3c9b1062b67179782d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dda620b49344bdaa8408d14a9e44acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:07.522549 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb5b08e1-4053-4016-b326-d9f453174c56 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 200 len: 1325 microversion: 2.1 time: 0.241408 Feb 12 21:24:07.523147 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2466/5073] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:07 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:07.681449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:07.733746 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8bc69e45-c451-48da-8dab-1ecb6f57c966 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.503107 Feb 12 21:24:07.738221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2608/5074] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:07 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:08.547154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:08.548710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:08.555553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:08.556306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:08.557283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:08.557960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:08.588156 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] HTTP exception thrown: Instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 could not be found. Feb 12 21:24:08.589171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Returning 404 to user: Instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:24:08.590990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57e86601-e9ba-4e42-b9e2-ea32bc88246d tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 404 len: 111 microversion: 2.1 time: 0.048277 Feb 12 21:24:08.592186 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2467/5075] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:08 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:24:08.604858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c7d38e0-9f1a-4e54-bfe9-d3bf8f4f8238 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '.version_select at 0x7fa8fde1d9d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:08.753088 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:08.759543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:08.767788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:08.768735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:08.770281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:08.770917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:08.789602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c7d38e0-9f1a-4e54-bfe9-d3bf8f4f8238 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934995220" status: 202 len: 0 microversion: 2.1 time: 0.192037 Feb 12 21:24:08.791368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2609/5076] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934995220 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:24:09.325175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:09.333301 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6bce7dcb-c263-4c5c-871e-c0c50adb097c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.586512 Feb 12 21:24:09.333936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2468/5077] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:08 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:10.352455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:10.356112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:10.369700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:10.370450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:10.371460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:10.372361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:10.690774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:10.719428 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2f290b83-eba5-46f8-965c-c0c6b03474c5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.372057 Feb 12 21:24:10.721894 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2610/5078] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:10 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:11.838262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:11.840388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:11.866707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:11.867178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:11.871175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:11.876736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:12.639471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:12.677153 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9baa0cb-ddb9-4164-a6ee-45a72bb68289 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.898087 Feb 12 21:24:12.689542 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2469/5079] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:11 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:13.710428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:13.711711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:13.727884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:13.732072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:13.732072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:13.732072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:14.484494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:14.494876 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a9dd001-6a60-4d76-bb1d-342d18b2257f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.788934 Feb 12 21:24:14.496944 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2611/5080] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:13 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:15.515847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:15.519510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:15.537039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:15.542135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:15.543266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:15.545289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:15.870188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:15.885064 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8592cfb3-5eac-43e4-8b4f-6e6c228de0f5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.375316 Feb 12 21:24:15.885739 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2470/5081] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:15 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:16.914897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:16.918424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:16.937612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:16.941879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:16.942800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:16.943464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:17.988725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:18.018344 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00998686-0ebb-4d80-85e5-6b1909ffd003 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 1.105318 Feb 12 21:24:18.021190 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2612/5082] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:16 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:19.038353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:19.039601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:19.047174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:19.052602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:19.053483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:19.053943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:19.477752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:19.486279 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81759683-5029-462b-b62e-a7f97c99ab5f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.451597 Feb 12 21:24:19.497062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2471/5083] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:19 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:20.508564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:20.510139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:20.520545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:20.521033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:20.521884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:20.522340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:20.900476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:20.908781 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c6d4a7ed-a3a7-48be-90f1-2e077072553a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.404163 Feb 12 21:24:20.919390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2613/5084] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:20 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:21.926937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:21.927648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:21.935041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:21.938684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:21.938684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:21.938684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:22.115032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:22.124904 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d293b06d-2ae1-45d8-bdf9-4f22f256c05a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.202431 Feb 12 21:24:22.126460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2472/5085] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:21 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:23.148932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:23.149776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:23.175114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:23.175590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:23.176417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:23.178551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:23.504139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:23.518294 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07776ace-c8c7-4cc8-928d-02a2a06fb962 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1503 microversion: 2.1 time: 0.378445 Feb 12 21:24:23.519857 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2614/5086] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:23 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:24.545277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:24.546543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:24.555270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:24.556536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:24.557534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:24.557977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:24.919019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:24.928483 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b0fe5ec0-8799-4165-af42-86c71781d680 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1503 microversion: 2.1 time: 0.391566 Feb 12 21:24:24.929077 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2473/5087] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:24 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:25.945911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:25.947224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:25.961135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:25.962002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:25.965772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:25.972127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:26.240625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:26.251094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-251a3d02-e32a-4460-adb1-d1bdfa87dfc9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1503 microversion: 2.1 time: 0.309289 Feb 12 21:24:26.261049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2615/5088] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:25 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:27.270878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:27.272645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:27.282121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:27.282917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:27.283960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:27.284606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:27.629113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:27.647393 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef41e3d0-64f9-4248-82d9-0d91c9322d85 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 200 len: 1506 microversion: 2.1 time: 0.382354 Feb 12 21:24:27.657407 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2474/5089] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:27 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:27.667575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:27.669408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:27.693464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:27.693932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:27.694791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:27.696818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:27.987878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7e14ceab-aa7c-47a8-b5f6-9573cc4d7d62 req-e40a678b-5f3f-4204-b9be-e4b5d6f5ddf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955f9962-b43e-40fa-af91-d85da806dad0", "name": "network-vif-unplugged", "status": "completed", "tag": "7e592411-155b-4647-a7b6-b5174ceee7ec"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:27.989607 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:24:27.989607 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:24:28.002988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7e14ceab-aa7c-47a8-b5f6-9573cc4d7d62 req-e40a678b-5f3f-4204-b9be-e4b5d6f5ddf2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:28.003786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7e14ceab-aa7c-47a8-b5f6-9573cc4d7d62 req-e40a678b-5f3f-4204-b9be-e4b5d6f5ddf2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:28.025495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.server_external_events [req-7e14ceab-aa7c-47a8-b5f6-9573cc4d7d62 req-e40a678b-5f3f-4204-b9be-e4b5d6f5ddf2 service nova] Unable to find a host for instance 955f9962-b43e-40fa-af91-d85da806dad0. Dropping event network-vif-unplugged {{(pid=141726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 21:24:28.035029 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7e14ceab-aa7c-47a8-b5f6-9573cc4d7d62 req-e40a678b-5f3f-4204-b9be-e4b5d6f5ddf2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051618 Feb 12 21:24:28.036327 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2475/5090] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 12 21:24:28.252269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:28.263834 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c09e5363-dae3-4390-b74e-14dab827b5e4 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.600523 Feb 12 21:24:28.265539 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2616/5091] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:27 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:28.292714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:28.292714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:28.304575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:28.305044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:28.305941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:28.306565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:28.854328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:28.879427 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3a538b7a-1a72-4615-a242-6c3564570b83 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.583951 Feb 12 21:24:28.880725 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2476/5092] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:28 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:28.899381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:28.900787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:28.925535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:28.926486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:28.927816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:28.930984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:29.483445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:29.503067 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d884fa9-9e5a-4441-84f5-f7887e62de2d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.610642 Feb 12 21:24:29.507070 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2617/5093] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:28 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:29.520666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:29.528286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:29.534137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:29.537481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:29.538755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:29.543741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:29.777020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:29.793490 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bee583c3-d21d-4679-b5fe-83604a3d4fd8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.277643 Feb 12 21:24:29.794809 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2477/5094] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:29 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:29.813940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b6d1558e-43e1-44c6-9418-9d0dd970fa8e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:29.830263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6d1558e-43e1-44c6-9418-9d0dd970fa8e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:29.832880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b6d1558e-43e1-44c6-9418-9d0dd970fa8e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:29.902281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b6d1558e-43e1-44c6-9418-9d0dd970fa8e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:24:30.180958 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b6d1558e-43e1-44c6-9418-9d0dd970fa8e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.374251 Feb 12 21:24:30.182334 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2618/5095] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:24:29 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:24:30.192655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:30.196126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:30.221053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:30.226323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:30.227363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:30.227889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:30.610801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:30.620480 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-56663782-77ff-416f-8785-228a35592d26 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.432520 Feb 12 21:24:30.621070 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2478/5096] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:30 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:30.961460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:30.965150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:30.979305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:30.979844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:30.980884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:30.994171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:31.014240 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] HTTP exception thrown: Instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 could not be found. Feb 12 21:24:31.014240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Returning 404 to user: Instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:24:31.014728 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-297a43d5-d8d0-47e4-902a-7afd8fc3d44e tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 404 len: 111 microversion: 2.1 time: 0.058600 Feb 12 21:24:31.019868 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2619/5097] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:24:30 2022] DELETE /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:24:31.027347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:31.037574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 0039e4f0-8954-4956-88f8-0e7da9b04f05] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:31.052509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:31.053209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:31.054653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:31.055261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:31.079433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] HTTP exception thrown: Instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 could not be found. Feb 12 21:24:31.080284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Returning 404 to user: Instance 0039e4f0-8954-4956-88f8-0e7da9b04f05 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:24:31.081313 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ddc81c0f-b287-429f-b1d1-fd44be39f356 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05" status: 404 len: 111 microversion: 2.1 time: 0.060628 Feb 12 21:24:31.082096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2479/5098] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:31 2022] GET /compute/v2.1/servers/0039e4f0-8954-4956-88f8-0e7da9b04f05 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:24:31.641386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:31.642280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:31.655291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:31.655851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:31.659299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:31.660254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:32.384357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:32.398310 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1d72e23c-655d-4d94-a26d-ec7a8043d2be tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.763382 Feb 12 21:24:32.399331 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2620/5099] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:31 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:33.420015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:33.421184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:33.432607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:33.433401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:33.434677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:33.435344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:33.684513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-121700719", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "6d5bc69a-2301-48bc-9830-3152e0fb1763"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:33.795570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] validate_networks() for [('6d5bc69a-2301-48bc-9830-3152e0fb1763', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:24:34.039953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:34.049901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a21945cd-7d73-441d-b82d-5602ad2dcaa8 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.637733 Feb 12 21:24:34.060820 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2480/5100] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:33 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:35.068381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:35.069185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:35.087558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:35.087558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:35.087558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:35.087558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:35.175980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:24:35.176454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:24:35.177163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:24:35.177808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:24:35.178417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:24:35.190476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:35.191001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:35.192054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:35.193025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:35.215592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Getting quotas for project 07de9e87ea3f495f90baaf85d83b982c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:24:35.223862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Getting quotas for user 7190c407ef794576a92dc5616e2ec4e3 and project 07de9e87ea3f495f90baaf85d83b982c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:24:35.240339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:24:35.242894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:24:35.358717 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32c606f8-b174-4d81-9275-3a0429081ac3 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678676 Feb 12 21:24:35.360406 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2621/5101] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:24:35.370107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7464f0c1-b7c1-4309-960d-dadcb7c61d80 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:35.371384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7464f0c1-b7c1-4309-960d-dadcb7c61d80 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:35.478678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7464f0c1-b7c1-4309-960d-dadcb7c61d80 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:35.487597 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7464f0c1-b7c1-4309-960d-dadcb7c61d80 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1218 microversion: 2.1 time: 0.121629 Feb 12 21:24:35.488185 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2622/5102] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:35 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:35.776593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:35.785754 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b7ac6f69-1c8b-4e04-a08c-89a4bd0ee59f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.721217 Feb 12 21:24:35.786345 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2481/5103] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:35 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:36.011551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:36.012909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:36.023411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:36.024310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:36.025348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:36.026038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:36.068181 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] HTTP exception thrown: Instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 could not be found. Feb 12 21:24:36.069582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Returning 404 to user: Instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:24:36.070684 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e46b10b-ff52-4a5f-9785-f1adbf7a9cfe tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "DELETE /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 404 len: 111 microversion: 2.1 time: 0.065549 Feb 12 21:24:36.074467 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2623/5104] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:24:36 2022] DELETE /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:24:36.083583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:36.084206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] [instance: 245ee706-32b5-4ae4-bf28-f1e5139ea077] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:36.098109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:36.099120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:36.102038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:36.104567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:36.130139 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] HTTP exception thrown: Instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 could not be found. Feb 12 21:24:36.131491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] Returning 404 to user: Instance 245ee706-32b5-4ae4-bf28-f1e5139ea077 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:24:36.132363 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b8b435f-9dfe-4fa5-b3d9-db5945b0bff9 tempest-AttachVolumeTestJSON-1617998511 tempest-AttachVolumeTestJSON-1617998511-project] 10.222.0.31 "GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077" status: 404 len: 111 microversion: 2.1 time: 0.054170 Feb 12 21:24:36.137484 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2482/5105] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:36 2022] GET /compute/v2.1/servers/245ee706-32b5-4ae4-bf28-f1e5139ea077 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:24:36.504780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0af5e574-92db-4401-b5f1-16b1e82a4646 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:36.506278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0af5e574-92db-4401-b5f1-16b1e82a4646 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:36.658834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0af5e574-92db-4401-b5f1-16b1e82a4646 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:36.686223 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0af5e574-92db-4401-b5f1-16b1e82a4646 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1218 microversion: 2.1 time: 0.169069 Feb 12 21:24:36.689003 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2624/5106] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:36 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:36.805250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:36.806109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:36.815832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:36.818269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:36.823003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:36.827329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:37.229864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:37.238858 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f81b35e7-d212-4925-af67-882d039c743b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.438967 Feb 12 21:24:37.242550 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2483/5107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:36 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:37.710702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:37.714988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:37.727570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:37.728679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:37.729664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:37.748931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:37.852617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:37.862719 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5cd4143-7eef-4522-9fc1-40cc0018b420 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1270 microversion: 2.1 time: 0.159563 Feb 12 21:24:37.867299 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2625/5108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:37 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:38.257942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:38.258560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:38.268928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:38.269661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:38.270477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:38.270918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:38.783988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:38.791851 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6092f592-c81a-439b-bfa8-094b98a2a0cc tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.537891 Feb 12 21:24:38.802801 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2484/5109] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:38 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:38.883069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:38.883679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:38.891441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:38.891902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:38.892970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:38.893437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:38.992920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:39.002132 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd29a08b-afb6-42aa-8c93-498470a9fdb7 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1276 microversion: 2.1 time: 0.121131 Feb 12 21:24:39.003268 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2626/5110] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:38 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:39.809219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:39.809871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:39.829055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:39.829699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:39.830502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:39.830949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:40.020423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:40.021581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:40.030081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:40.030534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:40.031457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:40.031920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:40.416593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:40.431485 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b00035c-6365-403e-a0ee-0a9d01bc35f8 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1276 microversion: 2.1 time: 0.414590 Feb 12 21:24:40.432424 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2627/5111] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:40 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1276 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:40.509705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:40.520712 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-194b251b-64bd-4a03-bc6b-7ac5084295ff tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1679 microversion: 2.1 time: 0.714982 Feb 12 21:24:40.521665 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2485/5112] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:39 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1679 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:41.454488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:41.455681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:41.465993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:41.466704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:41.467508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:41.467944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:41.540725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:41.541400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:41.551769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:41.552293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:41.553587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:41.554233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:41.687125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:41.696030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f378eb10-33e9-439a-8e0d-021c13eb5d5b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 0.246122 Feb 12 21:24:41.696690 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2628/5113] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:41 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:42.421830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:42.446709 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f25b9329-8563-4a72-8d71-af1d2d00a045 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1656 microversion: 2.1 time: 0.912377 Feb 12 21:24:42.453112 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2486/5114] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:41 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1656 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:42.473958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a7b616f-18cb-4a29-a64c-70bfc8213771 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:42.484228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a7b616f-18cb-4a29-a64c-70bfc8213771 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:42.489075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a7b616f-18cb-4a29-a64c-70bfc8213771 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:42.578113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a7b616f-18cb-4a29-a64c-70bfc8213771 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Going to try to start instance {{(pid=141727) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:24:42.714233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:42.720819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3afa41f-ef22-4eb2-a14e-88e0f23d25a9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 0.242762 Feb 12 21:24:43.086528 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2487/5115] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:42 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:43.362969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a7b616f-18cb-4a29-a64c-70bfc8213771 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.893880 Feb 12 21:24:43.370378 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2629/5116] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:24:42 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:24:43.380003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:43.380654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:43.403146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:43.403617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:43.409301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:43.409793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:44.090821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:44.091524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:44.106425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:44.106995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:44.107955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:44.108632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:44.382422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:44.401922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5af1843-3f0e-4006-ab4e-be2a33d9ee29 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 0.314040 Feb 12 21:24:44.403633 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2630/5117] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:44 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:44.404563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:44.423600 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa1d617c-542e-4867-9345-02b26db85554 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1665 microversion: 2.1 time: 1.045811 Feb 12 21:24:44.423600 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2488/5118] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:43 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1665 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:45.012575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-cae15fe0-593f-442f-84de-e7f4de9a6bc9 req-d086464a-90ed-4fe0-8d57-4aa9e01602c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc92777-08a6-40e3-a421-5a9898d5e199", "tag": "d661d100-a3e2-4189-afa4-cff30b0ad7a4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:45.016897 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:24:45.016897 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:24:45.028061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cae15fe0-593f-442f-84de-e7f4de9a6bc9 req-d086464a-90ed-4fe0-8d57-4aa9e01602c1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:45.029991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-cae15fe0-593f-442f-84de-e7f4de9a6bc9 req-d086464a-90ed-4fe0-8d57-4aa9e01602c1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:45.085011 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-cae15fe0-593f-442f-84de-e7f4de9a6bc9 req-d086464a-90ed-4fe0-8d57-4aa9e01602c1 service nova] Creating event network-changed:d661d100-a3e2-4189-afa4-cff30b0ad7a4 for instance 4dc92777-08a6-40e3-a421-5a9898d5e199 on nch1-master-1 Feb 12 21:24:45.108971 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-cae15fe0-593f-442f-84de-e7f4de9a6bc9 req-d086464a-90ed-4fe0-8d57-4aa9e01602c1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089656 Feb 12 21:24:45.113674 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2631/5119] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:45.424191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:45.424838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:45.440872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:45.441744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:45.448918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:45.449790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:45.451586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:45.454661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:45.455320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:45.457319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:45.458313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:45.461415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:45.738769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:45.746582 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-715335a4-cd9b-4c72-8ef4-28b37c86d9b2 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1665 microversion: 2.1 time: 0.311695 Feb 12 21:24:45.747370 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2632/5120] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:45 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1665 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:46.413839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:46.425702 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00393fc4-6805-4eec-9e30-6b1a191126ae tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 1.007463 Feb 12 21:24:46.427381 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2489/5121] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:45 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:46.765393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:46.767873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:46.788681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:46.790145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:46.791023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:46.792133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:47.213686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:47.224513 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-515a948c-adcd-4935-b136-42a6d9c3634f tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1665 microversion: 2.1 time: 0.463832 Feb 12 21:24:47.235040 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2633/5122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:46 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1665 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:47.443525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:47.444330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:47.457752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:47.464436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:47.465449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:47.465912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:48.242085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:48.242688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:48.253771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:48.254314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:48.255167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:48.255931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:48.358512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:48.362076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eaffcaf3-3317-4b2f-bb08-1208e7668073 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 0.922414 Feb 12 21:24:48.363202 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2490/5123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:47 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:48.463068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:48.472981 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bdf6478a-6111-4ff0-927d-504d2cdd1f88 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.234425 Feb 12 21:24:48.473607 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2634/5124] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:48 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:48.493889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:48.495087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:48.503537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:48.504003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:48.504796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:48.505436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:49.095730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:49.100745 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3cef22df-c94b-484d-9b20-50384c31370a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.610812 Feb 12 21:24:49.121496 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2491/5125] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:48 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:49.125766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:49.126390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:49.136257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:49.137932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:49.139063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:49.141050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:49.383360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:49.386012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:49.396863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:49.402678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:49.403631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:49.404094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:49.702274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:49.721854 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3784ff8-7f9d-45da-8ae2-2006641643a6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.596707 Feb 12 21:24:49.722779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2635/5126] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:49 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:49.744739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:49.744739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:49.756550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:49.758118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:49.761887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:49.762718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:50.377650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:50.392101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e0b8f155-85cb-4251-abb8-3df099c81c21 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 1.013766 Feb 12 21:24:50.393167 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2492/5127] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:49 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:50.483708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:50.499555 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7af86eac-f236-41a1-a13b-13a4329bb06a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.763200 Feb 12 21:24:50.501950 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2636/5128] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:49 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:50.521261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:50.523335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:50.540744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:50.541531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:50.544191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:50.544824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:50.894506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:50.909191 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71047d28-a2e0-44a9-96da-d73e84df8c3b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.395504 Feb 12 21:24:50.914027 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2493/5129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:50 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:50.930709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:50.931906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:50.939990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:50.940830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:50.941972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:50.942642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:50.977393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lazy-loading 'flavor' on Instance uuid 8c34707c-1370-4765-a22b-cdab52d7a63e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:24:51.366175 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4fd4148e-6882-4e2b-ba01-67a53bc9c853 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.438678 Feb 12 21:24:51.368023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2637/5130] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:24:50 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:24:51.380064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:51.385709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:51.398190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:51.398678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:51.399473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:51.400129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:51.411445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:51.412146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:51.420208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:51.420700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:51.425629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:51.426739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:51.728139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:51.735651 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5cd9771-cc1d-4965-8571-2c9176c990f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 0.328927 Feb 12 21:24:51.736267 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2638/5131] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:51 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:51.877291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:51.888324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a33619ff-9cdb-493e-b5a5-6f7eff154466 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1677 microversion: 2.1 time: 0.514794 Feb 12 21:24:51.889151 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2494/5132] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:51 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1677 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:52.169787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-231caf64-f6ee-488d-9f3f-36739adfe19b req-a4e53ae2-a8eb-4ecc-956a-7e3625469582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc92777-08a6-40e3-a421-5a9898d5e199", "name": "network-vif-plugged", "status": "completed", "tag": "d661d100-a3e2-4189-afa4-cff30b0ad7a4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:52.171564 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:24:52.171564 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:24:52.194697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-231caf64-f6ee-488d-9f3f-36739adfe19b req-a4e53ae2-a8eb-4ecc-956a-7e3625469582 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:52.195367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-231caf64-f6ee-488d-9f3f-36739adfe19b req-a4e53ae2-a8eb-4ecc-956a-7e3625469582 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:52.223422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-231caf64-f6ee-488d-9f3f-36739adfe19b req-a4e53ae2-a8eb-4ecc-956a-7e3625469582 service nova] Creating event network-vif-plugged:d661d100-a3e2-4189-afa4-cff30b0ad7a4 for instance 4dc92777-08a6-40e3-a421-5a9898d5e199 on nch1-master-1 Feb 12 21:24:52.228490 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-231caf64-f6ee-488d-9f3f-36739adfe19b req-a4e53ae2-a8eb-4ecc-956a-7e3625469582 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064136 Feb 12 21:24:52.229554 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2639/5133] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:52.770211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:52.771084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:52.779941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:52.780506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:52.782143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:52.782939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:52.907504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:52.908221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:52.915936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:52.916393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:52.917205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:52.924389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:53.346430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:53.364642 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-665bb978-2c65-432a-8d1f-3906fa5dd5ec tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1318 microversion: 2.1 time: 0.609118 Feb 12 21:24:53.366313 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2495/5134] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:52 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:53.527381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:53.539935 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a1e39ef0-84ec-4203-a508-da1291597e1a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1660 microversion: 2.1 time: 0.636931 Feb 12 21:24:53.541150 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2640/5135] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:52 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1660 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:53.557902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:24:53.559247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:53.571823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:53.572546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:53.575345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:53.575778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:53.899303 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-273c5828-67f1-4255-b1f4-b509949c3ac1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action" status: 202 len: 0 microversion: 2.1 time: 0.345431 Feb 12 21:24:53.905163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2496/5136] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:24:53 2022] POST /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:24:53.910662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:53.911569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:53.940174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:53.945340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:53.946487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:53.947143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:54.386647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:54.387436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:54.396526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:54.396997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:54.398033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:54.398496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:54.554365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:54.566570 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7a7e75b7-8415-4155-95af-d40bbe6e1d11 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1666 microversion: 2.1 time: 0.661973 Feb 12 21:24:54.580047 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2641/5137] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:53 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1666 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:55.157500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:55.165724 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-054663b3-8bf7-4b21-b07e-60efd1616064 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1506 microversion: 2.1 time: 0.785927 Feb 12 21:24:55.166334 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2497/5138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:54 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1506 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:24:55.602196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:55.604680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:55.621142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:55.621142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:55.621142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:55.621142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:56.309448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:56.327185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a4581fe2-a41c-4e3e-ab05-8df4e6cd7f80 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1666 microversion: 2.1 time: 0.743840 Feb 12 21:24:56.341603 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2642/5139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:55 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1666 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:57.285521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43d9ffcb-3a70-44f5-b850-c5cdda192cb8 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe7e7940>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:57.352234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:57.352863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:57.370145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:57.370644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:57.372944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:57.373435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:57.396834 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43d9ffcb-3a70-44f5-b850-c5cdda192cb8 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/f138a5f1-3115-4cbc-85a8-6ad6283b36a1" status: 200 len: 344 microversion: 2.1 time: 0.116081 Feb 12 21:24:57.397451 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2498/5140] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:24:57 2022] GET /compute/v2.1/os-volumes/f138a5f1-3115-4cbc-85a8-6ad6283b36a1 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:24:57.868476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:57.879610 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7fa89581-7f39-4fab-9d1e-941e7edfbb6e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.532059 Feb 12 21:24:57.880648 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2643/5141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:57 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:57.897085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:57.897965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:57.912902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:57.914477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:57.916937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:57.918252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:58.427226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:24:58.448260 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-71205322-3c99-4382-978b-c38dc62fe51e tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1669 microversion: 2.1 time: 0.551453 Feb 12 21:24:58.449474 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2499/5142] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:24:57 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1669 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:24:58.472878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:24:58.475366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:24:58.495666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:58.501279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:58.502730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:24:58.505536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:24:58.564370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:24:58.574547 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Working on deleting snapshot a4faadd2-d057-46ee-9422-41c9eaf6a7e8 from shelved instance... Feb 12 21:25:00.709121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Doing local delete in cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) {{(pid=141727) _delete /opt/stack/nova/nova/compute/api.py:2459}} Feb 12 21:25:00.710046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:00.712684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:00.714943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Feb 12 21:25:00.720656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] deallocate_for_instance() {{(pid=141727) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1790}} Feb 12 21:25:01.455897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b37497e-e48a-4b35-89ee-6e0685e3eb49 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe1328b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:01.558033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b37497e-e48a-4b35-89ee-6e0685e3eb49 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/942a8fad-6559-4371-b634-16a0127fe83c" status: 200 len: 342 microversion: 2.1 time: 0.105721 Feb 12 21:25:01.559133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2500/5143] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:25:01 2022] GET /compute/v2.1/os-volumes/942a8fad-6559-4371-b634-16a0127fe83c => generated 342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:02.902666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aacc142f-bac9-4d58-9705-49f2b86e3a0a", "device": "/dev/sdb"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:02.903908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:02.936464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:02.937149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:02.938401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:02.939004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:04.037205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Updating instance_info_cache with network_info: [] {{(pid=141727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Feb 12 21:25:04.060056 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34bab073-440d-4c7f-906d-e7530e98c410 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "POST /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157121 Feb 12 21:25:04.065303 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2501/5144] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:25:02 2022] POST /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:04.087602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a1b983b0-45b4-42a1-a652-2fc984cfe501 req-b09333b4-c8b6-4cb2-942e-7ea51c488824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955f9962-b43e-40fa-af91-d85da806dad0", "name": "network-vif-deleted", "tag": "7e592411-155b-4647-a7b6-b5174ceee7ec"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:04.097718 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:25:04.097718 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:25:04.118004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a1b983b0-45b4-42a1-a652-2fc984cfe501 req-b09333b4-c8b6-4cb2-942e-7ea51c488824 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:04.118730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a1b983b0-45b4-42a1-a652-2fc984cfe501 req-b09333b4-c8b6-4cb2-942e-7ea51c488824 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:04.159247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.server_external_events [req-a1b983b0-45b4-42a1-a652-2fc984cfe501 req-b09333b4-c8b6-4cb2-942e-7ea51c488824 service nova] Unable to find a host for instance 955f9962-b43e-40fa-af91-d85da806dad0. Dropping event network-vif-deleted {{(pid=141726) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 21:25:04.162289 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a1b983b0-45b4-42a1-a652-2fc984cfe501 req-b09333b4-c8b6-4cb2-942e-7ea51c488824 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.095151 Feb 12 21:25:04.167408 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2502/5145] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 12 21:25:04.528652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eea63fa5-06a8-45e1-a64b-07200d672751 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe132160>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:04.623259 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eea63fa5-06a8-45e1-a64b-07200d672751 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/3586ccc6-e4ab-4aeb-a1af-73efbf85555a" status: 200 len: 343 microversion: 2.1 time: 0.100222 Feb 12 21:25:04.623781 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2503/5146] 10.222.0.31 () {58 vars in 1244 bytes} [Sat Feb 12 21:25:04 2022] GET /compute/v2.1/os-volumes/3586ccc6-e4ab-4aeb-a1af-73efbf85555a => generated 343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:25:04.636354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a4b04e2-9bcb-4a01-ac22-7e14aa497a82 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fdfea8b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:04.784239 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a4b04e2-9bcb-4a01-ac22-7e14aa497a82 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.152459 Feb 12 21:25:04.791764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2504/5147] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 21:25:04 2022] GET /compute/v2.1/os-volumes => generated 1012 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:25:04.798619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4c98449-43a5-4bf7-8c36-a22daa9e43c6 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fdfb4160>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:05.282311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2edec4bb-7028-4228-b337-e99715197491 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "DELETE /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 204 len: 0 microversion: 2.1 time: 6.813009 Feb 12 21:25:05.286925 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2644/5148] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:24:58 2022] DELETE /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 0 bytes in 6815 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:25:05.295152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:05.299257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 955f9962-b43e-40fa-af91-d85da806dad0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:05.319053 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4c98449-43a5-4bf7-8c36-a22daa9e43c6 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 678 microversion: 2.1 time: 0.525468 Feb 12 21:25:05.320504 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2505/5149] 10.222.0.31 () {58 vars in 1148 bytes} [Sat Feb 12 21:25:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 678 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:05.322160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:05.322638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:05.324657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:05.327177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:05.332595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b2cb334-7fc6-40a0-adf1-550b447d0775 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe7e7790>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:05.370166 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] HTTP exception thrown: Instance 955f9962-b43e-40fa-af91-d85da806dad0 could not be found. Feb 12 21:25:05.370987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Returning 404 to user: Instance 955f9962-b43e-40fa-af91-d85da806dad0 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:25:05.372593 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1e010c68-a4a1-4cdd-991f-9a7dbdc85b8c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0" status: 404 len: 111 microversion: 2.1 time: 0.084204 Feb 12 21:25:05.373340 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2645/5150] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:05 2022] GET /compute/v2.1/servers/955f9962-b43e-40fa-af91-d85da806dad0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:25:05.388164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:05.394032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:05.414680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:05.416665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:05.419883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:05.420584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:05.471376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:25:05.715177 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b2cb334-7fc6-40a0-adf1-550b447d0775 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.386580 Feb 12 21:25:05.716006 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2506/5151] 10.222.0.31 () {58 vars in 1133 bytes} [Sat Feb 12 21:25:05 2022] GET /compute/v2.1/os-volumes => generated 1012 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:05.727689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-16c74595-554e-4b29-9103-4a35483f006e tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe1eaaf0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:05.976689 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9bd4fad-5ff8-4478-aa69-dfb9d900fa94 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "DELETE /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 204 len: 0 microversion: 2.1 time: 0.595304 Feb 12 21:25:05.977293 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2646/5152] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:25:05 2022] DELETE /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:25:05.987822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:05.988575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:06.032725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:06.036734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:06.037888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:06.040797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:06.285646 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-16c74595-554e-4b29-9103-4a35483f006e tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.561057 Feb 12 21:25:06.285646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2507/5153] 10.222.0.31 () {58 vars in 1166 bytes} [Sat Feb 12 21:25:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 345 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:25:06.297347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:06.297984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f2205df1-5f31-4c2e-8a31-1f298990b5d1 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe16dee0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:06.307190 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2aee1cfe-cecc-4d98-87ea-e56ff92e89d6 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1464 microversion: 2.1 time: 0.323683 Feb 12 21:25:06.308508 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2647/5154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:05 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:06.485573 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f2205df1-5f31-4c2e-8a31-1f298990b5d1 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 678 microversion: 2.1 time: 0.192236 Feb 12 21:25:06.487252 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2508/5155] 10.222.0.31 () {58 vars in 1169 bytes} [Sat Feb 12 21:25:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:06.502348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7ecc486b-43b9-4c56-868a-0c70f7dde412 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fdf39ca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:06.845543 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7ecc486b-43b9-4c56-868a-0c70f7dde412 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.350218 Feb 12 21:25:06.846414 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2648/5156] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:25:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:25:06.866403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9d0bdb30-d56f-4305-bd16-cbc678f60aa2 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fe111c10>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:07.001187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9d0bdb30-d56f-4305-bd16-cbc678f60aa2 tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.145251 Feb 12 21:25:07.002893 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2509/5157] 10.222.0.31 () {58 vars in 1187 bytes} [Sat Feb 12 21:25:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:07.014391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d4700da-121f-4f08-aa04-8c36aaa18a1a tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] Calling method '.version_select at 0x7fa8fea2d280>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:07.332169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:07.333022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:07.384148 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d4700da-121f-4f08-aa04-8c36aaa18a1a tempest-VolumesTestJSON-1588431633 tempest-VolumesTestJSON-1588431633-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.372677 Feb 12 21:25:07.385581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:07.386071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:07.391816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:07.393469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:07.395336 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2649/5158] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:25:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:07.628258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:07.655636 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3d38f91a-7a2d-4303-b637-63d544646834 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1464 microversion: 2.1 time: 0.328696 Feb 12 21:25:07.656793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2510/5159] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:07 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1464 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:08.347850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-627f00b9-ac81-4daf-b672-98d376dcbea7 req-87e81fc3-de17-42ec-a5ee-061b70fa2d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d7cfd2-6923-4882-bbbe-97069905bcba", "name": "network-vif-deleted", "tag": "6c240f75-9cf6-4ab7-9416-73a6c32cc739"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:08.350579 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:25:08.350579 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:25:08.362469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-627f00b9-ac81-4daf-b672-98d376dcbea7 req-87e81fc3-de17-42ec-a5ee-061b70fa2d6a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:08.365403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-627f00b9-ac81-4daf-b672-98d376dcbea7 req-87e81fc3-de17-42ec-a5ee-061b70fa2d6a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:08.391353 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-627f00b9-ac81-4daf-b672-98d376dcbea7 req-87e81fc3-de17-42ec-a5ee-061b70fa2d6a service nova] Creating event network-vif-deleted:6c240f75-9cf6-4ab7-9416-73a6c32cc739 for instance 93d7cfd2-6923-4882-bbbe-97069905bcba on nch2-master-1 Feb 12 21:25:08.402287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-627f00b9-ac81-4daf-b672-98d376dcbea7 req-87e81fc3-de17-42ec-a5ee-061b70fa2d6a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059732 Feb 12 21:25:08.407649 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2650/5160] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:08.674030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:08.674804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:08.681957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:08.682485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:08.683352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:08.683850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:08.720433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:08.721373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:08.721991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lazy-loading 'fault' on Instance uuid 93d7cfd2-6923-4882-bbbe-97069905bcba {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:25:08.774900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:08.789614 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4635c7b4-8464-47ba-9ec5-70b6b26f3a71 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 200 len: 1304 microversion: 2.1 time: 0.119367 Feb 12 21:25:08.790953 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2511/5161] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:08 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:09.811003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:09.812603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 93d7cfd2-6923-4882-bbbe-97069905bcba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:09.821449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:09.822175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:09.824498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:09.825850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:09.850185 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] HTTP exception thrown: Instance 93d7cfd2-6923-4882-bbbe-97069905bcba could not be found. Feb 12 21:25:09.850997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Returning 404 to user: Instance 93d7cfd2-6923-4882-bbbe-97069905bcba could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:25:09.851994 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2642dc30-e8e3-45ef-aa0f-22ffdec0080a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba" status: 404 len: 111 microversion: 2.1 time: 0.047633 Feb 12 21:25:09.857902 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2651/5162] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:09 2022] GET /compute/v2.1/servers/93d7cfd2-6923-4882-bbbe-97069905bcba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:25:09.863359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:09.863943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:09.877098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:09.877098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:09.877098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:09.877098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:09.909526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:25:10.243798 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-899e154d-f4f7-47ef-bb0c-a72f6fb3f091 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 204 len: 0 microversion: 2.1 time: 0.385549 Feb 12 21:25:10.244420 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2512/5163] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:25:09 2022] DELETE /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:25:10.252613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:10.253883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:10.286458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:10.288063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:10.289342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:10.289822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:10.811357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:10.820609 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3ce77c9-649e-4109-8e7d-d90ccc9ea57d tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1508 microversion: 2.1 time: 0.571899 Feb 12 21:25:10.821839 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2652/5164] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:10 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:11.838246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:11.839126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:11.846735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:11.847432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:11.848343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:11.848874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:12.197339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:12.206558 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-393f1148-7c99-4c87-aaa4-2ab6a40c2028 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1508 microversion: 2.1 time: 0.372284 Feb 12 21:25:12.217703 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2513/5165] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:11 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:12.840714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-daf2efdd-68f6-41a5-8677-6cf61ef95484 req-dfff026c-9bf6-46f6-a1af-0fae472b780c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f7fd737-b889-4ec5-970b-9388c850a094", "name": "network-vif-deleted", "tag": "a7ca726b-c529-424c-8983-7b7a58cc17cd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:12.842658 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:25:12.842658 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:25:12.860643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-daf2efdd-68f6-41a5-8677-6cf61ef95484 req-dfff026c-9bf6-46f6-a1af-0fae472b780c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:12.861096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-daf2efdd-68f6-41a5-8677-6cf61ef95484 req-dfff026c-9bf6-46f6-a1af-0fae472b780c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:12.893429 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-daf2efdd-68f6-41a5-8677-6cf61ef95484 req-dfff026c-9bf6-46f6-a1af-0fae472b780c service nova] Creating event network-vif-deleted:a7ca726b-c529-424c-8983-7b7a58cc17cd for instance 3f7fd737-b889-4ec5-970b-9388c850a094 on nch2-master-1 Feb 12 21:25:12.931211 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-daf2efdd-68f6-41a5-8677-6cf61ef95484 req-dfff026c-9bf6-46f6-a1af-0fae472b780c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093913 Feb 12 21:25:12.938279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2653/5166] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:13.225077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:13.225737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:13.238182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:13.242422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:13.245098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:13.245803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:13.314398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:13.315113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:13.316083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lazy-loading 'fault' on Instance uuid 3f7fd737-b889-4ec5-970b-9388c850a094 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:25:13.454110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:13.473406 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8cb7cde8-ab6e-46d4-bd7f-2a956770375a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 200 len: 1305 microversion: 2.1 time: 0.253684 Feb 12 21:25:13.479088 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2514/5167] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:13 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 1305 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:14.492288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:14.492991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 3f7fd737-b889-4ec5-970b-9388c850a094] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:14.509114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:14.509114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:14.509114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:14.509114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:14.522856 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] HTTP exception thrown: Instance 3f7fd737-b889-4ec5-970b-9388c850a094 could not be found. Feb 12 21:25:14.523455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Returning 404 to user: Instance 3f7fd737-b889-4ec5-970b-9388c850a094 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:25:14.524286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ff5ff29b-7efc-41f9-b645-f3a77c1d97c1 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094" status: 404 len: 111 microversion: 2.1 time: 0.036390 Feb 12 21:25:14.524841 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2654/5168] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:14 2022] GET /compute/v2.1/servers/3f7fd737-b889-4ec5-970b-9388c850a094 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:25:14.538444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:14.538949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:14.545779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:14.546770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:14.547818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:14.548689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:14.578972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:25:14.894665 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3525c468-b48a-4aa1-917f-66be5f3b4314 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 204 len: 0 microversion: 2.1 time: 0.359678 Feb 12 21:25:14.922799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:14.922799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:14.923331 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2515/5169] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:25:14 2022] DELETE /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:25:14.923423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:14.923423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:14.923423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:14.923423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:15.653174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:15.668340 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-04b4bbd7-acd4-47d7-a46e-a85bf48e438b tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1493 microversion: 2.1 time: 0.768055 Feb 12 21:25:15.672061 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2655/5170] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:14 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1493 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:16.686475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:16.688376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:16.707176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:16.707633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:16.708708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:16.709202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:17.096576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:17.104839 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-95e30554-059e-4657-810a-3fa5c0b89e79 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1493 microversion: 2.1 time: 0.422528 Feb 12 21:25:17.105638 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2516/5171] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:16 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1493 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:25:17.560651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b5c1b94b-a287-43c6-bae8-f0cabe342f0d req-2a128224-6293-4e9b-ad76-be4eafa7b44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8df7ff-9049-4b7d-940f-776982de0700", "name": "network-vif-deleted", "tag": "a500c7b1-8358-4bc8-ae00-21079afb6cb4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:17.562918 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:25:17.562918 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:25:17.582437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b5c1b94b-a287-43c6-bae8-f0cabe342f0d req-2a128224-6293-4e9b-ad76-be4eafa7b44c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:17.585825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b5c1b94b-a287-43c6-bae8-f0cabe342f0d req-2a128224-6293-4e9b-ad76-be4eafa7b44c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:17.596362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b5c1b94b-a287-43c6-bae8-f0cabe342f0d req-2a128224-6293-4e9b-ad76-be4eafa7b44c service nova] Creating event network-vif-deleted:a500c7b1-8358-4bc8-ae00-21079afb6cb4 for instance 1d8df7ff-9049-4b7d-940f-776982de0700 on nch2-master-1 Feb 12 21:25:17.602411 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b5c1b94b-a287-43c6-bae8-f0cabe342f0d req-2a128224-6293-4e9b-ad76-be4eafa7b44c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045435 Feb 12 21:25:17.604167 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2656/5172] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:18.127106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:18.132378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:18.137193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:18.137688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:18.138502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:18.142099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:18.198695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:18.199283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:18.199827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lazy-loading 'fault' on Instance uuid 1d8df7ff-9049-4b7d-940f-776982de0700 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:25:18.272770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:18.296507 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f9c3d8c2-2996-4370-b06a-7f35a0b1778a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 200 len: 1304 microversion: 2.1 time: 0.170611 Feb 12 21:25:18.301030 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2517/5173] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:18 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:19.318572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:19.318572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 1d8df7ff-9049-4b7d-940f-776982de0700] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:19.335866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:19.336560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:19.337676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:19.338306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:19.359357 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] HTTP exception thrown: Instance 1d8df7ff-9049-4b7d-940f-776982de0700 could not be found. Feb 12 21:25:19.359976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Returning 404 to user: Instance 1d8df7ff-9049-4b7d-940f-776982de0700 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:25:19.360854 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9bb196e5-d223-42ab-9faa-6ddfc01084a3 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700" status: 404 len: 111 microversion: 2.1 time: 0.049778 Feb 12 21:25:19.361500 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2657/5174] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:19 2022] GET /compute/v2.1/servers/1d8df7ff-9049-4b7d-940f-776982de0700 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:25:19.369447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:19.370626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:19.378246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:19.378707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:19.379531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:19.379967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:19.410085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:25:19.734795 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c582892-0e11-4829-95be-3cb9f1b29332 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 204 len: 0 microversion: 2.1 time: 0.368231 Feb 12 21:25:19.738227 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2518/5175] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:25:19 2022] DELETE /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:25:19.746354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:19.747166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:19.757395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:19.761331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:19.761331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:19.761331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:20.001639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:20.009686 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-34dd1fb5-30ec-4b30-92a2-6e59cec0b30c tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1675 microversion: 2.1 time: 0.268386 Feb 12 21:25:20.010491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2658/5176] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:19 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:21.032901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:21.034392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:21.052254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:21.052884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:21.053874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:21.054531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:21.352781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:21.365890 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0a8d054-8aaf-4f25-a0cd-96f1b081d7d7 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1675 microversion: 2.1 time: 0.340373 Feb 12 21:25:21.367365 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2519/5177] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:21 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1675 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:22.385548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:22.386855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:22.401771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:22.406001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:22.407052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:22.410661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:22.549249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:22.566908 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f046ca3-59ab-47c2-b6f6-3ed933fc713a tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1608 microversion: 2.1 time: 0.186088 Feb 12 21:25:22.567873 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2659/5178] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:22 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1608 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:23.591915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ccc732aa-96b8-4901-83d6-461271dccc31 req-7cc68b01-eda3-4758-9f8b-d8c3bc2d9a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34707c-1370-4765-a22b-cdab52d7a63e", "name": "network-vif-deleted", "tag": "46b4431b-660a-42fe-8b92-e92dfee82188"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:23.592437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:23.593148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:23.598677 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:25:23.598677 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:25:23.612937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ccc732aa-96b8-4901-83d6-461271dccc31 req-7cc68b01-eda3-4758-9f8b-d8c3bc2d9a3b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:23.613407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ccc732aa-96b8-4901-83d6-461271dccc31 req-7cc68b01-eda3-4758-9f8b-d8c3bc2d9a3b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:23.626911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:23.629905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:23.637132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:23.637132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:23.660179 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ccc732aa-96b8-4901-83d6-461271dccc31 req-7cc68b01-eda3-4758-9f8b-d8c3bc2d9a3b service nova] Creating event network-vif-deleted:46b4431b-660a-42fe-8b92-e92dfee82188 for instance 8c34707c-1370-4765-a22b-cdab52d7a63e on nch1-master-1 Feb 12 21:25:23.672494 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ccc732aa-96b8-4901-83d6-461271dccc31 req-7cc68b01-eda3-4758-9f8b-d8c3bc2d9a3b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099262 Feb 12 21:25:23.673528 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2520/5179] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:23.799008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b461f428c844982ac3fa24b0f80dc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fc5569c8334523aa6dff77b1d79015', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:23.810546 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e9b7820-7038-4c02-8479-6b19a12971a5 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 200 len: 1608 microversion: 2.1 time: 0.230596 Feb 12 21:25:23.812367 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2660/5180] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:23 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 1608 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:24.830776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:24.831490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] [instance: 8c34707c-1370-4765-a22b-cdab52d7a63e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:24.852457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:24.852924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:24.853765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:24.854700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:24.884784 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] HTTP exception thrown: Instance 8c34707c-1370-4765-a22b-cdab52d7a63e could not be found. Feb 12 21:25:24.885772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Returning 404 to user: Instance 8c34707c-1370-4765-a22b-cdab52d7a63e could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:25:24.886629 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-886f64c4-d094-4073-8bd1-4f69e8b219b9 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e" status: 404 len: 111 microversion: 2.1 time: 0.061269 Feb 12 21:25:24.887555 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2521/5181] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:24 2022] GET /compute/v2.1/servers/8c34707c-1370-4765-a22b-cdab52d7a63e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:25:24.897273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4fb8cb9-a09a-424f-8ad2-9eeafc59db81 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] Calling method '.version_select at 0x7fa8fd872550>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:25.052923 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4fb8cb9-a09a-424f-8ad2-9eeafc59db81 tempest-ServerActionsTestJSON-614087630 tempest-ServerActionsTestJSON-614087630-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794518578" status: 202 len: 0 microversion: 2.1 time: 0.160847 Feb 12 21:25:25.053938 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2661/5182] 10.222.0.31 () {58 vars in 1220 bytes} [Sat Feb 12 21:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794518578 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:25:44.605734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1147838865", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "3056d90f-d42e-4df0-99f3-32e068e8afa8"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:44.711210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] validate_networks() for [('3056d90f-d42e-4df0-99f3-32e068e8afa8', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:25:45.755094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:25:45.755690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:25:45.756118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:25:45.757443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:25:45.760129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:25:45.785226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:45.785226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:45.785226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:45.785226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:45.831026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Getting quotas for project a2d180f06cfb411eb0ef364c5b2ef81b. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:25:45.841463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Getting quotas for user f499c374dcf34238a9b7394f3c592f7c and project a2d180f06cfb411eb0ef364c5b2ef81b. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:25:45.867898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:25:45.870559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:25:45.992332 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d44c9df-5fde-4028-91b0-b59dfabc1535 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.880100 Feb 12 21:25:45.994026 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2522/5183] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:25:46.006026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb970676-a446-4c1d-9c64-3937d5ccb71e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:46.007023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb970676-a446-4c1d-9c64-3937d5ccb71e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:46.107077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb970676-a446-4c1d-9c64-3937d5ccb71e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:46.115974 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb970676-a446-4c1d-9c64-3937d5ccb71e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1217 microversion: 2.1 time: 0.115165 Feb 12 21:25:46.116945 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2662/5184] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:45 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:47.134591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ecfaf1a-c623-40d1-a610-2b3f7fcf5798 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:47.136366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ecfaf1a-c623-40d1-a610-2b3f7fcf5798 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:47.276645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ecfaf1a-c623-40d1-a610-2b3f7fcf5798 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:47.286623 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ecfaf1a-c623-40d1-a610-2b3f7fcf5798 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1217 microversion: 2.1 time: 0.157147 Feb 12 21:25:47.299234 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2523/5185] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:47 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:48.308230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:48.310599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:48.338747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:48.344559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:48.347271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:48.351392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:48.549823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:48.560440 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0055ee54-8985-42de-b646-27acc00fc92e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1269 microversion: 2.1 time: 0.257374 Feb 12 21:25:48.573941 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2663/5186] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:48 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1269 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:49.593180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:49.602003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:49.612146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:49.613492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:49.622927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:49.623507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:49.876423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:49.892601 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ff08eb8e-378d-446b-a693-1099ceccd845 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1275 microversion: 2.1 time: 0.311955 Feb 12 21:25:49.893858 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2524/5187] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:49 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1275 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:50.915717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:50.916960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:50.928177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:50.933096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:50.934592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:50.935483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:51.629783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:51.646465 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c502a1f6-e261-4a6f-a181-db1eaa832cc2 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1275 microversion: 2.1 time: 0.738614 Feb 12 21:25:51.649414 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2664/5188] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:50 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1275 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:52.677334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:52.678095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:52.690287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:52.696260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:52.697141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:52.697622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:53.601632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:53.615187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d1906ce9-9eb1-433c-8511-1ce3a893c750 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 0.952095 Feb 12 21:25:53.617093 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2525/5189] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:52 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:54.634482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:54.645534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:54.649279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:54.651774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:54.661588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:54.664469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:54.869408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1231470f-3157-4155-b492-142df14fc2b8 req-ff15f785-1a5e-44bd-b887-ec34654bfba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7f353c-e294-4694-84c9-8e2b3f3268f6", "tag": "88886a31-ecd4-4ea6-b1fe-27f452ea98e3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:25:54.871993 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:25:54.871993 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:25:54.887011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1231470f-3157-4155-b492-142df14fc2b8 req-ff15f785-1a5e-44bd-b887-ec34654bfba1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:54.888480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1231470f-3157-4155-b492-142df14fc2b8 req-ff15f785-1a5e-44bd-b887-ec34654bfba1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:54.912365 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1231470f-3157-4155-b492-142df14fc2b8 req-ff15f785-1a5e-44bd-b887-ec34654bfba1 service nova] Creating event network-changed:88886a31-ecd4-4ea6-b1fe-27f452ea98e3 for instance 1f7f353c-e294-4694-84c9-8e2b3f3268f6 on nch2-master-1 Feb 12 21:25:54.945374 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1231470f-3157-4155-b492-142df14fc2b8 req-ff15f785-1a5e-44bd-b887-ec34654bfba1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082144 Feb 12 21:25:54.947880 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2526/5190] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:25:55.457303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:55.466363 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63a079a1-8113-4455-8e1b-2ee481c15dae tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 0.838077 Feb 12 21:25:55.474068 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2665/5191] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:54 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:56.499054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:56.500224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:56.527609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:56.532872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:56.534199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:56.535085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:56.970324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:57.001296 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd407112-124c-4b14-8049-98af0a684497 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 0.510498 Feb 12 21:25:57.002020 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2527/5192] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:56 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:58.031743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:58.032350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:58.063547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:58.064041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:58.068174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:58.069072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:58.816067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:25:58.847254 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5421ce4e-c3c8-4fe6-aa51-d254e2f0f55d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 0.818564 Feb 12 21:25:58.851845 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2666/5193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:58 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:25:59.865261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:25:59.865829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:25:59.876060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:59.878780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:25:59.879675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:25:59.880162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:00.994291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:01.010466 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72042e47-2345-4b63-99f0-e05092005b82 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 1.148915 Feb 12 21:26:01.011385 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2528/5194] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:25:59 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:02.028166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:02.028763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:02.048779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:02.049225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:02.050129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:02.050567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:02.606476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:02.621846 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-347843bc-f769-4103-8a42-b6e963e9ea48 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 0.597512 Feb 12 21:26:02.641399 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2667/5195] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:02 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:03.643301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:03.644184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:03.666267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:03.666890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:03.669666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:03.670176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:04.279478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:04.288943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef0072d8-2760-4896-b8c2-953a18c67030 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 0.653517 Feb 12 21:26:04.292504 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2529/5196] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:03 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:04.989991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4a376151-900f-487b-ad63-64c8f3226053 req-a1a8e547-06d8-489c-afc6-377c847520a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7f353c-e294-4694-84c9-8e2b3f3268f6", "name": "network-vif-plugged", "status": "completed", "tag": "88886a31-ecd4-4ea6-b1fe-27f452ea98e3"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:04.992683 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:04.992683 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:05.007307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4a376151-900f-487b-ad63-64c8f3226053 req-a1a8e547-06d8-489c-afc6-377c847520a5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:05.012971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4a376151-900f-487b-ad63-64c8f3226053 req-a1a8e547-06d8-489c-afc6-377c847520a5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:05.055174 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4a376151-900f-487b-ad63-64c8f3226053 req-a1a8e547-06d8-489c-afc6-377c847520a5 service nova] Creating event network-vif-plugged:88886a31-ecd4-4ea6-b1fe-27f452ea98e3 for instance 1f7f353c-e294-4694-84c9-8e2b3f3268f6 on nch2-master-1 Feb 12 21:26:05.085739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4a376151-900f-487b-ad63-64c8f3226053 req-a1a8e547-06d8-489c-afc6-377c847520a5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097393 Feb 12 21:26:05.086369 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2668/5197] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:26:05.309162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:05.309885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:05.324395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:05.324931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:05.332637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:05.333453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:06.802480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:06.818578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c29d46ff-44ff-4caf-86ca-258c1ec66bac tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1317 microversion: 2.1 time: 1.508348 Feb 12 21:26:06.819838 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2530/5198] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:05 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1317 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:07.837000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:07.838346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:07.851733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:07.857066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:07.864238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:07.864238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.370589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:08.383718 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb54da99-7ab3-4ac3-bb91-001033f10036 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1505 microversion: 2.1 time: 0.551167 Feb 12 21:26:08.401065 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2669/5199] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:07 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:08.422252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:08.422885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:08.442474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.442935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.443759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.444182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.510007 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-26e4ff2f-7cca-43fa-a7e9-d6dd74bb565b tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6/ips" status: 200 len: 108 microversion: 2.1 time: 0.094904 Feb 12 21:26:08.510606 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2531/5200] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:26:08 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6/ips => generated 108 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:08.522987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:08.523792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:08.541977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.542705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.546605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.547932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.609113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3535e3fe-f015-463e-99ed-d64930fd6b92 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6/ips" status: 200 len: 108 microversion: 2.1 time: 0.089910 Feb 12 21:26:08.609997 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2670/5201] 10.222.0.31 () {58 vars in 1247 bytes} [Sat Feb 12 21:26:08 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6/ips => generated 108 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:26:08.624472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:08.625291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:08.640622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.642288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.643707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.646639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.692370 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8726553c-9f9b-43cd-a6b7-b334abe9c5f5 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6/ips/tempest-ServerAddressesTestJSON-740380941-network" status: 200 len: 93 microversion: 2.1 time: 0.076233 Feb 12 21:26:08.693714 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2532/5202] 10.222.0.31 () {58 vars in 1397 bytes} [Sat Feb 12 21:26:08 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6/ips/tempest-ServerAddressesTestJSON-740380941-network => generated 93 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:26:08.708878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:08.709961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:08.717828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.718653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.720048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:08.720726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:08.783370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:26:09.316993 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fc02c76-187d-4d89-8832-5f179c8e56b4 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 204 len: 0 microversion: 2.1 time: 0.615923 Feb 12 21:26:09.317704 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2671/5203] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:26:08 2022] DELETE /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:26:09.328369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:09.329058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:09.348666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:09.349580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:09.351767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:09.354676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:10.159726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:10.168433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59ba6c2a-6245-43c4-a9e1-10b2e3842eb1 tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1511 microversion: 2.1 time: 0.846014 Feb 12 21:26:10.169027 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2533/5204] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:09 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:11.187354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:11.188675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:11.215814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:11.224176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:11.233201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:11.234081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:11.730993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:11.741392 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00cc6411-cc51-49db-9e51-1760122b6fdd tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1511 microversion: 2.1 time: 0.558727 Feb 12 21:26:11.748624 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2672/5205] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:11 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1511 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:12.354754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7ce3b099-c88c-491e-b525-abd11c8cf961 req-86c52b9c-0151-40fb-b904-7be4e3c6b095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7f353c-e294-4694-84c9-8e2b3f3268f6", "name": "network-vif-deleted", "tag": "88886a31-ecd4-4ea6-b1fe-27f452ea98e3"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:12.356858 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:12.356858 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:26:12.375396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ce3b099-c88c-491e-b525-abd11c8cf961 req-86c52b9c-0151-40fb-b904-7be4e3c6b095 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:12.382962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ce3b099-c88c-491e-b525-abd11c8cf961 req-86c52b9c-0151-40fb-b904-7be4e3c6b095 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:12.432469 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7ce3b099-c88c-491e-b525-abd11c8cf961 req-86c52b9c-0151-40fb-b904-7be4e3c6b095 service nova] Creating event network-vif-deleted:88886a31-ecd4-4ea6-b1fe-27f452ea98e3 for instance 1f7f353c-e294-4694-84c9-8e2b3f3268f6 on nch2-master-1 Feb 12 21:26:12.446898 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7ce3b099-c88c-491e-b525-abd11c8cf961 req-86c52b9c-0151-40fb-b904-7be4e3c6b095 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100824 Feb 12 21:26:12.449697 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2534/5206] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:12.764450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:12.766506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:12.772950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:12.778087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:12.782312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:12.783245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:12.940859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f499c374dcf34238a9b7394f3c592f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d180f06cfb411eb0ef364c5b2ef81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:12.952040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79c26a53-fad5-49bc-a31b-a961a286a73e tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 200 len: 1302 microversion: 2.1 time: 0.189385 Feb 12 21:26:12.953178 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2673/5207] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:12 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 1302 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:13.972596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:13.974257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] [instance: 1f7f353c-e294-4694-84c9-8e2b3f3268f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:13.983621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:13.984513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:13.985564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:13.986199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:14.004053 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] HTTP exception thrown: Instance 1f7f353c-e294-4694-84c9-8e2b3f3268f6 could not be found. Feb 12 21:26:14.005679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] Returning 404 to user: Instance 1f7f353c-e294-4694-84c9-8e2b3f3268f6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:14.007150 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae054fbb-f709-4df5-a046-53dcf031047d tempest-ServerAddressesTestJSON-1427191290 tempest-ServerAddressesTestJSON-1427191290-project] 10.222.0.31 "GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6" status: 404 len: 111 microversion: 2.1 time: 0.041126 Feb 12 21:26:14.008369 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2535/5208] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:13 2022] GET /compute/v2.1/servers/1f7f353c-e294-4694-84c9-8e2b3f3268f6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:17.156168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2056479198", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5fef39ac-97f4-4395-ab0f-a44a2e3c59e5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "17443eb2-4308-410f-a5f4-59d4de5fb120"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:17.319189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] validate_networks() for [('17443eb2-4308-410f-a5f4-59d4de5fb120', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:26:19.651433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:26:19.653307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:26:19.654994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:26:19.657750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:26:19.660184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:26:19.688467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:19.688929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:19.693059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:19.698689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:19.740545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:19.747788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for user cc56a9a0488e44d7935295ed39bfbb46 and project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:19.789018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:26:19.791290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5fef39ac-97f4-4395-ab0f-a44a2e3c59e5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:26:20.048091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4ea9c42-f521-40f5-82e6-917431447a11 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.896200 Feb 12 21:26:20.050323 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2674/5209] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:26:20.060141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-83ea080a-c822-40a6-8ad9-0a5a86a3ebc2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:20.061980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83ea080a-c822-40a6-8ad9-0a5a86a3ebc2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:20.195400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-83ea080a-c822-40a6-8ad9-0a5a86a3ebc2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:20.203286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-83ea080a-c822-40a6-8ad9-0a5a86a3ebc2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1057 microversion: 2.1 time: 0.147354 Feb 12 21:26:20.207256 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2536/5210] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:20 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1057 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:21.225075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1edfdf3a-2931-4a65-8df9-a15878837ded tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:21.227098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1edfdf3a-2931-4a65-8df9-a15878837ded tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:21.332791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1edfdf3a-2931-4a65-8df9-a15878837ded tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:21.347263 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1edfdf3a-2931-4a65-8df9-a15878837ded tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1057 microversion: 2.1 time: 0.125208 Feb 12 21:26:21.348588 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2675/5211] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:21 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1057 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:22.364019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:22.365278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:22.381583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:22.382233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:22.383227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:22.383837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:22.493067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:22.506477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6a76edbe-ef76-4c80-ac8e-48df7a2f3fd6 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1109 microversion: 2.1 time: 0.142678 Feb 12 21:26:22.511868 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2537/5212] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:22 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1109 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:23.529300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:23.532703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:23.551388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:23.551388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:23.552913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:23.554805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:23.761925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:23.771052 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3da4efb1-522c-453d-8cc0-52ae5a773f8e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1127 microversion: 2.1 time: 0.245392 Feb 12 21:26:23.771650 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2676/5213] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:23 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1127 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:24.042361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-320a66d5-643a-4584-a4bd-04a4bdacd3bd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Action: 'create', calling method: .version_select at 0x7fa8fe167550>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-887960575", "policies": ["affinity"]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:24.097713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-320a66d5-643a-4584-a4bd-04a4bdacd3bd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:24.115231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-320a66d5-643a-4584-a4bd-04a4bdacd3bd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:24.288878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-320a66d5-643a-4584-a4bd-04a4bdacd3bd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:24.297559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-320a66d5-643a-4584-a4bd-04a4bdacd3bd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:24.315255 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-320a66d5-643a-4584-a4bd-04a4bdacd3bd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.535348 Feb 12 21:26:24.328578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b67fb0e8-5c34-4753-a81b-2cf2c7b0763f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Action: 'create', calling method: .version_select at 0x7fa8fd872040>, body: {"server_group": {"name": "tempest-server-group-490697151", "policies": ["affinity"]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:24.346514 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2538/5214] 10.222.0.31 () {60 vars in 1173 bytes} [Sat Feb 12 21:26:23 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:24.406887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b67fb0e8-5c34-4753-a81b-2cf2c7b0763f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:24.414350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b67fb0e8-5c34-4753-a81b-2cf2c7b0763f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:24.563982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b67fb0e8-5c34-4753-a81b-2cf2c7b0763f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:24.573137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-b67fb0e8-5c34-4753-a81b-2cf2c7b0763f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:24.603460 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b67fb0e8-5c34-4753-a81b-2cf2c7b0763f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.280057 Feb 12 21:26:24.609345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2677/5215] 10.222.0.31 () {60 vars in 1172 bytes} [Sat Feb 12 21:26:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:24.620247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4f33a653-dc82-4a12-a780-37aba8a7e042 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Action: 'create', calling method: .version_select at 0x7fa907f5e160>, body: {"server_group": {"name": "tempest-server-group-490697151", "policies": ["affinity"]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:24.672505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4f33a653-dc82-4a12-a780-37aba8a7e042 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:24.679313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4f33a653-dc82-4a12-a780-37aba8a7e042 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:24.789851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:24.790901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:24.812912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:24.818853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:24.820654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:24.821266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:24.891231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4f33a653-dc82-4a12-a780-37aba8a7e042 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:24.905585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4f33a653-dc82-4a12-a780-37aba8a7e042 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:24.944843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4f33a653-dc82-4a12-a780-37aba8a7e042 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.329630 Feb 12 21:26:24.953388 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2539/5216] 10.222.0.31 () {60 vars in 1172 bytes} [Sat Feb 12 21:26:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:24.965151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d0b2ce6-c06e-4a50-a483-ad2bfbf6a423 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:25.084079 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d0b2ce6-c06e-4a50-a483-ad2bfbf6a423 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/436a386f-ab58-4d60-82a2-b1ca636a2bdd" status: 204 len: 0 microversion: 2.1 time: 0.128965 Feb 12 21:26:25.084610 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2540/5217] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:24 2022] DELETE /compute/v2.1/os-server-groups/436a386f-ab58-4d60-82a2-b1ca636a2bdd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:26:25.092819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-122b1b8f-034f-47e7-b3e6-8f370fb6bce8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:25.155625 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-122b1b8f-034f-47e7-b3e6-8f370fb6bce8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.066862 Feb 12 21:26:25.168012 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2541/5218] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:26:25 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:25.182117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-45861505-0442-4219-ad10-636e137a0fcd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:25.349246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:25.366242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6064cd2-8404-4bf7-a590-cbdbe506262d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1169 microversion: 2.1 time: 0.575926 Feb 12 21:26:25.367357 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2678/5219] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:24 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1169 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:25.382024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-45861505-0442-4219-ad10-636e137a0fcd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/958b7460-7ca5-4c24-852e-3d4889d0caa4" status: 204 len: 0 microversion: 2.1 time: 0.208585 Feb 12 21:26:25.382698 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2542/5220] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:25 2022] DELETE /compute/v2.1/os-server-groups/958b7460-7ca5-4c24-852e-3d4889d0caa4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:26:25.430911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2789f9ff-5642-4d49-9695-e18f729018e4 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:25.481170 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2789f9ff-5642-4d49-9695-e18f729018e4 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.090142 Feb 12 21:26:25.484077 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2679/5221] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:26:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:25.495156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0641bfc4-6bc0-42d2-ab7e-65bf76e4aaa8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Action: 'create', calling method: .version_select at 0x7fa8fe16daf0>, body: {"server_group": {"name": "tempest-server-group-1316285727", "policies": ["affinity"]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:25.531761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0641bfc4-6bc0-42d2-ab7e-65bf76e4aaa8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:25.542058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0641bfc4-6bc0-42d2-ab7e-65bf76e4aaa8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:25.724223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0641bfc4-6bc0-42d2-ab7e-65bf76e4aaa8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:25.730186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-0641bfc4-6bc0-42d2-ab7e-65bf76e4aaa8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:25.766400 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0641bfc4-6bc0-42d2-ab7e-65bf76e4aaa8 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.274753 Feb 12 21:26:25.767346 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2543/5222] 10.222.0.31 () {60 vars in 1172 bytes} [Sat Feb 12 21:26:25 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:25.778544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ab3b5102-3f2f-433c-9bf4-3c685c45518f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:25.937645 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ab3b5102-3f2f-433c-9bf4-3c685c45518f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/ae7c79a0-a37c-47d1-bb7d-47359d3d2fdc" status: 204 len: 0 microversion: 2.1 time: 0.163663 Feb 12 21:26:25.938893 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2680/5223] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:25 2022] DELETE /compute/v2.1/os-server-groups/ae7c79a0-a37c-47d1-bb7d-47359d3d2fdc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:26:25.960768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ef712f06-e497-4ae7-9a39-08bf085cbf34 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:25.993153 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ef712f06-e497-4ae7-9a39-08bf085cbf34 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.048752 Feb 12 21:26:25.998604 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2544/5224] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:26:25 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:26.007942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ebc03b6c-8da9-4a96-89a5-a67ede86c9d7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Action: 'create', calling method: .version_select at 0x7fa8fd856ee0>, body: {"server_group": {"name": "tempest-server-group-1442719907", "policies": ["anti-affinity"]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:26.028402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ebc03b6c-8da9-4a96-89a5-a67ede86c9d7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:26.036033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ebc03b6c-8da9-4a96-89a5-a67ede86c9d7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:26.287682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ebc03b6c-8da9-4a96-89a5-a67ede86c9d7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:26.303228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ebc03b6c-8da9-4a96-89a5-a67ede86c9d7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_groups'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:26.352311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ebc03b6c-8da9-4a96-89a5-a67ede86c9d7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.348260 Feb 12 21:26:26.360882 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2681/5225] 10.222.0.31 () {60 vars in 1172 bytes} [Sat Feb 12 21:26:26 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:26.368680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f5f80291-c742-4857-8d36-cabcc4ff98da tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:26.383769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:26.384542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:26.393995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:26.394466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:26.395271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:26.395709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:26.534843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f5f80291-c742-4857-8d36-cabcc4ff98da tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/6c035543-3e17-47f8-aebc-a675125d3204" status: 204 len: 0 microversion: 2.1 time: 0.173102 Feb 12 21:26:26.535623 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2545/5226] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:26 2022] DELETE /compute/v2.1/os-server-groups/6c035543-3e17-47f8-aebc-a675125d3204 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:26:26.544253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c0b3b3e-433c-4042-aacf-cfcd5dd22291 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:26.568472 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c0b3b3e-433c-4042-aacf-cfcd5dd22291 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028400 Feb 12 21:26:26.577264 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2546/5227] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:26:26 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:26:26.843231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2067063695", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "2d400d95-ec5f-48f7-ad66-79ff014da04a"}]}, "os:scheduler_hints": {"group": "6847c995-3cbb-4746-98b4-4af8b53f0bb9"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:26.924923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] validate_networks() for [('2d400d95-ec5f-48f7-ad66-79ff014da04a', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:26:26.953435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:26.969504 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-10e3d5df-891b-4868-81eb-f41d484f7083 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1169 microversion: 2.1 time: 0.586652 Feb 12 21:26:26.970159 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2682/5228] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:26 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1169 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:27.988546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:27.989276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:28.019926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:28.022152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:28.024066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:28.024066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:28.434168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:26:28.434665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:26:28.435122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:26:28.435574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:26:28.436400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:26:28.479673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:28.484360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:28.485611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:28.486081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:28.534819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:28.546114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:28.574989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:26:28.581887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:26:28.771047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:28.777115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:28.903001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for project 728db61ca9094fe293a8471317a6d762. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:28.917752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Getting quotas for user af8985ec6f994d97be5efdf7b8e80833 and project 728db61ca9094fe293a8471317a6d762. Resources: {'server_group_members'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:28.944298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:28.961046 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf723e90-6bc3-428c-a6b5-21c6966bcdcf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122149 Feb 12 21:26:28.962477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2547/5229] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:26:28.967684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-502b826d-9646-4c16-a55c-2e3013a6938b req-5aadaf78-8142-4dc9-b836-d8f7c721ffc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035ff5e-f64d-4306-9b3d-33601a168720", "tag": "6e1f4d04-fb0d-4afc-8f41-bbfb4f641a55"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:28.970340 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:28.970340 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:26:28.973181 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f697acce-5821-4f4d-8427-72407875eb2f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1169 microversion: 2.1 time: 0.975955 Feb 12 21:26:28.976135 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2683/5230] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:27 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1169 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:28.991099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea2b7666-004f-4a1b-8dae-9c5bdb23f669 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:28.991682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-502b826d-9646-4c16-a55c-2e3013a6938b req-5aadaf78-8142-4dc9-b836-d8f7c721ffc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:28.992103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-502b826d-9646-4c16-a55c-2e3013a6938b req-5aadaf78-8142-4dc9-b836-d8f7c721ffc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:28.997593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea2b7666-004f-4a1b-8dae-9c5bdb23f669 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:29.023596 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-502b826d-9646-4c16-a55c-2e3013a6938b req-5aadaf78-8142-4dc9-b836-d8f7c721ffc6 service nova] Creating event network-changed:6e1f4d04-fb0d-4afc-8f41-bbfb4f641a55 for instance b035ff5e-f64d-4306-9b3d-33601a168720 on nch2-master-1 Feb 12 21:26:29.030351 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-502b826d-9646-4c16-a55c-2e3013a6938b req-5aadaf78-8142-4dc9-b836-d8f7c721ffc6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065732 Feb 12 21:26:29.031516 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2548/5231] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:29.132579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ea2b7666-004f-4a1b-8dae-9c5bdb23f669 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:29.142753 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea2b7666-004f-4a1b-8dae-9c5bdb23f669 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1213 microversion: 2.1 time: 0.162179 Feb 12 21:26:29.147165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2684/5232] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:28 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:29.995986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:29.997381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:30.017840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:30.019041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:30.022384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:30.024493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:30.161591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a697188-0eec-4780-867b-7ddf8069b22d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:30.162300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a697188-0eec-4780-867b-7ddf8069b22d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:30.240142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a697188-0eec-4780-867b-7ddf8069b22d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:30.247891 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a697188-0eec-4780-867b-7ddf8069b22d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1213 microversion: 2.1 time: 0.090084 Feb 12 21:26:30.258660 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2685/5233] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:30 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:30.317065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:30.327716 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5631f070-20e2-4ae0-b9fc-a6bf0ecb9778 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1169 microversion: 2.1 time: 0.338514 Feb 12 21:26:30.333440 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2549/5234] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:29 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1169 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:31.267127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:31.269466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:31.287646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:31.289584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:31.290428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:31.293515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:31.348447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:31.348447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:31.360943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:31.362389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:31.364308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:31.367359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:31.460493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:31.480732 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d1bd2925-3c8a-4393-aae3-c943f0ea2958 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1209 microversion: 2.1 time: 0.219051 Feb 12 21:26:31.487031 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2686/5235] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:31 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1209 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:32.007805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:32.024127 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d197997-864f-4067-a121-b2ebffdc0cd7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1169 microversion: 2.1 time: 0.683925 Feb 12 21:26:32.025294 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2550/5236] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:31 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1169 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:32.505011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:32.510740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:32.521169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:32.522429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:32.526166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:32.526166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:32.635064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:32.645832 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d6023dd-115e-4382-af9b-fdb52978da7e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1273 microversion: 2.1 time: 0.146033 Feb 12 21:26:32.665742 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2687/5237] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:32 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:33.041958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:33.042586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:33.062096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:33.065208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:33.065208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:33.065208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:33.415597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:33.428419 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c8e9186-7ccb-4798-bddb-c8abc599f3ff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1215 microversion: 2.1 time: 0.390023 Feb 12 21:26:33.428815 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2551/5238] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:33 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:33.663674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:33.664935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:33.672245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:33.672706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:33.673907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:33.674306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:34.056317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:34.071370 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ec6f75e-9af6-45ab-9fa1-65ec43d72ce7 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.411425 Feb 12 21:26:34.083072 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2688/5239] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:33 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:34.456538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:34.457836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:34.472644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:34.473182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:34.474096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:34.474907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:34.741773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:34.751599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-551a8b66-9371-4592-a530-d2bd0ff63cb3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 0.308218 Feb 12 21:26:34.764887 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2552/5240] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:34 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:34.884835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f095c88b-4cbb-4a9c-90e6-c5c24d28eaa9 req-18d5c580-a6b9-4315-9b48-d06fc8bab98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e5319d-f792-40d2-b911-7f06300475ba", "tag": "79333068-c2d8-461b-ae55-4351994e694a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:34.886549 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:34.886549 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:34.897998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f095c88b-4cbb-4a9c-90e6-c5c24d28eaa9 req-18d5c580-a6b9-4315-9b48-d06fc8bab98f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:34.898456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f095c88b-4cbb-4a9c-90e6-c5c24d28eaa9 req-18d5c580-a6b9-4315-9b48-d06fc8bab98f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:34.921339 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f095c88b-4cbb-4a9c-90e6-c5c24d28eaa9 req-18d5c580-a6b9-4315-9b48-d06fc8bab98f service nova] Creating event network-changed:79333068-c2d8-461b-ae55-4351994e694a for instance 06e5319d-f792-40d2-b911-7f06300475ba on nch1-master-1 Feb 12 21:26:34.927796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f095c88b-4cbb-4a9c-90e6-c5c24d28eaa9 req-18d5c580-a6b9-4315-9b48-d06fc8bab98f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046418 Feb 12 21:26:34.928335 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2689/5241] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:35.090310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:35.091041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:35.107559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:35.114100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:35.115123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:35.115807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:35.476757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:35.484967 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4749027b-7d67-4fb0-adde-eec91e4acf80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.398140 Feb 12 21:26:35.496039 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2553/5242] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:35 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:35.772552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:35.779182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:35.780652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:35.781324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:35.782347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:35.782978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:36.336894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:36.348437 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-17438c4f-782b-4372-bbdb-127edd38b70b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 0.581002 Feb 12 21:26:36.362793 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2690/5243] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:35 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:36.502491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:36.504089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:36.512243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:36.513176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:36.515381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:36.516086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:37.190332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:37.202598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0d59d14-f557-4b58-9828-83ac8e5b76a1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.704075 Feb 12 21:26:37.206471 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2554/5244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:36 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:37.372488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:37.373818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:37.385317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:37.392730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:37.398341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:37.399449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:37.741515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:37.753628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f92b9d6-7ef7-4bbf-a0c0-1183df3aa843 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 0.385808 Feb 12 21:26:37.754784 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2691/5245] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:37 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:37.875821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1420303702", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "f96b466b-384a-4a15-836c-202ee42be0f5"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:37.948163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] validate_networks() for [('f96b466b-384a-4a15-836c-202ee42be0f5', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:26:38.222067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:38.222951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:38.229300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:38.229979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:38.230932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:38.231558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:38.429897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:38.438330 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58786248-e822-41ff-88bf-d13ae8382892 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.219800 Feb 12 21:26:38.439519 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2692/5246] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:38 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:38.775040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:38.776660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:38.784425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:38.784886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:38.785988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:38.787006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:39.024383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:39.033510 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5d63f47-04fe-44ae-b83d-97b92e3f40b2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 0.264515 Feb 12 21:26:39.043727 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2693/5247] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:38 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:39.052477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:26:39.055144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:26:39.055856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:26:39.056657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:26:39.057289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:26:39.071990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:39.072447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:39.073275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:39.073741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:39.092181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Getting quotas for project 338dee3698c944ca8240d48553a4e629. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:39.097491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Getting quotas for user 580ae0f6575f42b49aa02349ba5c95b3 and project 338dee3698c944ca8240d48553a4e629. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:39.110762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:26:39.113409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:26:39.238159 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d82f82e3-2d34-4cbe-ad5e-e3260d07922c tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590446 Feb 12 21:26:39.245837 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2555/5248] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:26:39.249599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1749752b-a1de-4c95-84c9-8d692cda33aa tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:39.250222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1749752b-a1de-4c95-84c9-8d692cda33aa tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:39.373981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1749752b-a1de-4c95-84c9-8d692cda33aa tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:39.382968 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1749752b-a1de-4c95-84c9-8d692cda33aa tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1214 microversion: 2.1 time: 0.136987 Feb 12 21:26:39.384216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2694/5249] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:39 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:39.456239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:39.457071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:39.476828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:39.479900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:39.484499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:39.486905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:39.775063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:39.784081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-406d4a65-6119-4772-9f2a-b256688c412a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.331646 Feb 12 21:26:39.784662 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2556/5250] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:39 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:40.051361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:40.051973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:40.080332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:40.086218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:40.087639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:40.088214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:40.401125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f9edf946-d5bb-4a62-9ce6-5e05c2359f97 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:40.401900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:40.402531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f9edf946-d5bb-4a62-9ce6-5e05c2359f97 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:40.410117 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7cf8e58e-79cd-4d93-985a-7da484871551 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 0.362386 Feb 12 21:26:40.413000 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2695/5251] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:40 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:40.480641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f9edf946-d5bb-4a62-9ce6-5e05c2359f97 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:40.488431 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f9edf946-d5bb-4a62-9ce6-5e05c2359f97 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1214 microversion: 2.1 time: 0.091462 Feb 12 21:26:40.490291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2557/5252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:40 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:40.802112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:40.803946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:40.811247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:40.811788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:40.812699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:40.813204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:41.397007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:41.406770 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-28a419f5-4d3c-40db-858e-8a206407099d tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.610229 Feb 12 21:26:41.407362 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2696/5253] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:40 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:41.429215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:41.429885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:41.450400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:41.455466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:41.456477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:41.456971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:41.510474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:41.511102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:41.531416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:41.533322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:41.534215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:41.534645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:41.715308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:41.725618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80a554ae-a0ad-409b-9d33-58f05224a387 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1266 microversion: 2.1 time: 0.222518 Feb 12 21:26:41.726648 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2697/5254] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:41 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:42.056702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-eef5c7be-8cad-45b1-835d-c112030a6012 req-9b4d6184-06ea-4116-86fe-079a60105eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035ff5e-f64d-4306-9b3d-33601a168720", "name": "network-vif-plugged", "status": "completed", "tag": "6e1f4d04-fb0d-4afc-8f41-bbfb4f641a55"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:42.058693 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:42.058693 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:42.073381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eef5c7be-8cad-45b1-835d-c112030a6012 req-9b4d6184-06ea-4116-86fe-079a60105eee service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:42.080269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-eef5c7be-8cad-45b1-835d-c112030a6012 req-9b4d6184-06ea-4116-86fe-079a60105eee service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:42.103766 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-eef5c7be-8cad-45b1-835d-c112030a6012 req-9b4d6184-06ea-4116-86fe-079a60105eee service nova] Creating event network-vif-plugged:6e1f4d04-fb0d-4afc-8f41-bbfb4f641a55 for instance b035ff5e-f64d-4306-9b3d-33601a168720 on nch2-master-1 Feb 12 21:26:42.125720 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-eef5c7be-8cad-45b1-835d-c112030a6012 req-9b4d6184-06ea-4116-86fe-079a60105eee service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070348 Feb 12 21:26:42.128740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2698/5255] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:42.427503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:42.429260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:42.437567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:42.438397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:42.439799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:42.440567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:42.538680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:42.554147 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-282f34e7-4429-41f6-ab6a-2c08dfedfc1a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 1.128464 Feb 12 21:26:42.554778 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2558/5256] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:41 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:42.742968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:42.744027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:42.752876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:42.754773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:42.755728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:42.756178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:42.850116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:42.863223 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1ad6cd80-620e-4684-a02f-67fd0ed8dd92 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.441032 Feb 12 21:26:42.863947 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2699/5257] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:42 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:42.985737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:42.996475 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a6e22e0-b933-4226-b42b-0cff9fcf3dfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1272 microversion: 2.1 time: 0.257152 Feb 12 21:26:43.006350 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2559/5258] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:42 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:43.573109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:43.574975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:43.584664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:43.586507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:43.586507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:43.586979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:43.880422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:43.881179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:43.892249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:43.895520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:43.900634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:43.901846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:43.909107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:43.917459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-17db3881-951a-42d8-9e37-55fa1aace6b7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1203 microversion: 2.1 time: 0.348169 Feb 12 21:26:43.927237 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2700/5259] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:43 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1203 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:44.024890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:44.025701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:44.039647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:44.041375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:44.043007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:44.045543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:44.178547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:44.193381 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-729e8b16-cca2-451f-9591-d149be0c6177 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1272 microversion: 2.1 time: 0.170814 Feb 12 21:26:44.194573 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2701/5260] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:44 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:44.209722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a61a763d-1148-4ef5-97f9-991127b09b5f req-e4a8439b-49e6-4d46-8606-89713e741b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e5319d-f792-40d2-b911-7f06300475ba", "name": "network-vif-plugged", "status": "completed", "tag": "79333068-c2d8-461b-ae55-4351994e694a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:44.212955 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:44.212955 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:44.224117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a61a763d-1148-4ef5-97f9-991127b09b5f req-e4a8439b-49e6-4d46-8606-89713e741b8f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:44.225005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a61a763d-1148-4ef5-97f9-991127b09b5f req-e4a8439b-49e6-4d46-8606-89713e741b8f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:44.242021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a61a763d-1148-4ef5-97f9-991127b09b5f req-e4a8439b-49e6-4d46-8606-89713e741b8f service nova] Creating event network-vif-plugged:79333068-c2d8-461b-ae55-4351994e694a for instance 06e5319d-f792-40d2-b911-7f06300475ba on nch1-master-1 Feb 12 21:26:44.249752 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a61a763d-1148-4ef5-97f9-991127b09b5f req-e4a8439b-49e6-4d46-8606-89713e741b8f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048346 Feb 12 21:26:44.250921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2702/5261] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:44.751633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:44.771848 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-adbfbd91-08ff-48fe-959e-c4d02678dbaf tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.895045 Feb 12 21:26:44.773082 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2560/5262] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:43 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:44.939609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:44.941054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:44.954873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:44.957292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:44.959292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:44.962088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:45.205866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:45.210453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:45.211229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:45.220964 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba5df938-29ab-4a34-82f3-18827f639bde tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1390 microversion: 2.1 time: 0.289670 Feb 12 21:26:45.221959 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2703/5263] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:44 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1390 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:45.236120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:45.237158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:45.238279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:45.239795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:45.259240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:45.260530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:45.280820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:45.282941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:45.295864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:45.299729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:45.721279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:45.730139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce19a64d-0984-4165-ac39-171d0605d83b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1390 microversion: 2.1 time: 0.484715 Feb 12 21:26:45.742380 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2704/5264] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:45 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1390 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:45.749011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:45.749966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:45.757081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:45.758260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:45.759499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:45.760187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:46.024165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:46.040265 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-328e2862-06e3-44f3-ba15-fd5d4ecc316d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1390 microversion: 2.1 time: 0.295629 Feb 12 21:26:46.053145 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2705/5265] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:45 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1390 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:46.063380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:46.063380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:46.079544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:46.080317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:46.082130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:46.082775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:46.457799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:46.469535 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c9c22133-d9fb-4b5e-b6de-4111d1c834b0 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1313 microversion: 2.1 time: 0.414912 Feb 12 21:26:46.470277 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2706/5266] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:46 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:46.475158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:46.475844 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:46.482473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:46.483157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:46.484134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:46.484992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:46.534508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:46.545983 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-502ab820-11fe-4d5c-9590-ad6896ac2a3f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 1.337133 Feb 12 21:26:46.564054 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2561/5267] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:45 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:46.574648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:26:47.220863 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-779a1cfb-745c-4ede-b7c3-963c30e965dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 204 len: 0 microversion: 2.1 time: 0.749055 Feb 12 21:26:47.221897 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2707/5268] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:26:46 2022] DELETE /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:26:47.229543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:47.230176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:47.242298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.242767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.243585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.246231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.488302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:47.489123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:47.501205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.505505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.508221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.508221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.681608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:47.694171 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93d10465-f80d-48b3-bdda-eb079b452950 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1396 microversion: 2.1 time: 0.468205 Feb 12 21:26:47.707908 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2562/5269] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:47 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1396 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:47.719694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:47.741726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:47.751100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.754484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.758286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.759045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.905669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:47.913647 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b513dae4-6ecb-4ffb-97a5-9fbd10283c71 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1496 microversion: 2.1 time: 0.430214 Feb 12 21:26:47.914231 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2708/5270] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:47 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1496 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:47.939152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd49fb3d-6409-456f-b44c-e4b9d65bcca9 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:47.954956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.server_groups [None req-cd49fb3d-6409-456f-b44c-e4b9d65bcca9 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Querying cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) for 1 instances {{(pid=141727) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 12 21:26:47.955878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd49fb3d-6409-456f-b44c-e4b9d65bcca9 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.956331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd49fb3d-6409-456f-b44c-e4b9d65bcca9 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.974023 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd49fb3d-6409-456f-b44c-e4b9d65bcca9 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups/6847c995-3cbb-4746-98b4-4af8b53f0bb9" status: 200 len: 221 microversion: 2.1 time: 0.040774 Feb 12 21:26:47.974841 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2709/5271] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:26:47 2022] GET /compute/v2.1/os-server-groups/6847c995-3cbb-4746-98b4-4af8b53f0bb9 => generated 221 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:47.984957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:47.985489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:47.991457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.991909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:47.992694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:47.993227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:48.025825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:26:48.262435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:48.283789 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7c06e90c-2bed-4ca1-ac91-dd5d0227c569 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 0.573292 Feb 12 21:26:48.285735 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2563/5272] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:47 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:48.396444 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de4bbfdb-359b-45ec-9eb0-7e9cb2be9f80 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 204 len: 0 microversion: 2.1 time: 0.415245 Feb 12 21:26:48.397050 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2710/5273] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:26:47 2022] DELETE /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:26:48.405340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:48.406080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:48.412727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:48.413282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:48.414169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:48.414845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:48.521423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-312075cd-1293-42e0-a784-b684c93236ff req-b8b25088-af2a-4240-8d5f-18962d75a255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae856f2-36ae-44d3-9c25-fd798d8dc096", "tag": "bb7d08d8-ac0e-4122-9259-758f1b442408"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:48.525240 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:48.525240 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:48.537399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-312075cd-1293-42e0-a784-b684c93236ff req-b8b25088-af2a-4240-8d5f-18962d75a255 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:48.541743 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-312075cd-1293-42e0-a784-b684c93236ff req-b8b25088-af2a-4240-8d5f-18962d75a255 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:48.561433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-312075cd-1293-42e0-a784-b684c93236ff req-b8b25088-af2a-4240-8d5f-18962d75a255 service nova] Creating event network-changed:bb7d08d8-ac0e-4122-9259-758f1b442408 for instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096 on nch2-master-1 Feb 12 21:26:48.568301 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-312075cd-1293-42e0-a784-b684c93236ff req-b8b25088-af2a-4240-8d5f-18962d75a255 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051298 Feb 12 21:26:48.569634 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2711/5274] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:26:48.725940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:48.730959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:48.754711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:48.756880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:48.757798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:48.758243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:49.079005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:49.088941 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f428f9f3-24ae-4351-a466-36efb616c90f tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1502 microversion: 2.1 time: 0.687277 Feb 12 21:26:49.089738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2564/5275] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:48 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1502 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:49.170644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:49.178590 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-200020d6-2f94-48b8-9ab6-3f0127a89630 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1396 microversion: 2.1 time: 0.468425 Feb 12 21:26:49.187873 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2712/5276] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:48 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1396 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:49.301846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:49.302664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:49.323577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:49.324150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:49.327819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:49.335449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:49.946688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-78659788", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "57ed5d22-bc4f-4292-a243-27a5ebb4ba3c"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:50.036601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] validate_networks() for [('57ed5d22-bc4f-4292-a243-27a5ebb4ba3c', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:26:50.297926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:50.310971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d4f69caf-1659-4945-8e3e-8e74b547bdfb tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 1.012169 Feb 12 21:26:50.312653 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2565/5277] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:49 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:50.321263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:50.321263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:50.331340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:50.332481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:50.333900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:50.334768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.016216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:51.027078 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-742d204a-fbca-451c-b0ce-cb03e79272dc tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1502 microversion: 2.1 time: 0.712861 Feb 12 21:26:51.028063 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2566/5278] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:50 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1502 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:51.034183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:51.035265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:51.043090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.045219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.046404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.046721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.195785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:51.212787 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffb77dc9-7ccb-4ae4-96b4-2d96d0649d27 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1354 microversion: 2.1 time: 0.179228 Feb 12 21:26:51.216938 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2567/5279] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:51 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:51.266691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:26:51.267751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:26:51.268245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:26:51.268922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:26:51.272026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:26:51.288183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.291587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.291587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.291587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.331585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:51.333448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:51.347493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Getting quotas for project 67268b7cb701423a97c6d14f1de05645. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:51.348585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.349405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.350512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.351183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.363741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Getting quotas for user fc64bc14eb984bba9687128d14ac1f47 and project 67268b7cb701423a97c6d14f1de05645. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:51.406759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:26:51.410103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:26:51.580765 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-debd302f-f555-445d-8620-86246356690c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639094 Feb 12 21:26:51.581579 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2713/5280] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:26:51.592403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-69ae561e-1497-44c0-b435-7f2c7a960ea1 req-c4fec89f-d05f-422b-8268-cd3b7701389e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035ff5e-f64d-4306-9b3d-33601a168720", "name": "network-vif-deleted", "tag": "6e1f4d04-fb0d-4afc-8f41-bbfb4f641a55"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:51.594257 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:51.594257 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:51.608092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-69ae561e-1497-44c0-b435-7f2c7a960ea1 req-c4fec89f-d05f-422b-8268-cd3b7701389e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:51.610265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-69ae561e-1497-44c0-b435-7f2c7a960ea1 req-c4fec89f-d05f-422b-8268-cd3b7701389e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:51.629740 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-69ae561e-1497-44c0-b435-7f2c7a960ea1 req-c4fec89f-d05f-422b-8268-cd3b7701389e service nova] Creating event network-vif-deleted:6e1f4d04-fb0d-4afc-8f41-bbfb4f641a55 for instance b035ff5e-f64d-4306-9b3d-33601a168720 on nch2-master-1 Feb 12 21:26:51.636654 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-69ae561e-1497-44c0-b435-7f2c7a960ea1 req-c4fec89f-d05f-422b-8268-cd3b7701389e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048803 Feb 12 21:26:51.637391 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2714/5281] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:51.643891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5abeaf8f-b35d-45c3-9029-696554ea50eb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:51.646170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5abeaf8f-b35d-45c3-9029-696554ea50eb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:51.735509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5abeaf8f-b35d-45c3-9029-696554ea50eb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:51.758304 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5abeaf8f-b35d-45c3-9029-696554ea50eb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1212 microversion: 2.1 time: 0.115736 Feb 12 21:26:51.775647 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2715/5282] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:51 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1212 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:51.853737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:51.870350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-332d6c8d-c91f-42f0-9582-b5cd9a63c299 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 0.542634 Feb 12 21:26:51.882194 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2568/5283] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:51 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:52.045665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:52.046581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:52.061609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:52.067709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:52.067709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:52.067709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:52.232262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:52.232987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:52.248291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:52.248758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:52.249714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:52.250497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:52.263204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:52.285242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7429c601-6b8a-465e-baf0-37f4abf81025 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1460 microversion: 2.1 time: 0.240455 Feb 12 21:26:52.289115 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2716/5284] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:52 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1460 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:52.399074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:52.451606 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-384ec71b-cb3b-4690-b04a-d464ed243446 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 200 len: 1188 microversion: 2.1 time: 0.199407 Feb 12 21:26:52.452893 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2569/5285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:52 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 1188 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:52.784193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5461aeab-2659-404b-9607-a30406815deb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:52.785166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5461aeab-2659-404b-9607-a30406815deb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:52.898578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:52.899299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:52.907824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:52.908282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:52.913857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:52.919674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:52.990389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5461aeab-2659-404b-9607-a30406815deb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:52.998369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5461aeab-2659-404b-9607-a30406815deb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1212 microversion: 2.1 time: 0.217948 Feb 12 21:26:53.011338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2717/5286] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:52 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1212 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:53.308570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:53.311299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:53.320937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:53.321837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:53.323081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:53.323739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:53.402733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:53.403428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:53.405760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lazy-loading 'fault' on Instance uuid 06e5319d-f792-40d2-b911-7f06300475ba {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:26:53.585007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8985ec6f994d97be5efdf7b8e80833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728db61ca9094fe293a8471317a6d762', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:53.594044 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3426eb8f-4c55-44a3-b39a-db4f29dd763c tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 200 len: 1303 microversion: 2.1 time: 0.290101 Feb 12 21:26:53.594937 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2718/5287] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:53 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 1303 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:53.602044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:53.602966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:53.619855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:53.620581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:53.621939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:53.622663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:53.642441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance b035ff5e-f64d-4306-9b3d-33601a168720 could not be found. Feb 12 21:26:53.643527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance b035ff5e-f64d-4306-9b3d-33601a168720 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:53.645030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-18723085-48d5-430f-9c12-6e9aa3a39b57 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 404 len: 111 microversion: 2.1 time: 0.047518 Feb 12 21:26:53.647072 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2719/5288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:53 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:53.687076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f329baf5-0039-4060-b492-85b4baa99f34 req-2e621023-bc97-42ed-8167-2813255cfce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e5319d-f792-40d2-b911-7f06300475ba", "name": "network-vif-deleted", "tag": "79333068-c2d8-461b-ae55-4351994e694a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:53.690214 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:53.690214 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:26:53.699978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f329baf5-0039-4060-b492-85b4baa99f34 req-2e621023-bc97-42ed-8167-2813255cfce4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:53.701802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f329baf5-0039-4060-b492-85b4baa99f34 req-2e621023-bc97-42ed-8167-2813255cfce4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:53.719911 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f329baf5-0039-4060-b492-85b4baa99f34 req-2e621023-bc97-42ed-8167-2813255cfce4 service nova] Creating event network-vif-deleted:79333068-c2d8-461b-ae55-4351994e694a for instance 06e5319d-f792-40d2-b911-7f06300475ba on nch1-master-1 Feb 12 21:26:53.746985 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f329baf5-0039-4060-b492-85b4baa99f34 req-2e621023-bc97-42ed-8167-2813255cfce4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062478 Feb 12 21:26:53.749915 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2720/5289] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:54.016174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.017171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:54.029639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:54.036233 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-91c713b3-c895-4f4c-93d2-1c3b534bdc4d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 1.141382 Feb 12 21:26:54.037168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.037856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.038835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.048980 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2570/5290] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:52 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:54.049896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.443161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:54.456197 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9fd41e4a-a39a-4ecc-b43a-4ae20c290329 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1264 microversion: 2.1 time: 0.444295 Feb 12 21:26:54.457109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2721/5291] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:54 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1264 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:54.613508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.614123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:54.621015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.622298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.623894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.624524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.641265 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance 06e5319d-f792-40d2-b911-7f06300475ba could not be found. Feb 12 21:26:54.642076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance 06e5319d-f792-40d2-b911-7f06300475ba could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.643086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9681175e-533a-4424-adcc-5c8495ae2afd tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 404 len: 111 microversion: 2.1 time: 0.033779 Feb 12 21:26:54.643849 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2571/5292] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:54 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:26:54.663872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2aeaa640-8478-4a5a-936c-2e5475745090 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.677906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.server_groups [None req-2aeaa640-8478-4a5a-936c-2e5475745090 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Querying cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) for 1 instances {{(pid=141727) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 12 21:26:54.678790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2aeaa640-8478-4a5a-936c-2e5475745090 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.679397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2aeaa640-8478-4a5a-936c-2e5475745090 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.691569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2aeaa640-8478-4a5a-936c-2e5475745090 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034420 Feb 12 21:26:54.692783 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2722/5293] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:26:54 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:54.705649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0f6a45bd-af4b-416f-b8d2-79a01a14056e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.721910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.compute.server_groups [None req-0f6a45bd-af4b-416f-b8d2-79a01a14056e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Querying cell e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d(cell1) for 1 instances {{(pid=141726) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Feb 12 21:26:54.726175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f6a45bd-af4b-416f-b8d2-79a01a14056e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.726175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f6a45bd-af4b-416f-b8d2-79a01a14056e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.735741 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0f6a45bd-af4b-416f-b8d2-79a01a14056e tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/os-server-groups/6847c995-3cbb-4746-98b4-4af8b53f0bb9" status: 200 len: 183 microversion: 2.1 time: 0.033852 Feb 12 21:26:54.736589 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2572/5294] 10.222.0.31 () {58 vars in 1262 bytes} [Sat Feb 12 21:26:54 2022] GET /compute/v2.1/os-server-groups/6847c995-3cbb-4746-98b4-4af8b53f0bb9 => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:26:54.751295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.751818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:54.761589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.762237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.764866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.765531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.783628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance 06e5319d-f792-40d2-b911-7f06300475ba could not be found. Feb 12 21:26:54.784236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance 06e5319d-f792-40d2-b911-7f06300475ba could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.785267 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-94520ece-60f6-491a-b5aa-e7ed73d8436a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 404 len: 111 microversion: 2.1 time: 0.041989 Feb 12 21:26:54.789420 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2723/5295] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:26:54 2022] DELETE /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:26:54.796381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.797015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] [instance: 06e5319d-f792-40d2-b911-7f06300475ba] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:54.803539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.804228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.805618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:54.806060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:54.823485 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance 06e5319d-f792-40d2-b911-7f06300475ba could not be found. Feb 12 21:26:54.824087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance 06e5319d-f792-40d2-b911-7f06300475ba could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.824980 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-01d03457-d6bc-4be2-8056-1bf96809fd6a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba" status: 404 len: 111 microversion: 2.1 time: 0.032660 Feb 12 21:26:54.825935 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2573/5296] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:54 2022] GET /compute/v2.1/servers/06e5319d-f792-40d2-b911-7f06300475ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:54.834452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac1faec7-e9cc-48f0-ac1f-96b03e8c28d1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.841594 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-ac1faec7-e9cc-48f0-ac1f-96b03e8c28d1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance group 6c035543-3e17-47f8-aebc-a675125d3204 could not be found. Feb 12 21:26:54.842634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac1faec7-e9cc-48f0-ac1f-96b03e8c28d1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance group 6c035543-3e17-47f8-aebc-a675125d3204 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.844073 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac1faec7-e9cc-48f0-ac1f-96b03e8c28d1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/6c035543-3e17-47f8-aebc-a675125d3204" status: 404 len: 117 microversion: 2.1 time: 0.013589 Feb 12 21:26:54.845098 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2724/5297] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:54 2022] DELETE /compute/v2.1/os-server-groups/6c035543-3e17-47f8-aebc-a675125d3204 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:26:54.853107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7282cbb5-3992-40c6-b448-2b0b432b2e9a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.867266 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7282cbb5-3992-40c6-b448-2b0b432b2e9a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance group ae7c79a0-a37c-47d1-bb7d-47359d3d2fdc could not be found. Feb 12 21:26:54.868204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7282cbb5-3992-40c6-b448-2b0b432b2e9a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance group ae7c79a0-a37c-47d1-bb7d-47359d3d2fdc could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.870035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7282cbb5-3992-40c6-b448-2b0b432b2e9a tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/ae7c79a0-a37c-47d1-bb7d-47359d3d2fdc" status: 404 len: 117 microversion: 2.1 time: 0.020880 Feb 12 21:26:54.871564 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2574/5298] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:54 2022] DELETE /compute/v2.1/os-server-groups/ae7c79a0-a37c-47d1-bb7d-47359d3d2fdc => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:54.880614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93c6ac7c-5358-444f-980f-d1ff40cd9dfe tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.888765 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-93c6ac7c-5358-444f-980f-d1ff40cd9dfe tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance group 958b7460-7ca5-4c24-852e-3d4889d0caa4 could not be found. Feb 12 21:26:54.896952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93c6ac7c-5358-444f-980f-d1ff40cd9dfe tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance group 958b7460-7ca5-4c24-852e-3d4889d0caa4 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.896952 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93c6ac7c-5358-444f-980f-d1ff40cd9dfe tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/958b7460-7ca5-4c24-852e-3d4889d0caa4" status: 404 len: 117 microversion: 2.1 time: 0.014256 Feb 12 21:26:54.896952 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2725/5299] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:54 2022] DELETE /compute/v2.1/os-server-groups/958b7460-7ca5-4c24-852e-3d4889d0caa4 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:54.902064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2d4d8dba-7543-48d6-95be-69d7e0336a99 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:54.909877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-2d4d8dba-7543-48d6-95be-69d7e0336a99 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] HTTP exception thrown: Instance group 436a386f-ab58-4d60-82a2-b1ca636a2bdd could not be found. Feb 12 21:26:54.910714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2d4d8dba-7543-48d6-95be-69d7e0336a99 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Returning 404 to user: Instance group 436a386f-ab58-4d60-82a2-b1ca636a2bdd could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:54.911702 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2d4d8dba-7543-48d6-95be-69d7e0336a99 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/436a386f-ab58-4d60-82a2-b1ca636a2bdd" status: 404 len: 117 microversion: 2.1 time: 0.013607 Feb 12 21:26:54.912236 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2575/5300] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:54 2022] DELETE /compute/v2.1/os-server-groups/436a386f-ab58-4d60-82a2-b1ca636a2bdd => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:54.926202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9de1cc89-5361-4c47-bd23-ef7f4333ede1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:55.055075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:55.056001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:55.060247 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9de1cc89-5361-4c47-bd23-ef7f4333ede1 tempest-ServerGroupTestJSON-1733270993 tempest-ServerGroupTestJSON-1733270993-project] 10.222.0.31 "DELETE /compute/v2.1/os-server-groups/6847c995-3cbb-4746-98b4-4af8b53f0bb9" status: 204 len: 0 microversion: 2.1 time: 0.137607 Feb 12 21:26:55.061932 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2726/5301] 10.222.0.31 () {58 vars in 1265 bytes} [Sat Feb 12 21:26:54 2022] DELETE /compute/v2.1/os-server-groups/6847c995-3cbb-4746-98b4-4af8b53f0bb9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:26:55.063176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:55.063698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:55.064569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:55.065176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:55.444205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:55.456944 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d377a88-fbf5-4687-8f7b-24dc91c614ab tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 0.405224 Feb 12 21:26:55.459066 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2576/5302] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:55 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:55.476921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:55.477588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:55.486627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:55.487353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:55.488340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:55.488791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:55.564553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:55.574155 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6eb124ad-f180-493a-be6e-6d7ebbf2dff9 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1270 microversion: 2.1 time: 0.103046 Feb 12 21:26:55.574741 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2727/5303] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:55 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:56.356071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6da6e1e5-fc54-40d8-89d7-48588c9b8ebf req-182fcf06-9616-4e56-89ec-cde60fb98abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae856f2-36ae-44d3-9c25-fd798d8dc096", "name": "network-vif-plugged", "status": "completed", "tag": "bb7d08d8-ac0e-4122-9259-758f1b442408"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:56.360305 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:56.360305 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:26:56.375733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6da6e1e5-fc54-40d8-89d7-48588c9b8ebf req-182fcf06-9616-4e56-89ec-cde60fb98abf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:56.379106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6da6e1e5-fc54-40d8-89d7-48588c9b8ebf req-182fcf06-9616-4e56-89ec-cde60fb98abf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:56.394894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6da6e1e5-fc54-40d8-89d7-48588c9b8ebf req-182fcf06-9616-4e56-89ec-cde60fb98abf service nova] Creating event network-vif-plugged:bb7d08d8-ac0e-4122-9259-758f1b442408 for instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096 on nch2-master-1 Feb 12 21:26:56.400607 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6da6e1e5-fc54-40d8-89d7-48588c9b8ebf req-182fcf06-9616-4e56-89ec-cde60fb98abf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048582 Feb 12 21:26:56.407681 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2577/5304] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:26:56.474160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:56.474766 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:56.485285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:56.490786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:56.493858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:56.493858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:56.593599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:56.595776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:56.611904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:56.612402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:56.613205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:56.614318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:56.745051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:56.758611 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44eab395-5d3c-44f2-bd94-480c7ba3b041 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 0.288458 Feb 12 21:26:56.760920 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2728/5305] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:56 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:57.108470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:57.117823 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98aabce0-0ea4-46eb-aa8a-63e7c31bf0cf tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.530762 Feb 12 21:26:57.118718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2578/5306] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:56 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:26:57.778011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:57.779111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:57.786406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:57.786860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:57.787656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:57.788102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:57.889125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-944fdd81-110a-4c92-bed9-ebb3fa03bf0e req-db17d688-d19c-4f97-81ee-99e951734635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5b018f-87a0-4198-b3b1-346b49ee6bf1", "tag": "b75f5f83-8e7c-4255-9f7b-b748b078e9ef"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:57.891583 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:26:57.891583 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:26:57.905203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-944fdd81-110a-4c92-bed9-ebb3fa03bf0e req-db17d688-d19c-4f97-81ee-99e951734635 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:57.907174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-944fdd81-110a-4c92-bed9-ebb3fa03bf0e req-db17d688-d19c-4f97-81ee-99e951734635 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:57.925925 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-944fdd81-110a-4c92-bed9-ebb3fa03bf0e req-db17d688-d19c-4f97-81ee-99e951734635 service nova] Creating event network-changed:b75f5f83-8e7c-4255-9f7b-b748b078e9ef for instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1 on nch1-master-1 Feb 12 21:26:57.934765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-944fdd81-110a-4c92-bed9-ebb3fa03bf0e req-db17d688-d19c-4f97-81ee-99e951734635 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050195 Feb 12 21:26:57.936336 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2579/5307] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:26:57.994959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:57.996093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:58.024523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:58.027362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:58.030021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:58.030744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:58.063024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance b035ff5e-f64d-4306-9b3d-33601a168720 could not be found. Feb 12 21:26:58.063894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance b035ff5e-f64d-4306-9b3d-33601a168720 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:58.064764 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ca1c8741-5ae7-454b-a7d4-348bd5d28d8a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 404 len: 111 microversion: 2.1 time: 0.085569 Feb 12 21:26:58.065326 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2580/5308] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:26:57 2022] DELETE /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:26:58.073619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:58.074560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: b035ff5e-f64d-4306-9b3d-33601a168720] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:58.083193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:58.083984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:58.085098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:58.085781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:58.103478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance b035ff5e-f64d-4306-9b3d-33601a168720 could not be found. Feb 12 21:26:58.104460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance b035ff5e-f64d-4306-9b3d-33601a168720 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:26:58.105675 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d48fcb8-b693-4295-ac9f-87ccc0069d12 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720" status: 404 len: 111 microversion: 2.1 time: 0.035966 Feb 12 21:26:58.107108 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2581/5309] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:58 2022] GET /compute/v2.1/servers/b035ff5e-f64d-4306-9b3d-33601a168720 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:26:58.145094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:58.149209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:58.172034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:58.172568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:58.178166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:58.179781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:58.548239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:58.559695 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-437778b7-aafe-4b45-b0d4-f7b2415af559 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.427214 Feb 12 21:26:58.560311 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2582/5310] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:58 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:58.917187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:58.928299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a3ece30-cee4-45ff-86c2-fa5edd23976d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1314 microversion: 2.1 time: 1.153844 Feb 12 21:26:58.928890 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2729/5311] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:57 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:59.583103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:59.583959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:59.593339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:59.594030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:59.600810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:59.601407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:59.803666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:26:59.813721 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ceccfce-743f-4312-a067-a26ff71ce47a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.241057 Feb 12 21:26:59.814581 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2583/5312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:59 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:26:59.874555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-949827026", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": "none"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:26:59.926462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:26:59.927018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:26:59.927366 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:26:59.927784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:26:59.928199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:26:59.938033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:59.938493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:59.939320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:59.939764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:59.945620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:26:59.946369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:26:59.953086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:59.953956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:59.954873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:26:59.955674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:26:59.958283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Getting quotas for project 7a7c682ee61c44f7b9859963f0cd7f83. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:26:59.963568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Getting quotas for user 0b0b8b6b87354fb489fc3bd445f4c6cd and project 7a7c682ee61c44f7b9859963f0cd7f83. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:26:59.976630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:26:59.979043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:27:00.180223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:00.188847 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-254dd9c5-c17b-4595-afb3-08b05efd4773 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1499 microversion: 2.1 time: 0.247031 Feb 12 21:27:00.189727 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2584/5313] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:26:59 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1499 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:00.194853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:00.196034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:00.203367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:00.204297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:00.205516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:00.206151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:00.231627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-da9f137a-c0ba-4427-986b-e6210b14e8fc tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.487602 Feb 12 21:27:00.233975 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2730/5314] 10.222.0.31 () {62 vars in 1187 bytes} [Sat Feb 12 21:26:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 12 21:27:00.244391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6c6399b9-82be-4b73-a2c1-6c86178694d1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:00.244962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6c6399b9-82be-4b73-a2c1-6c86178694d1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:00.461164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lazy-loading 'services' on Instance uuid 4dc92777-08a6-40e3-a421-5a9898d5e199 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:27:00.666724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6c6399b9-82be-4b73-a2c1-6c86178694d1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:00.686371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6c6399b9-82be-4b73-a2c1-6c86178694d1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:00.689899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6c6399b9-82be-4b73-a2c1-6c86178694d1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:00.692532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6c6399b9-82be-4b73-a2c1-6c86178694d1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1277 microversion: 2.54 time: 0.452016 Feb 12 21:27:00.693552 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2731/5315] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:00 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1277 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:00.833245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:00.833875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:00.843966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:00.844728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:00.845788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:00.846420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:01.138858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:01.150879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e270af95-55d3-47fd-971f-19fb377d95ac tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.323174 Feb 12 21:27:01.159950 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2732/5316] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:00 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:01.551781 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f7535b9c-996d-401e-b1d6-de45b2e5c06a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199/os-volume_attachments/aacc142f-bac9-4d58-9705-49f2b86e3a0a" status: 202 len: 0 microversion: 2.1 time: 1.360744 Feb 12 21:27:01.556357 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2585/5317] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:27:00 2022] DELETE /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199/os-volume_attachments/aacc142f-bac9-4d58-9705-49f2b86e3a0a => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:27:01.712809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b6ecec43-ee1f-4245-ba5e-9afd20e4d7ad tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:01.713592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b6ecec43-ee1f-4245-ba5e-9afd20e4d7ad tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:01.814749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b6ecec43-ee1f-4245-ba5e-9afd20e4d7ad tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:01.824630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b6ecec43-ee1f-4245-ba5e-9afd20e4d7ad tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:01.827098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b6ecec43-ee1f-4245-ba5e-9afd20e4d7ad tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:01.828207 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b6ecec43-ee1f-4245-ba5e-9afd20e4d7ad tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1277 microversion: 2.54 time: 0.121664 Feb 12 21:27:01.834778 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2733/5318] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:01 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:02.177737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:02.179236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:02.191022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:02.193192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:02.193192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:02.194533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:02.424093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:02.433631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-773c5131-1f74-492d-8d43-e8a3a63a344d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.261148 Feb 12 21:27:02.435852 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2586/5319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:02 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:02.784720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:02.785304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:02.793164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:02.793761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:02.795262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:02.795741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:02.822921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:27:02.850486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:02.851273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:02.867425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:02.871323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:02.872461 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:02.873990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:02.979061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:02.988136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:02.989763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:02.990894 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3511ffb4-5b4b-45e5-a5c1-4919fbf669f7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1329 microversion: 2.54 time: 0.144364 Feb 12 21:27:02.991657 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2587/5320] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:02 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1329 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:03.274135 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a1a5292-e0fa-42f5-9170-ce524257ced9 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 204 len: 0 microversion: 2.1 time: 0.492791 Feb 12 21:27:03.275329 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2734/5321] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:27:02 2022] DELETE /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:27:03.284087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:03.284760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:03.291582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:03.292147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:03.292952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:03.293412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:03.454552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:03.455859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:03.462880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:03.463342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:03.464153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:03.464595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:03.547656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:03.557138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab581c9a-738b-413c-8ce3-3664e3359e4a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1512 microversion: 2.1 time: 0.276665 Feb 12 21:27:03.567888 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2588/5322] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:03 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:03.655941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:03.663587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be7b9d65-ae16-408c-a613-3693c67c28d0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.216024 Feb 12 21:27:03.664168 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2735/5323] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:03 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:04.010132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:04.011544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:04.019620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.020974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.022278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.022955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.175051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:04.186533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:04.195223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:04.197613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85c11234-07e2-4277-9244-b41715da0b2a tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1335 microversion: 2.54 time: 0.191303 Feb 12 21:27:04.199065 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2589/5324] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:04 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1335 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:04.245702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a6747fc7-fa87-46ee-9d1e-3ee25e643192 req-7c57549e-6644-4c0b-9195-93b7b3073c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5b018f-87a0-4198-b3b1-346b49ee6bf1", "name": "network-vif-plugged", "status": "completed", "tag": "b75f5f83-8e7c-4255-9f7b-b748b078e9ef"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:04.247327 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:04.247327 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:27:04.255189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a6747fc7-fa87-46ee-9d1e-3ee25e643192 req-7c57549e-6644-4c0b-9195-93b7b3073c94 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.255891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a6747fc7-fa87-46ee-9d1e-3ee25e643192 req-7c57549e-6644-4c0b-9195-93b7b3073c94 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.267667 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a6747fc7-fa87-46ee-9d1e-3ee25e643192 req-7c57549e-6644-4c0b-9195-93b7b3073c94 service nova] Creating event network-vif-plugged:b75f5f83-8e7c-4255-9f7b-b748b078e9ef for instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1 on nch1-master-1 Feb 12 21:27:04.272911 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a6747fc7-fa87-46ee-9d1e-3ee25e643192 req-7c57549e-6644-4c0b-9195-93b7b3073c94 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Feb 12 21:27:04.273592 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2736/5325] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:04.579287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:04.580342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:04.593539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.594875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.595935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.596545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.685010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:04.685010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:04.702454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.703046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.703899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:04.704335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:04.931325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:04.948120 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8d17a5f1-716b-4403-9e78-48438faa9069 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1512 microversion: 2.1 time: 0.376126 Feb 12 21:27:04.948811 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2590/5326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:04 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:04.952220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:04.967113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a9f92d9-2fea-4dc2-81bc-6bd40e6a53e7 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1312 microversion: 2.1 time: 0.289285 Feb 12 21:27:04.968248 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2737/5327] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:04 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1312 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:05.219302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:05.219999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:05.226470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:05.226923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:05.228006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:05.231381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:05.329952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:05.345688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:05.348105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:05.349989 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2438c755-ae55-4590-87d5-aeab9aff4d10 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1335 microversion: 2.54 time: 0.135180 Feb 12 21:27:05.350859 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2591/5328] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:05 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1335 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:05.806926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:05.807533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:05.815097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:05.815551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:05.816492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:05.817251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:05.846733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:27:05.968081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:05.968716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:05.988753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:05.989126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:05.996415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:05.996884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.109425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:06.122674 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e6d9c8ac-89e7-49b8-ba44-f8e2eeb70382 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1470 microversion: 2.1 time: 0.159786 Feb 12 21:27:06.123582 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2592/5329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:05 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:06.127955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:06.128558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:06.134614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.135066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.135882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.136322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.235883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b168f91e-94ad-4a71-ada3-951c7f03411f tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 204 len: 0 microversion: 2.1 time: 0.432243 Feb 12 21:27:06.236805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2738/5330] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:27:05 2022] DELETE /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:27:06.243112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a3399bb8-47d0-44db-a60e-eef94153081a req-b13f37e9-f5a7-467d-b22c-bf62776182be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc92777-08a6-40e3-a421-5a9898d5e199", "name": "network-vif-deleted", "tag": "d661d100-a3e2-4189-afa4-cff30b0ad7a4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:06.245094 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:06.245094 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:27:06.257462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a3399bb8-47d0-44db-a60e-eef94153081a req-b13f37e9-f5a7-467d-b22c-bf62776182be service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.257928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a3399bb8-47d0-44db-a60e-eef94153081a req-b13f37e9-f5a7-467d-b22c-bf62776182be service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.271365 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a3399bb8-47d0-44db-a60e-eef94153081a req-b13f37e9-f5a7-467d-b22c-bf62776182be service nova] Creating event network-vif-deleted:d661d100-a3e2-4189-afa4-cff30b0ad7a4 for instance 4dc92777-08a6-40e3-a421-5a9898d5e199 on nch1-master-1 Feb 12 21:27:06.277136 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a3399bb8-47d0-44db-a60e-eef94153081a req-b13f37e9-f5a7-467d-b22c-bf62776182be service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038454 Feb 12 21:27:06.278008 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2739/5331] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:06.280868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:06.291038 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6094498f-333a-4bc1-9d21-e4e88f72761d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1495 microversion: 2.1 time: 0.166227 Feb 12 21:27:06.292520 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2593/5332] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:06 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1495 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:06.305106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:06.305106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:06.305106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.305106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.305106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.305106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.373177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:06.374193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:06.395247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.396922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.398021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:06.398853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:06.530580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:06.540340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:06.542951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:06.545699 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c46b7877-bedf-4e77-ac3d-e8e37bdeba66 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1356 microversion: 2.54 time: 0.178512 Feb 12 21:27:06.547218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2594/5333] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:06 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:06.567445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9cbbd428-c1df-4984-80ed-d9f0f15c7e91 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Action: 'create', calling method: .version_select at 0x7fa90444c040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1327375619"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:06.583662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9cbbd428-c1df-4984-80ed-d9f0f15c7e91 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Getting quotas for project 7a7c682ee61c44f7b9859963f0cd7f83. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:27:06.589824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9cbbd428-c1df-4984-80ed-d9f0f15c7e91 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Getting quotas for user 0b0b8b6b87354fb489fc3bd445f4c6cd and project 7a7c682ee61c44f7b9859963f0cd7f83. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:27:06.661608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:06.675170 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bcb59d11-4311-4c06-888e-8d6ffc6ac33d tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1505 microversion: 2.1 time: 0.395596 Feb 12 21:27:06.686165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2740/5334] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:06 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:06.967732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9cbbd428-c1df-4984-80ed-d9f0f15c7e91 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Getting quotas for project 7a7c682ee61c44f7b9859963f0cd7f83. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:27:06.973565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9cbbd428-c1df-4984-80ed-d9f0f15c7e91 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Getting quotas for user 0b0b8b6b87354fb489fc3bd445f4c6cd and project 7a7c682ee61c44f7b9859963f0cd7f83. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:27:06.990222 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9cbbd428-c1df-4984-80ed-d9f0f15c7e91 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.54 time: 0.427645 Feb 12 21:27:06.990360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2595/5335] 10.222.0.31 () {62 vars in 1198 bytes} [Sat Feb 12 21:27:06 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 431 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:27:07.001157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1327375619", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:07.002888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.010391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.010841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.011633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.012067 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.107020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:27:07.107552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:27:07.108059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:27:07.108468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:27:07.108887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:27:07.140840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:07.142679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.151193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.151839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.154775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.155549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.201991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.202440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.202909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lazy-loading 'fault' on Instance uuid 4dc92777-08a6-40e3-a421-5a9898d5e199 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:27:07.246391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:07.256341 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7026d8b2-20ab-47cd-8348-0a84831a4947 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 200 len: 1308 microversion: 2.1 time: 0.120013 Feb 12 21:27:07.257600 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2596/5336] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:07 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:07.265655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:07.266405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.276328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.277113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.278448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.280066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.308465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:27:07.601831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.611406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.612273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.613377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.614048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.656289 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16edc5da-dc79-43db-9078-9aadcf612ebb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "POST /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f/action" status: 202 len: 1139 microversion: 2.54 time: 0.659554 Feb 12 21:27:07.658411 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2741/5337] 10.222.0.31 () {62 vars in 1319 bytes} [Sat Feb 12 21:27:06 2022] POST /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f/action => generated 1139 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Feb 12 21:27:07.674960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:07.675931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.682156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.682763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.683669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.684099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.717666 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bccbee41-0e00-4428-a916-ee0629c9bc2c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "DELETE /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 204 len: 0 microversion: 2.1 time: 0.457814 Feb 12 21:27:07.718721 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2597/5338] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:27:07 2022] DELETE /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:27:07.728593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:07.729729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.739984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.746247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.746247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.746247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.791098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:07.803581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:07.805086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:07.806926 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c282c62-ac88-4e2d-a44f-f97c4ef0fbc5 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.136965 Feb 12 21:27:07.807701 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2742/5339] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:07 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:07.813498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:07.813498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:07.818667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.819257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:07.820054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:07.820483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:08.111403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:08.121248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7d8bea5a-4984-4469-aeb3-656fec31e41a tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1501 microversion: 2.1 time: 0.312575 Feb 12 21:27:08.123511 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2743/5340] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:07 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1501 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:08.192820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:08.203300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e0342990-0ceb-49bc-961c-7f790aa8a166 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1505 microversion: 2.1 time: 0.483014 Feb 12 21:27:08.208623 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2598/5341] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:07 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:08.287552 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:08.288218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 4dc92777-08a6-40e3-a421-5a9898d5e199] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:08.305751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:08.310177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:08.311120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:08.313394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:08.347466 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] HTTP exception thrown: Instance 4dc92777-08a6-40e3-a421-5a9898d5e199 could not be found. Feb 12 21:27:08.349294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Returning 404 to user: Instance 4dc92777-08a6-40e3-a421-5a9898d5e199 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:27:08.350666 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b9794892-5bba-4930-929d-d9161ea9ebf2 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199" status: 404 len: 111 microversion: 2.1 time: 0.077040 Feb 12 21:27:08.351401 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2744/5342] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:08 2022] GET /compute/v2.1/servers/4dc92777-08a6-40e3-a421-5a9898d5e199 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:27:08.788016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5573bedc-f904-478d-baf2-8ac30e76294a req-ba1983bb-5354-4954-b6a4-59ad72b0d795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae856f2-36ae-44d3-9c25-fd798d8dc096", "name": "network-vif-deleted", "tag": "bb7d08d8-ac0e-4122-9259-758f1b442408"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:08.789582 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:08.789582 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:08.808030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5573bedc-f904-478d-baf2-8ac30e76294a req-ba1983bb-5354-4954-b6a4-59ad72b0d795 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:08.808507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5573bedc-f904-478d-baf2-8ac30e76294a req-ba1983bb-5354-4954-b6a4-59ad72b0d795 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:08.826261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:08.826967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:08.836589 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5573bedc-f904-478d-baf2-8ac30e76294a req-ba1983bb-5354-4954-b6a4-59ad72b0d795 service nova] Creating event network-vif-deleted:bb7d08d8-ac0e-4122-9259-758f1b442408 for instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096 on nch2-master-1 Feb 12 21:27:08.837027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:08.838588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:08.839614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:08.840061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:08.846697 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5573bedc-f904-478d-baf2-8ac30e76294a req-ba1983bb-5354-4954-b6a4-59ad72b0d795 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061505 Feb 12 21:27:08.846697 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2599/5343] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:08.951494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:08.962980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:08.964658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:08.966027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a08cc9b-9cd9-4f20-83fb-3ec63c603f38 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.143645 Feb 12 21:27:08.967959 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2745/5344] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:08 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:09.144756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:09.145496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:09.152708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:09.153518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:09.154589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:09.155200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:09.229260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:09.234371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:09.252367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:09.253316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:09.254391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:09.255684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:09.304616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:09.305260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:09.305983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lazy-loading 'fault' on Instance uuid 2ae856f2-36ae-44d3-9c25-fd798d8dc096 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:27:09.492887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:09.500874 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c229491-c4bb-4c72-b1e8-1486c1655b99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1501 microversion: 2.1 time: 0.360602 Feb 12 21:27:09.503172 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2600/5345] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:09 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:09.551434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580ae0f6575f42b49aa02349ba5c95b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338dee3698c944ca8240d48553a4e629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:09.560384 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1853b700-9b50-4516-b5af-1f6316a9ff79 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 200 len: 1304 microversion: 2.1 time: 0.334992 Feb 12 21:27:09.561184 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2746/5346] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:09 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 1304 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:09.988368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:09.989058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:09.997612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:09.998931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:09.999770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:10.000379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:10.298365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:10.310049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:10.320150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:10.327176 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c37b33a6-1988-41db-956f-a3cfca6efb39 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.337310 Feb 12 21:27:10.328019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2601/5347] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:09 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:10.518905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:10.520346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:10.527848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:10.529608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:10.530653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:10.531253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:10.583727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:10.584575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] [instance: 2ae856f2-36ae-44d3-9c25-fd798d8dc096] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:10.595263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:10.597428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:10.597428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:10.597428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:10.613857 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] HTTP exception thrown: Instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096 could not be found. Feb 12 21:27:10.614740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] Returning 404 to user: Instance 2ae856f2-36ae-44d3-9c25-fd798d8dc096 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:27:10.615578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1b1e9944-675b-4e1a-af90-7707831f3688 tempest-VolumesActionsTest-662775030 tempest-VolumesActionsTest-662775030-project] 10.222.0.31 "GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096" status: 404 len: 111 microversion: 2.1 time: 0.037014 Feb 12 21:27:10.616141 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2602/5348] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:10 2022] GET /compute/v2.1/servers/2ae856f2-36ae-44d3-9c25-fd798d8dc096 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:27:10.659077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:10.670196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0a10003a-847c-4eec-8d0e-082ceb6f14bb tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1459 microversion: 2.1 time: 0.154891 Feb 12 21:27:10.680015 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2747/5349] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:10 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1459 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:10.861200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9700437f-bb93-4f56-ac5c-54a686e57bec req-81a91d2a-c24a-4c56-aa34-766ed2d23bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5b018f-87a0-4198-b3b1-346b49ee6bf1", "name": "network-vif-deleted", "tag": "b75f5f83-8e7c-4255-9f7b-b748b078e9ef"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:10.863235 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:10.863235 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:10.871087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9700437f-bb93-4f56-ac5c-54a686e57bec req-81a91d2a-c24a-4c56-aa34-766ed2d23bab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:10.871686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9700437f-bb93-4f56-ac5c-54a686e57bec req-81a91d2a-c24a-4c56-aa34-766ed2d23bab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:10.895980 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9700437f-bb93-4f56-ac5c-54a686e57bec req-81a91d2a-c24a-4c56-aa34-766ed2d23bab service nova] Creating event network-vif-deleted:b75f5f83-8e7c-4255-9f7b-b748b078e9ef for instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1 on nch1-master-1 Feb 12 21:27:10.900940 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9700437f-bb93-4f56-ac5c-54a686e57bec req-81a91d2a-c24a-4c56-aa34-766ed2d23bab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043891 Feb 12 21:27:10.901619 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2603/5350] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:11.349496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:11.350509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:11.358257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:11.358810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:11.359654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:11.360091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:11.559859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:11.568268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:11.575601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:11.575601 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b8a126b-e196-4460-9469-c0f407ffa050 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.228071 Feb 12 21:27:11.575601 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2748/5351] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:11 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:11.691397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:11.692230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:11.699439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:11.702132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:11.702132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:11.702357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:11.737736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:11.738328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:11.739015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lazy-loading 'fault' on Instance uuid fa5b018f-87a0-4198-b3b1-346b49ee6bf1 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:27:11.783329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:11.811026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-25798169-0a24-4566-8d00-ecc609d2741b tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 200 len: 1302 microversion: 2.1 time: 0.125236 Feb 12 21:27:11.816799 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2604/5352] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:11 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:12.593656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:12.594934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:12.604852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:12.605309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:12.607206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:12.607754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:12.690372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:12.708261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:12.710195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:12.713449 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d1adb42e-9749-4da0-9071-62d15cf67784 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.123381 Feb 12 21:27:12.713449 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2749/5353] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:12 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:12.833884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:12.836784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: fa5b018f-87a0-4198-b3b1-346b49ee6bf1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:12.847192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:12.848126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:12.849236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:12.849914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:12.881918 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] HTTP exception thrown: Instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1 could not be found. Feb 12 21:27:12.885399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Returning 404 to user: Instance fa5b018f-87a0-4198-b3b1-346b49ee6bf1 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:27:12.886355 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-69f7706b-8832-48b6-8a94-9ddbfd72efe2 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1" status: 404 len: 111 microversion: 2.1 time: 0.056746 Feb 12 21:27:12.886939 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2605/5354] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:12 2022] GET /compute/v2.1/servers/fa5b018f-87a0-4198-b3b1-346b49ee6bf1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:27:13.141009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-501277308", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "57ed5d22-bc4f-4292-a243-27a5ebb4ba3c"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:13.214975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] validate_networks() for [('57ed5d22-bc4f-4292-a243-27a5ebb4ba3c', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:27:13.734720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:13.735793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:13.744155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:13.747339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:13.747339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:13.747577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:13.785009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:27:13.785527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:27:13.786019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:27:13.786443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:27:13.790505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:27:13.806789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:13.807646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:13.809093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:13.810124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:13.831715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Getting quotas for project 67268b7cb701423a97c6d14f1de05645. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:27:13.838458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Getting quotas for user fc64bc14eb984bba9687128d14ac1f47 and project 67268b7cb701423a97c6d14f1de05645. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:27:13.848449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:13.855748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:27:13.861592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:27:13.865323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:13.882181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:13.882181 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-db10403d-b32d-4eac-8bb0-cdf4141b12f1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.140455 Feb 12 21:27:13.882181 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2606/5355] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:13 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:13.970906 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0345fc7-3001-41aa-a037-34321d4465b8 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835770 Feb 12 21:27:13.971565 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2750/5356] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:27:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:27:13.981943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a322b70-0a15-4257-826f-384c5206d672 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:13.985342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a322b70-0a15-4257-826f-384c5206d672 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:14.082026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a322b70-0a15-4257-826f-384c5206d672 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:14.104729 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a322b70-0a15-4257-826f-384c5206d672 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1213 microversion: 2.1 time: 0.127119 Feb 12 21:27:14.105322 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2607/5357] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:13 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:14.891423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:14.892147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:14.908494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:14.909210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:14.910275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:14.910989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:15.017880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:15.024701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:15.025963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:15.027138 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e79e7c48-db5f-4626-b3da-618599e21127 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.141260 Feb 12 21:27:15.027734 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2751/5358] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:14 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:15.122520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:15.123990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:15.131964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:15.132418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:15.133281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:15.133702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:15.242715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:15.251299 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1444af1-dc5f-4740-8ddd-520f45512c4f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1217 microversion: 2.1 time: 0.133000 Feb 12 21:27:15.251830 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2608/5359] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:15 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:16.046785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:16.047406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:16.058995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:16.060323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:16.061319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:16.061785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:16.130901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:16.137347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:16.139081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:16.140351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a232e60-0b68-43a2-a232-b651db383b0e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.098283 Feb 12 21:27:16.140958 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2752/5360] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:16 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:16.268423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:16.269062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:16.276394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:16.276847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:16.277653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:16.278138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:16.361443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:16.371758 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03b2229c-1b5c-4792-b768-191c67f373c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1265 microversion: 2.1 time: 0.107015 Feb 12 21:27:16.376682 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2609/5361] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:16 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:17.160129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:17.161271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:17.172660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:17.173120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:17.173973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:17.174410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:17.368267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:17.390795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:17.392285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:17.395544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:17.397158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:17.398845 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b7c2721e-47c1-4f99-9b9a-b84708dd8adf tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.242861 Feb 12 21:27:17.409389 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2753/5362] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:17 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:17.409634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:17.409634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:17.409634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:17.409634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:17.497863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:17.505750 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2af7c5eb-f497-434d-9887-9c073ece6c13 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1271 microversion: 2.1 time: 0.119491 Feb 12 21:27:17.506347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2610/5363] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:17 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:18.422397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:18.423025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:18.437699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:18.438158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:18.438972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:18.439411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:18.527198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:18.527897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:18.540431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:18.540883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:18.541720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:18.542259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:18.571100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:18.583813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:18.585408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:18.587084 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c069efd3-0ce0-470e-ab0b-f3c70c0563a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.169461 Feb 12 21:27:18.600358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2754/5364] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:18 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:18.843945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:18.852840 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-adb49b5e-7bc0-4810-8932-3ac7f0ffcd5c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1313 microversion: 2.1 time: 0.332149 Feb 12 21:27:18.853887 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2611/5365] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:18 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:19.174358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-442796225", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ec995a3e-38b5-4860-a73f-89108774c4bf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "17443eb2-4308-410f-a5f4-59d4de5fb120"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:19.249044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] validate_networks() for [('17443eb2-4308-410f-a5f4-59d4de5fb120', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:27:19.282697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c0ca1454-df22-4fbc-96b2-8231d69493a7 req-22d676a6-32c4-47c6-85bc-ef72b2df70fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2a60cd-8ef4-40a4-95b9-67f57ef959f6", "tag": "2e7b7f50-bdcc-4774-a329-7fa81dc025e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:19.284530 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:19.284530 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:19.295879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c0ca1454-df22-4fbc-96b2-8231d69493a7 req-22d676a6-32c4-47c6-85bc-ef72b2df70fa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:19.295879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c0ca1454-df22-4fbc-96b2-8231d69493a7 req-22d676a6-32c4-47c6-85bc-ef72b2df70fa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:19.321694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c0ca1454-df22-4fbc-96b2-8231d69493a7 req-22d676a6-32c4-47c6-85bc-ef72b2df70fa service nova] Creating event network-changed:2e7b7f50-bdcc-4774-a329-7fa81dc025e6 for instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 on nch1-master-1 Feb 12 21:27:19.328017 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c0ca1454-df22-4fbc-96b2-8231d69493a7 req-22d676a6-32c4-47c6-85bc-ef72b2df70fa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050267 Feb 12 21:27:19.328887 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2612/5366] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:27:19.608657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:19.609411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:19.616435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:19.617271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:19.618334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:19.618845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:19.701021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:19.736451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:19.745482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:19.745482 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2a8d64e-f53b-4353-b6c9-49f95b4175aa tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.140505 Feb 12 21:27:19.745482 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2613/5367] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:19 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:19.872878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:19.874711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:19.884812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:19.886383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:19.886383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:19.887068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:20.187168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:27:20.187761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:27:20.188051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:27:20.188461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:27:20.188873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:27:20.198379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:20.202216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:20.202216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:20.202216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:20.219969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:27:20.225126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for user cc56a9a0488e44d7935295ed39bfbb46 and project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:27:20.290010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:27:20.292108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ec995a3e-38b5-4860-a73f-89108774c4bf',volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:27:20.309966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:20.323603 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-65bb0d75-3204-4b97-9af9-dd0ed469d3b0 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1313 microversion: 2.1 time: 0.455934 Feb 12 21:27:20.333586 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2614/5368] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:19 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:20.767981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:20.769260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:20.779542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:20.789049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:20.789049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:20.789049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:20.825844 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ecbfdc88-8dc7-4c2f-b904-77fb5bbe5021 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656136 Feb 12 21:27:20.826966 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2755/5369] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:27:20.861188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6bcaa6ce-094e-4623-b07c-8a7acaf5cc5d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:20.863577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6bcaa6ce-094e-4623-b07c-8a7acaf5cc5d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:20.885775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:20.899072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:20.901086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:20.906316 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-32fb5362-2366-4396-8e90-a441df024b83 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.138957 Feb 12 21:27:20.915956 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2615/5370] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:20 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:20.958580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bcaa6ce-094e-4623-b07c-8a7acaf5cc5d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:20.977453 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6bcaa6ce-094e-4623-b07c-8a7acaf5cc5d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1070 microversion: 2.1 time: 0.127477 Feb 12 21:27:20.983299 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2756/5371] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:20 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1070 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:21.342125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:21.343443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:21.350085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:21.350548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:21.351353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:21.351984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:21.659223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:21.668110 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68342fa8-b9ca-4fcb-8619-f9b54bb3dd0f tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1313 microversion: 2.1 time: 0.330146 Feb 12 21:27:21.668698 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2616/5372] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:21 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:21.922271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:21.922963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:21.930190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:21.930647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:21.931462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:21.931907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:22.002640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:22.004594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:22.013703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:22.014662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:22.016223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:22.017028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:22.052364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:22.066519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:22.073851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:22.089433 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d171e0a-623a-48e8-a55a-5753033a5c61 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.157519 Feb 12 21:27:22.093025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2757/5373] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:21 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:22.137023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:22.150506 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b98680d1-03f8-4b29-8e26-3bda03b5c5fa tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1120 microversion: 2.1 time: 0.151503 Feb 12 21:27:22.151697 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2617/5374] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:21 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1120 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:22.687651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:22.688248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:22.694874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:22.702254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:22.703471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:22.704095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:22.876406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:22.884453 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9862dd6a-280a-4ea1-a4c7-2393623f30ce tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1313 microversion: 2.1 time: 0.200932 Feb 12 21:27:22.887599 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2758/5375] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:22 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:23.112630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:23.113185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:23.132017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:23.133002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:23.136800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:23.140150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:23.169202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:23.170212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:23.183931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:23.188658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:23.188658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:23.188658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:23.250508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:23.262455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:23.265771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:23.269749 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c23091e1-8a54-4dac-a853-2d2c9e3d4250 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.160592 Feb 12 21:27:23.271271 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2618/5376] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:23 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:23.294130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:23.302594 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0a4d8be5-f33b-40aa-8300-e2e7da778015 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1168 microversion: 2.1 time: 0.136910 Feb 12 21:27:23.302594 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2759/5377] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:23 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1168 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:23.904673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:23.908949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:23.913558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:23.914612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:23.915672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:23.916586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:24.247764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:24.276925 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc6234bb-62f6-47aa-8310-da9724971eb6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1313 microversion: 2.1 time: 0.377558 Feb 12 21:27:24.286707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2619/5378] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:23 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:24.289994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:24.290680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:24.305333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:24.305815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:24.306891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:24.307529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:24.327664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:24.328631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:24.338000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:24.340642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:24.340642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:24.340642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:24.408209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:24.420516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:24.423049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:24.429305 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cc3ac984-1104-4612-9dff-524240ecb0da tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.138268 Feb 12 21:27:24.437501 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2760/5379] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:24 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:24.443809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ac68ed20-afc7-4187-b915-0953ce8692db req-7bf899b8-5b37-45d3-a07a-466ecaadace7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2a60cd-8ef4-40a4-95b9-67f57ef959f6", "name": "network-vif-plugged", "status": "completed", "tag": "2e7b7f50-bdcc-4774-a329-7fa81dc025e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:24.444103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:24.447119 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:24.447119 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:27:24.453193 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8b537480-66fc-4cb1-9abf-aa53926171dd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1186 microversion: 2.1 time: 0.136165 Feb 12 21:27:24.453781 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2620/5380] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:24 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1186 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:24.485204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac68ed20-afc7-4187-b915-0953ce8692db req-7bf899b8-5b37-45d3-a07a-466ecaadace7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:24.486316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac68ed20-afc7-4187-b915-0953ce8692db req-7bf899b8-5b37-45d3-a07a-466ecaadace7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:24.503524 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ac68ed20-afc7-4187-b915-0953ce8692db req-7bf899b8-5b37-45d3-a07a-466ecaadace7 service nova] Creating event network-vif-plugged:2e7b7f50-bdcc-4774-a329-7fa81dc025e6 for instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 on nch1-master-1 Feb 12 21:27:24.517875 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ac68ed20-afc7-4187-b915-0953ce8692db req-7bf899b8-5b37-45d3-a07a-466ecaadace7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075155 Feb 12 21:27:24.519590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2761/5381] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:25.300578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:25.302223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:25.320860 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:25.321841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:25.325208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:25.326028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:25.444595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:25.445956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:25.456898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:25.456898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:25.456898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:25.456898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:25.596684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:25.606834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:25.609646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:25.611094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81a6f204-d2fb-4e8c-8319-a921eda360a0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.171765 Feb 12 21:27:25.611670 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2762/5382] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:25 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:25.616265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:25.617068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:25.627213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:25.627674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:25.628488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:25.629147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:25.763632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:25.773407 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4587d72-498a-4ace-8a50-ffcce18c9c04 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1313 microversion: 2.1 time: 0.479970 Feb 12 21:27:25.774925 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2621/5383] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:25 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:25.820015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:25.829699 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-57599be3-16c8-417c-a638-52bdb926f38e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1228 microversion: 2.1 time: 0.216620 Feb 12 21:27:25.830819 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2763/5384] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:25 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1228 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:26.116147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-259902355", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "6d5bc69a-2301-48bc-9830-3152e0fb1763"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:26.184243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] validate_networks() for [('6d5bc69a-2301-48bc-9830-3152e0fb1763', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:27:26.632314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:26.633818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:26.643236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:26.644202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:26.646182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:26.646755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:26.819444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:26.838484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:26.840644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:26.845071 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe072b80-3f37-4057-b86e-40f005edb4c9 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.217336 Feb 12 21:27:26.848139 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2764/5385] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:26 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:26.858060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:26.858795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:26.866313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:26.872691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:26.872691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:26.872691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.026187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:27:27.026707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:27:27.027317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:27:27.027845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:27:27.028343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:27:27.038354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.038933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.039827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.040349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.058203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Getting quotas for project 07de9e87ea3f495f90baaf85d83b982c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:27:27.064355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Getting quotas for user 7190c407ef794576a92dc5616e2ec4e3 and project 07de9e87ea3f495f90baaf85d83b982c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:27:27.078105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:27:27.080616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:27:27.128760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:27.139685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-92e593dd-8506-4dae-8e98-905480073692 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1496 microversion: 2.1 time: 0.288747 Feb 12 21:27:27.140281 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2765/5386] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:26 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1496 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:27.148987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:27.149656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:27.162533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.163464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.163794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.164398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.280748 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34389d54-7957-4c6a-b3e8-352001306865 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170167 Feb 12 21:27:27.291633 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2622/5387] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:27:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:27:27.314483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-de39b7b6-141e-4456-9765-8ceb06802f98 req-2d1bbff5-132a-4dce-b779-cfb7a41bb821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd21b7e-2110-47b0-a723-422ec85bdeb1", "tag": "5c93b7c0-4b50-4e5a-b4bb-7412fd5c594d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:27.320522 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:27.320522 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:27.339718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-de39b7b6-141e-4456-9765-8ceb06802f98 req-2d1bbff5-132a-4dce-b779-cfb7a41bb821 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.340175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-de39b7b6-141e-4456-9765-8ceb06802f98 req-2d1bbff5-132a-4dce-b779-cfb7a41bb821 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.371825 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-de39b7b6-141e-4456-9765-8ceb06802f98 req-2d1bbff5-132a-4dce-b779-cfb7a41bb821 service nova] Creating event network-changed:5c93b7c0-4b50-4e5a-b4bb-7412fd5c594d for instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 on nch1-master-1 Feb 12 21:27:27.377676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-de39b7b6-141e-4456-9765-8ceb06802f98 req-2d1bbff5-132a-4dce-b779-cfb7a41bb821 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088943 Feb 12 21:27:27.378531 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2623/5388] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:27.387408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e68317ae-a2b5-4211-ad0f-a708e6e57c6f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:27.393075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e68317ae-a2b5-4211-ad0f-a708e6e57c6f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:27.479924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e68317ae-a2b5-4211-ad0f-a708e6e57c6f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:27.491029 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e68317ae-a2b5-4211-ad0f-a708e6e57c6f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1218 microversion: 2.1 time: 0.109381 Feb 12 21:27:27.491029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2624/5389] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:27 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:27.556901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:27.579403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80f51e0b-06c1-4764-89c5-dc4132fb55fe tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.438040 Feb 12 21:27:27.580018 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2766/5390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:27 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:27.871543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:27.879044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:27.886650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.887585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.889773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:27.890793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:27.984605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:28.003454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:28.005647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:28.007048 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-84588fba-44e7-48d1-a401-2a24a9ccb72c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.142791 Feb 12 21:27:28.007689 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2625/5391] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:27 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:28.508929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1fba0ce1-e1f1-46c4-bafc-3a3f74e5ef9f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:28.509425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:28.510005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:28.510866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1fba0ce1-e1f1-46c4-bafc-3a3f74e5ef9f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:28.519854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:28.520308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:28.521401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:28.530012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:28.558783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:27:28.686477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1fba0ce1-e1f1-46c4-bafc-3a3f74e5ef9f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:28.698155 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1fba0ce1-e1f1-46c4-bafc-3a3f74e5ef9f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1218 microversion: 2.1 time: 0.192235 Feb 12 21:27:28.699880 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2767/5392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:28 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1218 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:28.709661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:28.710576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:28.722293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:28.723120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:28.724256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:28.725115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:28.921529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:28.929601 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-603af044-02a4-41a6-9fbe-06fc79b97164 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.226903 Feb 12 21:27:28.933471 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2768/5393] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:28 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:28.944209 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d77e3b85-f8a4-4e2d-ae67-0ee770a29d99 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 204 len: 0 microversion: 2.1 time: 0.439119 Feb 12 21:27:28.944810 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2626/5394] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:27:28 2022] DELETE /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:27:28.957471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:28.958521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:28.967458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:28.967923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:28.969583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:28.970523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:29.030485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:29.031539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:29.039319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:29.039856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:29.040919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:29.041456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:29.183159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:29.201366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:29.208921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:29.210962 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c391b419-3dc5-40dc-a541-8ef7d5dc390c tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.187087 Feb 12 21:27:29.212041 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2627/5395] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:29 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:29.258528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:29.269735 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-23e84539-6d08-4483-b979-92eb7ebd58c5 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1502 microversion: 2.1 time: 0.318477 Feb 12 21:27:29.270396 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2769/5396] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:28 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:29.717473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:29.718767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:29.736922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:29.737655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:29.738681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:29.739245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:29.947761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:29.948368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:29.956375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:29.956753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:29.957970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:29.958460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:30.088085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:30.098832 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72b6e727-0a8a-419f-9753-0e3e01a61734 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1270 microversion: 2.1 time: 0.385527 Feb 12 21:27:30.098832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2628/5397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:29 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:30.233087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:30.234068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:30.241338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:30.242101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:30.243121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:30.243775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:30.465315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:30.479703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:30.492459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:30.494157 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-889a36da-4489-45e1-83c3-382a068bda9b tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.267228 Feb 12 21:27:30.504845 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2629/5398] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:30 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:30.509483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:30.510868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:30.519952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:30.521164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:30.522470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:30.523084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:30.567376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:30.577038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c46ee220-2566-43e7-90d2-ba8be9506a4c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.633058 Feb 12 21:27:30.586264 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2770/5399] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:29 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:30.929901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:30.939025 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-858571d2-e4bf-4967-ac42-5df4d1c0573c tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1502 microversion: 2.1 time: 0.440947 Feb 12 21:27:30.949110 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2630/5400] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:30 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:31.132808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:31.132808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:31.135369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.136052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.136770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.137219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.278202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:31.287429 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c17a06f6-004b-4f51-a1ae-af8514d7c7f0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1276 microversion: 2.1 time: 0.169032 Feb 12 21:27:31.288017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2771/5401] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:31 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:31.513814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:31.514688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:31.521265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.521790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.522790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.523231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.594982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:31.595888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:31.606445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.606445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.606445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.606445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.645227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:31.656356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:31.658230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:31.659853 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96291f02-f87b-4459-8972-481d67e9c8cb tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.150595 Feb 12 21:27:31.670959 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2631/5402] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:31 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:31.809124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:31.817000 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-034dad7e-e9f5-4557-bb49-15c055e728d9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.227213 Feb 12 21:27:31.817626 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2772/5403] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:31 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:31.957479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:31.958218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:31.965206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.966444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:31.967508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:31.967958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.055601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:32.067971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9beba51-5a9b-4336-aea9-4d1c5da237d6 tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1460 microversion: 2.1 time: 0.114232 Feb 12 21:27:32.068774 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2632/5404] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:31 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1460 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:32.122263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-8b7fa0ea-5fa2-4d92-9c90-441f0f688962 req-a0408e89-c560-4e42-955b-fed7c3b0d21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2a60cd-8ef4-40a4-95b9-67f57ef959f6", "name": "network-vif-deleted", "tag": "2e7b7f50-bdcc-4774-a329-7fa81dc025e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:32.124023 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:32.124023 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:27:32.148835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8b7fa0ea-5fa2-4d92-9c90-441f0f688962 req-a0408e89-c560-4e42-955b-fed7c3b0d21e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.157293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8b7fa0ea-5fa2-4d92-9c90-441f0f688962 req-a0408e89-c560-4e42-955b-fed7c3b0d21e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.179282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-8b7fa0ea-5fa2-4d92-9c90-441f0f688962 req-a0408e89-c560-4e42-955b-fed7c3b0d21e service nova] Creating event network-vif-deleted:2e7b7f50-bdcc-4774-a329-7fa81dc025e6 for instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 on nch1-master-1 Feb 12 21:27:32.192638 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-8b7fa0ea-5fa2-4d92-9c90-441f0f688962 req-a0408e89-c560-4e42-955b-fed7c3b0d21e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074342 Feb 12 21:27:32.193836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2773/5405] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:32.305333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:32.305970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:32.317218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.317731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.318534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.318972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.682543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:32.683258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:32.691863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.692624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.694646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.695258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.879012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:32.884846 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7fb2d0c-3a2c-4295-8533-d86aaa814462 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.583063 Feb 12 21:27:32.885557 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2633/5406] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:32 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:32.898394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:32.899378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:32.906483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:32.910139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.913193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.915365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:32.918249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:32.918249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:32.918448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:32.919061 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee2be383-7c59-4e9e-b858-42b3fa358be0 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.244027 Feb 12 21:27:32.919945 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2774/5407] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:32 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 12 21:27:33.084752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:33.085380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:33.097490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.097991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:33.104947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.104947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:33.140604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.141320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:33.141989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lazy-loading 'fault' on Instance uuid 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:27:33.227700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:33.237942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc64bc14eb984bba9687128d14ac1f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67268b7cb701423a97c6d14f1de05645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:33.238854 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-be8f2d78-3d85-4e6a-aeb8-f0a12f95d4c8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.351380 Feb 12 21:27:33.239698 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2634/5408] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:32 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:33.248103 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a0cd2f1-c454-481b-ac12-aa3df7c3e95e tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 200 len: 1303 microversion: 2.1 time: 0.166915 Feb 12 21:27:33.253134 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2775/5409] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:33 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:33.904330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:33.909200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:33.913115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.917734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:33.920446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.921000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:33.939138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:33.939808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:33.949458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.958941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:33.959870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:33.960393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.055522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:34.064905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:34.066428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:34.067890 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c04872a4-0b96-430f-832c-4efee77943b7 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1408 microversion: 2.54 time: 0.133905 Feb 12 21:27:34.078006 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2776/5410] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:33 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:34.228624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6bb1400e-ab74-4201-8f3c-637c632463d7 req-2327175e-9431-4268-ab53-8588c7d0558d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca553ab-0024-4fbf-8e16-f59d646c6680", "tag": "3e04915f-889d-42d7-9810-114870636136"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:34.231788 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:34.231788 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:27:34.241026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6bb1400e-ab74-4201-8f3c-637c632463d7 req-2327175e-9431-4268-ab53-8588c7d0558d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:34.241695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6bb1400e-ab74-4201-8f3c-637c632463d7 req-2327175e-9431-4268-ab53-8588c7d0558d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.257089 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6bb1400e-ab74-4201-8f3c-637c632463d7 req-2327175e-9431-4268-ab53-8588c7d0558d service nova] Creating event network-changed:3e04915f-889d-42d7-9810-114870636136 for instance 8ca553ab-0024-4fbf-8e16-f59d646c6680 on nch2-master-1 Feb 12 21:27:34.264089 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6bb1400e-ab74-4201-8f3c-637c632463d7 req-2327175e-9431-4268-ab53-8588c7d0558d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039189 Feb 12 21:27:34.265165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2777/5411] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:34.272541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:34.273696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:34.280011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:34.289708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a8299bcd-c879-4813-839d-47bd94643e0a tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.390915 Feb 12 21:27:34.293672 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2635/5412] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:33 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:34.295866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:34.300335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.301599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:34.302355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.303763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:34.306213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] [instance: 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:34.319109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:34.319742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.321245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:34.321740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.342103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] HTTP exception thrown: Instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 could not be found. Feb 12 21:27:34.342701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] Returning 404 to user: Instance 8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:27:34.343714 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b8de4a46-d711-45fd-8905-b74be1917e0d tempest-VolumesActionsTest-2082612410 tempest-VolumesActionsTest-2082612410-project] 10.222.0.31 "GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6" status: 404 len: 111 microversion: 2.1 time: 0.046705 Feb 12 21:27:34.348155 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2636/5413] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:34 2022] GET /compute/v2.1/servers/8e2a60cd-8ef4-40a4-95b9-67f57ef959f6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:27:34.599449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-14b3f917-3b84-4625-b457-53ce382fb0fc req-99dfb3d7-7f1c-4c33-89ed-77d6b7db9593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd21b7e-2110-47b0-a723-422ec85bdeb1", "name": "network-vif-plugged", "status": "completed", "tag": "5c93b7c0-4b50-4e5a-b4bb-7412fd5c594d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:34.601998 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:34.601998 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:34.615283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-14b3f917-3b84-4625-b457-53ce382fb0fc req-99dfb3d7-7f1c-4c33-89ed-77d6b7db9593 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:34.615283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-14b3f917-3b84-4625-b457-53ce382fb0fc req-99dfb3d7-7f1c-4c33-89ed-77d6b7db9593 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:34.626917 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-14b3f917-3b84-4625-b457-53ce382fb0fc req-99dfb3d7-7f1c-4c33-89ed-77d6b7db9593 service nova] Creating event network-vif-plugged:5c93b7c0-4b50-4e5a-b4bb-7412fd5c594d for instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 on nch1-master-1 Feb 12 21:27:34.633009 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-14b3f917-3b84-4625-b457-53ce382fb0fc req-99dfb3d7-7f1c-4c33-89ed-77d6b7db9593 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037306 Feb 12 21:27:34.635641 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2637/5414] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:27:35.090157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:35.091361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:35.104810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:35.105270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:35.106446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:35.106703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:35.250649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:35.259635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6119acb5-221d-481f-a2a7-b5299fbb63c5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.992649 Feb 12 21:27:35.269321 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2778/5415] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:34 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:35.285040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:35.295133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:35.300295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:35.300295 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4052935c-b5fe-45e2-b369-85ae512b5c7e tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1426 microversion: 2.54 time: 0.212700 Feb 12 21:27:35.300295 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2638/5416] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:35 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1426 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:35.315284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:35.315912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:35.327276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:35.327800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:35.328882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:35.329940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:35.523129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:35.530205 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-725f4f50-f40f-453d-bd16-46de09be3617 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.223771 Feb 12 21:27:35.545227 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2779/5417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:35 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:36.278334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:36.279242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:36.291429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:36.292008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:36.294344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:36.295138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:36.317984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:36.318581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:36.330387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:36.331117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:36.331916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:36.332348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:36.416892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:36.434664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:36.440592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:36.442128 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5cd67f91-8346-4b04-8894-e6b365c7f7b3 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1414 microversion: 2.54 time: 0.127633 Feb 12 21:27:36.443341 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2780/5418] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:36 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:36.536309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:36.546525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ad1e47c-50ca-4dc6-a704-ab0fc30ea959 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1216 microversion: 2.1 time: 0.272366 Feb 12 21:27:36.547950 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2639/5419] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:36 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1216 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:36.549116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:36.549970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:36.557057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:36.557985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:36.558979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:36.559705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:36.911726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:36.923760 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e4a6b1a2-76a5-4110-a67c-aca4418b1bc0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.380152 Feb 12 21:27:36.924520 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2781/5420] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:36 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:37.462139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:37.466080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:37.474843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.475297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.476109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.478312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.553617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:37.563894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:37.564650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:37.565413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:37.565542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:37.566598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4ef35567-de69-4575-be93-e6fa25165ef1 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1399 microversion: 2.54 time: 0.108226 Feb 12 21:27:37.577893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.577893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.577893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.577893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.588068 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2640/5421] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:37 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1399 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:37.595420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dc2c0928-f51b-45be-b471-e22202e7fb4d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '.version_select at 0x7fa8fd68e550>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:37.689092 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dc2c0928-f51b-45be-b471-e22202e7fb4d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1327375619" status: 204 len: 0 microversion: 2.54 time: 0.101338 Feb 12 21:27:37.691333 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2641/5422] 10.222.0.31 () {60 vars in 1318 bytes} [Sat Feb 12 21:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1327375619 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:27:37.707632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:37.712492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:37.724408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.725531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.727020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.728427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.766483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:27:37.787674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:37.799927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1217b76-db89-4648-9492-457c50326502 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1404 microversion: 2.1 time: 0.239130 Feb 12 21:27:37.800535 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2782/5423] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:37 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:37.817779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:37.818647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:37.826133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.826886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:37.827848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:37.828466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.227873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:38.249213 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d928b6f7-aafe-45e4-b773-ee0fc689db79 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1404 microversion: 2.1 time: 0.436173 Feb 12 21:27:38.267059 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2783/5424] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:37 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:38.286604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:38.287589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:38.296610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:38.297499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.298866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:38.300113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.567214 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:38.579484 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3e76e93-bdb6-415f-adcb-b14599056db6 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.308405 Feb 12 21:27:38.580351 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2784/5425] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:38 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:38.585271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-360170628"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:38.586372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:38.594519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:38.598571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.598726 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4ae3a780-02c1-4ebd-bfa0-56d975e504f8 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 204 len: 0 microversion: 2.54 time: 0.891421 Feb 12 21:27:38.599254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:38.599371 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2642/5426] 10.222.0.31 () {60 vars in 1279 bytes} [Sat Feb 12 21:27:37 2022] DELETE /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 0 bytes in 893 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 12 21:27:38.599475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.610560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:38.611875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:38.621110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:38.621972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.622774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:38.623230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:38.707368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:38.717952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:38.719984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:38.721441 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-592df7cc-b254-4708-a837-24f6474babd4 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1405 microversion: 2.54 time: 0.116595 Feb 12 21:27:38.722534 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2643/5427] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:38 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:38.795710 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Attempting to quiesce instance before volume snapshot. Feb 12 21:27:38.817651 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Feb 12 21:27:39.221895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Creating snapshot from volume ec995a3e-38b5-4860-a73f-89108774c4bf. {{(pid=141727) snapshot_instance /opt/stack/nova/nova/compute/api.py:3419}} Feb 12 21:27:39.601536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:39.602852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:39.623080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:39.623566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:39.624402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:39.624852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:40.009886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:40.034663 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cdedd067-a0c4-43d8-b764-66e912634401 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.441440 Feb 12 21:27:40.037654 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2644/5428] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:39 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:40.051791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:40.053902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:40.081965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:40.083768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:40.084609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:40.085065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:40.179199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:40.181543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:40.185706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lazy-loading 'fault' on Instance uuid 2502e987-8e49-4813-b843-0d216e66fc4f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:27:40.241210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:40.250814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:40.252313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b0b8b6b87354fb489fc3bd445f4c6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7c682ee61c44f7b9859963f0cd7f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:40.254378 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0df78817-0818-4d8b-a921-df119294c58d tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 200 len: 1410 microversion: 2.54 time: 0.213822 Feb 12 21:27:40.259347 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2645/5429] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:40 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 1410 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 12 21:27:40.488025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-46c11303-a9ef-4866-beb6-ca0d4acbe9e8 req-5327d5f5-6241-40ae-8b10-59766b456e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca553ab-0024-4fbf-8e16-f59d646c6680", "name": "network-vif-plugged", "status": "completed", "tag": "3e04915f-889d-42d7-9810-114870636136"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:40.490735 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:40.490735 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:40.500208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-46c11303-a9ef-4866-beb6-ca0d4acbe9e8 req-5327d5f5-6241-40ae-8b10-59766b456e64 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:40.500654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-46c11303-a9ef-4866-beb6-ca0d4acbe9e8 req-5327d5f5-6241-40ae-8b10-59766b456e64 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:40.514768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-46c11303-a9ef-4866-beb6-ca0d4acbe9e8 req-5327d5f5-6241-40ae-8b10-59766b456e64 service nova] Creating event network-vif-plugged:3e04915f-889d-42d7-9810-114870636136 for instance 8ca553ab-0024-4fbf-8e16-f59d646c6680 on nch2-master-1 Feb 12 21:27:40.519983 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-46c11303-a9ef-4866-beb6-ca0d4acbe9e8 req-5327d5f5-6241-40ae-8b10-59766b456e64 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036475 Feb 12 21:27:40.521923 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2646/5430] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:41.055904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:41.057976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:41.074109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:41.075119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:41.076462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:41.077696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:41.339274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:41.350135 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48ae5677-1bd9-466c-ba0f-1451a773172f tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1318 microversion: 2.1 time: 0.299198 Feb 12 21:27:41.350722 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2647/5431] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:41 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:41.356454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:41.362219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] [instance: 2502e987-8e49-4813-b843-0d216e66fc4f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:41.397245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:41.398104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:41.399157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:41.402105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:41.440673 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] HTTP exception thrown: Instance 2502e987-8e49-4813-b843-0d216e66fc4f could not be found. Feb 12 21:27:41.441707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] Returning 404 to user: Instance 2502e987-8e49-4813-b843-0d216e66fc4f could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:27:41.443868 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3d7a97c-0234-4878-a1b4-3bca9274bd64 tempest-ServerShowV254Test-537664003 tempest-ServerShowV254Test-537664003-project] 10.222.0.31 "GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f" status: 404 len: 111 microversion: 2.54 time: 0.091959 Feb 12 21:27:41.444669 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2648/5432] 10.222.0.31 () {60 vars in 1276 bytes} [Sat Feb 12 21:27:41 2022] GET /compute/v2.1/servers/2502e987-8e49-4813-b843-0d216e66fc4f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:27:41.623503 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3f924e97-60ae-4ca3-9f4c-2f3c9d381799 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1/action" status: 202 len: 0 microversion: 2.1 time: 3.041391 Feb 12 21:27:41.625416 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2785/5433] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:27:38 2022] POST /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1/action => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 21:27:42.367120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:42.369872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:42.394216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:42.397248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:42.402399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:42.403460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:42.620515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:42.638009 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-37cf7bd4-2bac-4cc8-bc86-00642af1e16b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1507 microversion: 2.1 time: 0.274211 Feb 12 21:27:42.639808 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2649/5434] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:42 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:42.659802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d0f4abb-5903-44b8-87d3-462cd29d1ffe", "device": "/dev/sdb"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:42.661868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:42.672699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:42.672699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:42.672699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:42.672699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:43.736503 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "POST /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.083635 Feb 12 21:27:43.738852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2786/5435] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:27:42 2022] POST /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680/os-volume_attachments => generated 194 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:27:44.118567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1408109181", "imageRef": "66015d11-4001-4958-a742-8427608644f7", "flavorRef": "452", "networks": [{"uuid": "17443eb2-4308-410f-a5f4-59d4de5fb120"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:44.195969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] validate_networks() for [('17443eb2-4308-410f-a5f4-59d4de5fb120', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:27:45.006850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:27:45.007213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:27:45.007725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:27:45.008102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:27:45.008522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:27:45.019173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:45.020091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:45.021194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:45.027426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:45.041856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:27:45.047563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for user cc56a9a0488e44d7935295ed39bfbb46 and project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:27:45.063933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:27:45.067018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='48da9167-46c3-4a44-91dc-095e52bb654a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:27:45.088072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:45.090048 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a04be94-b21b-4e59-a11f-6ff6a101bbf0 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002301 Feb 12 21:27:45.096123 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2787/5436] 10.222.0.31 () {56 vars in 885 bytes} [Sat Feb 12 21:27:45 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Feb 12 21:27:45.687815 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-67465923-a379-4eb2-b59a-16c8c94fa66a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580689 Feb 12 21:27:45.693435 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2650/5437] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:27:45.709740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ac725283-7e65-4c7c-bad3-3a0f5a2247ee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:45.713748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ac725283-7e65-4c7c-bad3-3a0f5a2247ee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:45.893493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ac725283-7e65-4c7c-bad3-3a0f5a2247ee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:45.923468 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ac725283-7e65-4c7c-bad3-3a0f5a2247ee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1230 microversion: 2.1 time: 0.224856 Feb 12 21:27:45.934512 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2788/5438] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:45 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1230 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:27:46.959263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c49bffb6-b1bc-42ff-9c3b-14c21b4e5953 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:46.959263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c49bffb6-b1bc-42ff-9c3b-14c21b4e5953 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:47.172374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c49bffb6-b1bc-42ff-9c3b-14c21b4e5953 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:47.180772 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c49bffb6-b1bc-42ff-9c3b-14c21b4e5953 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1230 microversion: 2.1 time: 0.243026 Feb 12 21:27:47.192135 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2651/5439] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:46 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1230 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:48.198329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:48.201801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:48.233119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:48.236765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:48.238152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:48.239129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:48.463169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:48.475041 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63061dd0-3219-47c1-afbd-c6df1f126378 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1226 microversion: 2.1 time: 0.280750 Feb 12 21:27:48.482873 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2789/5440] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:48 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1226 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:49.499965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:49.501313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:49.548282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:49.553451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:49.555051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:49.555516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:49.720311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:49.729327 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2f81999-3332-48ea-b3e4-346ba35b2e26 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1300 microversion: 2.1 time: 0.234903 Feb 12 21:27:49.729961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2652/5441] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:49 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1300 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:50.760724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:50.763963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:50.778876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:50.779529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:50.783276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:50.783971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:50.943805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:50.957967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7075f762-7cf1-4c74-b770-9359f603936f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1300 microversion: 2.1 time: 0.200887 Feb 12 21:27:50.973092 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2790/5442] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:50 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:51.980533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:51.984472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:52.005021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:52.011494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:52.014147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:52.021407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:52.959070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:52.977764 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0bf24efa-86b3-40dd-84da-be7eb409abf5 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1342 microversion: 2.1 time: 0.998526 Feb 12 21:27:52.983183 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2653/5443] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:51 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1342 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:54.002771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:54.003510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:54.019052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:54.022143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:54.027272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:54.030849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:54.786888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:54.800029 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ec99314-a65e-46df-9869-0d707fe8c1e8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1342 microversion: 2.1 time: 0.801375 Feb 12 21:27:54.801188 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2791/5444] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:53 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1342 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:55.297644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-50710639-eec7-4034-92dc-b8dd21eb3da7 req-eeee42a9-f534-4358-ab0b-7bf697c004c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e104e7-32ff-4fb0-b83b-1b02dbe58457", "tag": "1dcb6e79-4a0a-495a-8490-6a5818d3fcb0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:27:55.303708 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:27:55.303708 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:27:55.319106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-50710639-eec7-4034-92dc-b8dd21eb3da7 req-eeee42a9-f534-4358-ab0b-7bf697c004c0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:55.319586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-50710639-eec7-4034-92dc-b8dd21eb3da7 req-eeee42a9-f534-4358-ab0b-7bf697c004c0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:55.370346 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-50710639-eec7-4034-92dc-b8dd21eb3da7 req-eeee42a9-f534-4358-ab0b-7bf697c004c0 service nova] Creating event network-changed:1dcb6e79-4a0a-495a-8490-6a5818d3fcb0 for instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 on nch1-master-1 Feb 12 21:27:55.395968 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-50710639-eec7-4034-92dc-b8dd21eb3da7 req-eeee42a9-f534-4358-ab0b-7bf697c004c0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105494 Feb 12 21:27:55.396849 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2654/5445] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:27:55.822764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:55.822764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:55.847420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:55.848928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:55.856195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:55.856195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:56.225483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:56.240378 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dc9054f5-829f-47b7-9f6e-c6c1e2c88040 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1342 microversion: 2.1 time: 0.425893 Feb 12 21:27:56.244390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2792/5446] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:55 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1342 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:57.268121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:57.270958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:57.295026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:57.295507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:57.298648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:57.300440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:57.920758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:57.935245 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-587207d8-3698-4e0e-95ba-be247ff7256e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1342 microversion: 2.1 time: 0.678222 Feb 12 21:27:57.937704 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2655/5447] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:57 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1342 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:27:58.956669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:27:58.957397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:27:58.977890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:58.978397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:58.980032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:27:58.980537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:27:59.305038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:27:59.316139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a3204d9-30dd-4772-a2ed-14982afeb2c2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1342 microversion: 2.1 time: 0.364919 Feb 12 21:27:59.317649 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2793/5448] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:27:58 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1342 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:00.336769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:00.338454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:00.354279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:00.358428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:00.360372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:00.361091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:00.572345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:00.588540 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a3f100d3-a7fb-47b4-87f4-849160e9e666 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1388 microversion: 2.1 time: 0.256938 Feb 12 21:28:00.590637 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2656/5449] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:00 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1388 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:01.609102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:01.618276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:01.633558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:01.634029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:01.637760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:01.638472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:02.447861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:02.464361 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4091a0e9-4d98-433e-987e-7758b7893ed2 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.860149 Feb 12 21:28:02.466319 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2794/5450] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:01 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:03.488061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:03.493836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:03.505066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:03.511532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:03.517993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:03.517993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:03.942419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:03.973151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c92dc834-2a06-4843-b64b-add3cc8dd15f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.476308 Feb 12 21:28:03.974582 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2657/5451] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:03 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:04.994038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:04.995170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:05.011147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:05.014253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:05.015307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:05.016752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:05.406293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:05.418829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-348718e0-0998-4c1c-ba3d-8c52abf5ae6d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.428747 Feb 12 21:28:05.420894 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2795/5452] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:04 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:06.438173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:06.439272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:06.452025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:06.452499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:06.454574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:06.454574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:06.872109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:06.882232 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c3c6b86-2c31-4b17-b80a-757edc34fc3f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.448253 Feb 12 21:28:06.884873 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2658/5453] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:06 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:07.900321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:07.901690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:07.914785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:07.915804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:07.917611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:07.920822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:08.286516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:08.296794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b68fa22a-8f24-4221-a892-8f695edaa7f7 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.400257 Feb 12 21:28:08.305971 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2796/5454] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:07 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:28:08.783373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2df128e5-04db-42e9-90bf-79cfb9ff4e73 req-7d9b79fb-84b0-475e-b8f0-0dba37c34a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e104e7-32ff-4fb0-b83b-1b02dbe58457", "name": "network-vif-plugged", "status": "completed", "tag": "1dcb6e79-4a0a-495a-8490-6a5818d3fcb0"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:28:08.784335 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:28:08.784335 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:28:08.803765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2df128e5-04db-42e9-90bf-79cfb9ff4e73 req-7d9b79fb-84b0-475e-b8f0-0dba37c34a3f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:08.806246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2df128e5-04db-42e9-90bf-79cfb9ff4e73 req-7d9b79fb-84b0-475e-b8f0-0dba37c34a3f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:08.832626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2df128e5-04db-42e9-90bf-79cfb9ff4e73 req-7d9b79fb-84b0-475e-b8f0-0dba37c34a3f service nova] Creating event network-vif-plugged:1dcb6e79-4a0a-495a-8490-6a5818d3fcb0 for instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 on nch1-master-1 Feb 12 21:28:08.863919 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2df128e5-04db-42e9-90bf-79cfb9ff4e73 req-7d9b79fb-84b0-475e-b8f0-0dba37c34a3f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082983 Feb 12 21:28:08.865722 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2659/5455] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:28:09.313780 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:09.314426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:09.321248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:09.329123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:09.330114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:09.330594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:09.712696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:09.729540 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5cc07dfd-d379-4d22-8ff1-c919c2ebe562 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.418242 Feb 12 21:28:09.729540 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2797/5456] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:09 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:10.744708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:10.745610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:10.758154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:10.758613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:10.759423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:10.759858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:10.930468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:10.941821 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1515688b-5cf7-46b6-bd18-ec6c4c686bff tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1376 microversion: 2.1 time: 0.200201 Feb 12 21:28:10.950688 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2660/5457] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:10 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1376 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:28:11.959501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:11.960227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:11.975099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:11.979084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:11.980990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:11.985059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:12.184133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:12.193216 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4234f356-906b-45fe-83aa-f12d966e99d0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1563 microversion: 2.1 time: 0.238224 Feb 12 21:28:12.193865 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2798/5458] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:11 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:12.214354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:12.215385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:12.223214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:12.223673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:12.224541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:12.225069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:12.446617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:12.455214 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-078fa104-0d02-40b8-86fb-20d0a73357e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1563 microversion: 2.1 time: 0.244750 Feb 12 21:28:12.456116 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2661/5459] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:12 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:12.535638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:12.536263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:12.551131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:12.551131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:12.551131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:12.551131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:12.576824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:28:13.034192 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-67f941c8-e889-44a4-b609-4ec087170785 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 204 len: 0 microversion: 2.1 time: 0.501818 Feb 12 21:28:13.035089 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2799/5460] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:28:12 2022] DELETE /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:28:13.043439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:13.044623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:13.054899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:13.055367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:13.056175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:13.056621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:13.289205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:13.299524 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27c219ac-b16c-4db5-9e74-730d832fdfca tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1569 microversion: 2.1 time: 0.260287 Feb 12 21:28:13.300110 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2662/5461] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:13 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:14.318420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:14.319208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:14.327720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:14.332836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:14.332836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:14.332836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:14.518985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:14.526654 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb3420ea-1f20-4871-b1e5-c1061123e5b0 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1569 microversion: 2.1 time: 0.213889 Feb 12 21:28:14.528009 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2800/5462] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:14 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:15.545003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:15.547411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:15.565212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:15.566732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:15.571736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:15.573528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:15.787646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:15.815709 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2d204324-a6e7-4084-b32c-ba578a5cef5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1527 microversion: 2.1 time: 0.275420 Feb 12 21:28:15.825321 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2663/5463] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:15 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:16.092649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fd9ffaf4-4007-44e5-af1b-55dd04a9462f req-06f0a2d3-2ff3-4362-859a-636e2fdf2a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e104e7-32ff-4fb0-b83b-1b02dbe58457", "name": "network-vif-deleted", "tag": "1dcb6e79-4a0a-495a-8490-6a5818d3fcb0"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:28:16.093728 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:28:16.093728 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:28:16.100744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fd9ffaf4-4007-44e5-af1b-55dd04a9462f req-06f0a2d3-2ff3-4362-859a-636e2fdf2a2e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:16.101205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fd9ffaf4-4007-44e5-af1b-55dd04a9462f req-06f0a2d3-2ff3-4362-859a-636e2fdf2a2e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:16.113079 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fd9ffaf4-4007-44e5-af1b-55dd04a9462f req-06f0a2d3-2ff3-4362-859a-636e2fdf2a2e service nova] Creating event network-vif-deleted:1dcb6e79-4a0a-495a-8490-6a5818d3fcb0 for instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 on nch1-master-1 Feb 12 21:28:16.118139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fd9ffaf4-4007-44e5-af1b-55dd04a9462f req-06f0a2d3-2ff3-4362-859a-636e2fdf2a2e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381225 Feb 12 21:28:16.118728 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2801/5464] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:28:16.842705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:16.844065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:16.858865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:16.866829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:16.868007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:16.868663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:16.934925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:16.936041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:16.936805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lazy-loading 'fault' on Instance uuid d3e104e7-32ff-4fb0-b83b-1b02dbe58457 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:28:17.009666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:28:17.019077 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1e78b529-9247-4a07-9a70-8d7c89db0e00 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 200 len: 1366 microversion: 2.1 time: 0.180091 Feb 12 21:28:17.022262 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2664/5465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:16 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:28:18.044129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:28:18.044999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:28:18.061656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:18.062391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:18.063237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:28:18.063736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:28:18.099025 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 could not be found. Feb 12 21:28:18.099654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:28:18.100621 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2bf7155d-4be7-4182-bfb6-0e91c46ffa5a tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 404 len: 111 microversion: 2.1 time: 0.062762 Feb 12 21:28:18.101384 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2802/5466] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:28:18 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:29:05.232145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:05.234004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:05.241298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:05.248576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:05.248576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:05.248576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:05.273920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:29:05.754587 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aabd13f8-14d0-4412-ba21-c315ce33d01f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 204 len: 0 microversion: 2.1 time: 0.526728 Feb 12 21:29:05.761481 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2665/5467] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:29:05 2022] DELETE /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:29:05.763711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:05.764336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:05.780142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:05.780865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:05.781791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:05.782248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:06.053063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:06.062106 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bebac112-ee58-4fc1-baa2-aaaa5ed5bcee tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1410 microversion: 2.1 time: 0.302476 Feb 12 21:29:06.062691 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2803/5468] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:05 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1410 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:07.081935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:07.083209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:07.094509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:07.095387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:07.096474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:07.097164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:07.448567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:07.468680 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a3b5b6b-d9cc-461b-8ae8-bdca51d42e9f tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1410 microversion: 2.1 time: 0.392762 Feb 12 21:29:07.471903 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2666/5469] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:07 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1410 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:08.496045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:08.496902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:08.514530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:08.515013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:08.515855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:08.516317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:08.574549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-0e0acaf9-86e9-4f5c-a7de-6a4548a88a73 req-0e6f1a0d-5d87-4b19-b72d-4c8ed959dcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd21b7e-2110-47b0-a723-422ec85bdeb1", "name": "network-vif-deleted", "tag": "5c93b7c0-4b50-4e5a-b4bb-7412fd5c594d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:08.577162 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:29:08.577162 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:29:08.586940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0e0acaf9-86e9-4f5c-a7de-6a4548a88a73 req-0e6f1a0d-5d87-4b19-b72d-4c8ed959dcfc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:08.587629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0e0acaf9-86e9-4f5c-a7de-6a4548a88a73 req-0e6f1a0d-5d87-4b19-b72d-4c8ed959dcfc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:08.611232 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-0e0acaf9-86e9-4f5c-a7de-6a4548a88a73 req-0e6f1a0d-5d87-4b19-b72d-4c8ed959dcfc service nova] Creating event network-vif-deleted:5c93b7c0-4b50-4e5a-b4bb-7412fd5c594d for instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 on nch1-master-1 Feb 12 21:29:08.617012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-0e0acaf9-86e9-4f5c-a7de-6a4548a88a73 req-0e6f1a0d-5d87-4b19-b72d-4c8ed959dcfc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048826 Feb 12 21:29:08.618035 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2667/5470] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:29:08.640886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:08.659049 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2a770c7-3a37-4919-9be2-1558cfb83105 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1368 microversion: 2.1 time: 0.166115 Feb 12 21:29:08.669993 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2804/5471] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:08 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:09.685099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:09.690714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:09.703397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:09.705324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:09.709223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:09.710422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:09.910609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:09.923149 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc211c67-ba54-4d91-ad9c-9a4ea8014c7d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1201 microversion: 2.1 time: 0.248065 Feb 12 21:29:09.923751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2668/5472] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:09 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1201 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:10.940882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:10.942974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:10.953856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:10.956811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:10.956811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:10.957085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:10.991709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:10.992181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:10.992659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lazy-loading 'fault' on Instance uuid 8bd21b7e-2110-47b0-a723-422ec85bdeb1 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:29:11.045284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:11.061394 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-74bbf774-edc1-4ce4-b5ed-921b99591f21 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 200 len: 1206 microversion: 2.1 time: 0.125006 Feb 12 21:29:11.062509 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2805/5473] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:10 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 1206 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:12.122719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:12.123495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:12.141071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:12.141557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:12.142375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:12.142811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:12.174978 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 could not be found. Feb 12 21:29:12.178757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:29:12.178757 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-05c0b704-2790-4c8b-ad08-d1d240c31003 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 404 len: 111 microversion: 2.1 time: 0.101930 Feb 12 21:29:12.180733 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2669/5474] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:12 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:29:25.229912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:25.230805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:25.246674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:25.246674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:25.246674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:25.246674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:25.280896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 could not be found. Feb 12 21:29:25.281829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:29:25.283062 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ee6d7f6-0143-4f66-8ca1-7164d41923e3 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 404 len: 111 microversion: 2.1 time: 0.058658 Feb 12 21:29:25.285421 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2806/5475] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:29:25 2022] DELETE /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:29:25.296456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:25.297026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: d3e104e7-32ff-4fb0-b83b-1b02dbe58457] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:25.309552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:25.310024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:25.311464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:25.313549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:25.353430 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 could not be found. Feb 12 21:29:25.356783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance d3e104e7-32ff-4fb0-b83b-1b02dbe58457 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:29:25.357711 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-47a738a7-e71a-4acf-8567-af0e5ead3b19 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457" status: 404 len: 111 microversion: 2.1 time: 0.067975 Feb 12 21:29:25.360418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2670/5476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:25 2022] GET /compute/v2.1/servers/d3e104e7-32ff-4fb0-b83b-1b02dbe58457 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:29:27.343482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:27.343990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:27.356089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:27.356822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:27.359047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:27.360190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:27.394441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 could not be found. Feb 12 21:29:27.397974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:29:27.399042 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2c055b8c-f2fc-429f-bd7e-ffd1d7990763 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 404 len: 111 microversion: 2.1 time: 0.059797 Feb 12 21:29:27.401935 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2807/5477] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:29:27 2022] DELETE /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:29:27.414588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:27.420557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: 8bd21b7e-2110-47b0-a723-422ec85bdeb1] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:27.446125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:27.450667 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:27.459429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:27.460127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:27.509267 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 could not be found. Feb 12 21:29:27.512383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance 8bd21b7e-2110-47b0-a723-422ec85bdeb1 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:29:27.514371 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4272784d-273a-47bf-b8f6-c7acf4822418 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1" status: 404 len: 111 microversion: 2.1 time: 0.109440 Feb 12 21:29:27.521445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2671/5478] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:27 2022] GET /compute/v2.1/servers/8bd21b7e-2110-47b0-a723-422ec85bdeb1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:29:28.238954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6eebb507-0853-4794-8757-7424ef634aad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'create', calling method: .version_select at 0x7fa8fd7a7a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-78159880"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:28.297544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6eebb507-0853-4794-8757-7424ef634aad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:29:28.313342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6eebb507-0853-4794-8757-7424ef634aad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for user cc56a9a0488e44d7935295ed39bfbb46 and project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:29:28.931615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6eebb507-0853-4794-8757-7424ef634aad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:29:28.942082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-6eebb507-0853-4794-8757-7424ef634aad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for user cc56a9a0488e44d7935295ed39bfbb46 and project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:29:28.961648 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6eebb507-0853-4794-8757-7424ef634aad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.726166 Feb 12 21:29:28.962835 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2808/5479] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:29:28 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:33.157554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-291b5812-b623-4e49-beb2-b9c4df71a94b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: .version_select at 0x7fa8fd2a1700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1911192451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:33.175630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-291b5812-b623-4e49-beb2-b9c4df71a94b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:29:33.181469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-291b5812-b623-4e49-beb2-b9c4df71a94b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:29:33.348575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-291b5812-b623-4e49-beb2-b9c4df71a94b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:29:33.361764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-291b5812-b623-4e49-beb2-b9c4df71a94b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:29:33.396972 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-291b5812-b623-4e49-beb2-b9c4df71a94b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.530301 Feb 12 21:29:33.397893 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2672/5480] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:29:32 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:40.828332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:40.829642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:40.848879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:40.850419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:40.854873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:40.857581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:41.082801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lazy-loading 'services' on Instance uuid 8ca553ab-0024-4fbf-8e16-f59d646c6680 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:29:41.601265 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fa6f433e-2e58-4aef-acda-cd676bd8a824 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680/os-volume_attachments/3d0f4abb-5903-44b8-87d3-462cd29d1ffe" status: 202 len: 0 microversion: 2.1 time: 0.781480 Feb 12 21:29:41.602080 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2809/5481] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:29:40 2022] DELETE /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680/os-volume_attachments/3d0f4abb-5903-44b8-87d3-462cd29d1ffe => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:29:42.879843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:42.880337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:42.907240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:42.907691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:42.912204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:42.912700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:42.987839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-566322606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-78159880", "security_groups": [{"name": "tempest-secgroup-smoke-857036283"}], "block_device_mapping_v2": [{"uuid": "246c1cd8-ec05-45ad-9455-c09c770c0c58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "17443eb2-4308-410f-a5f4-59d4de5fb120"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:42.996634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:29:43.411339 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e21ca923-e7bc-412e-bddb-f19f4d1164ea tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 204 len: 0 microversion: 2.1 time: 0.535625 Feb 12 21:29:43.412753 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2673/5482] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:29:42 2022] DELETE /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:29:43.421664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:43.422369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:43.435189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] validate_networks() for [('17443eb2-4308-410f-a5f4-59d4de5fb120', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:29:43.439345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:43.439784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:43.440811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:43.441453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:44.131907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:44.152973 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4a3581fa-58a7-42a6-8fa4-35fd9459735b tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1513 microversion: 2.1 time: 0.735355 Feb 12 21:29:44.155165 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2674/5483] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:43 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1513 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:45.178597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:45.180844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:45.206344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:45.206809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:45.207630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:45.208080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:45.934145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:29:45.938050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:29:45.938050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:29:45.938050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:29:45.938050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:29:45.953046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:45.957042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:45.962032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:45.967403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:45.970743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:45.980980 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72eb2bfe-36ee-4782-b58e-59f81b44badf tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1513 microversion: 2.1 time: 0.812343 Feb 12 21:29:45.981608 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2675/5484] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:45 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1513 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:46.034848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:29:46.050285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Getting quotas for user cc56a9a0488e44d7935295ed39bfbb46 and project 5c11b938ee814f3180aa6e0f37c4e1f0. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:29:46.152061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:29:46.154666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='246c1cd8-ec05-45ad-9455-c09c770c0c58',volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:29:46.739248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ad80c4d2-cf68-41a0-bfc3-69f45aaf1cef tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.755749 Feb 12 21:29:46.747154 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2810/5485] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:29:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 3767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:29:46.751523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0117dc8f-523a-4509-996b-91c9d4c86c2e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:46.756273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0117dc8f-523a-4509-996b-91c9d4c86c2e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:46.997610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:46.998286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:47.007269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:47.007753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:47.008616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:47.012994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:47.078479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0117dc8f-523a-4509-996b-91c9d4c86c2e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:47.110249 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0117dc8f-523a-4509-996b-91c9d4c86c2e tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1092 microversion: 2.1 time: 0.363005 Feb 12 21:29:47.117587 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2676/5486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:46 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1092 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:47.405574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9d33ec93-0c0d-4c5b-b532-620b9c34e96f req-cca2cd65-00f0-47a2-9428-781dbdfc6f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca553ab-0024-4fbf-8e16-f59d646c6680", "name": "network-vif-deleted", "tag": "3e04915f-889d-42d7-9810-114870636136"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:47.407434 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:29:47.407434 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:29:47.434823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:47.445253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9d33ec93-0c0d-4c5b-b532-620b9c34e96f req-cca2cd65-00f0-47a2-9428-781dbdfc6f82 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:47.446052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9d33ec93-0c0d-4c5b-b532-620b9c34e96f req-cca2cd65-00f0-47a2-9428-781dbdfc6f82 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:47.455988 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3ac047c-500d-44a7-883b-e38c66eb6df5 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1471 microversion: 2.1 time: 0.461350 Feb 12 21:29:47.472995 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2811/5487] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:46 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1471 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:29:47.504000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9d33ec93-0c0d-4c5b-b532-620b9c34e96f req-cca2cd65-00f0-47a2-9428-781dbdfc6f82 service nova] Creating event network-vif-deleted:3e04915f-889d-42d7-9810-114870636136 for instance 8ca553ab-0024-4fbf-8e16-f59d646c6680 on nch2-master-1 Feb 12 21:29:47.523258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9d33ec93-0c0d-4c5b-b532-620b9c34e96f req-cca2cd65-00f0-47a2-9428-781dbdfc6f82 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127678 Feb 12 21:29:47.538221 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2677/5488] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:29:48.137810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6486ac65-c04f-43e1-82ea-8fc1e96266ce tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:48.162147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6486ac65-c04f-43e1-82ea-8fc1e96266ce tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:48.293471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6486ac65-c04f-43e1-82ea-8fc1e96266ce tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:48.300413 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6486ac65-c04f-43e1-82ea-8fc1e96266ce tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1092 microversion: 2.1 time: 0.174691 Feb 12 21:29:48.306254 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2812/5489] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:48 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1092 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:48.481288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:48.483406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:48.501056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:48.501056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:48.501287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:48.504203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:48.565946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:48.566983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:48.567727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lazy-loading 'fault' on Instance uuid 8ca553ab-0024-4fbf-8e16-f59d646c6680 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:29:48.735321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7190c407ef794576a92dc5616e2ec4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07de9e87ea3f495f90baaf85d83b982c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:48.768456 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9e9fd914-445b-4987-bf7d-35fa1bf54289 tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 200 len: 1308 microversion: 2.1 time: 0.295382 Feb 12 21:29:48.770227 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2678/5490] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:48 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:49.323415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:49.325053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:49.340657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:49.341213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:49.347991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:49.348539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:49.786662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:49.788049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] [instance: 8ca553ab-0024-4fbf-8e16-f59d646c6680] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:49.796351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:49.796789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:49.800167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:49.800618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:49.824737 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] HTTP exception thrown: Instance 8ca553ab-0024-4fbf-8e16-f59d646c6680 could not be found. Feb 12 21:29:49.825403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] Returning 404 to user: Instance 8ca553ab-0024-4fbf-8e16-f59d646c6680 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:29:49.827195 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86c42dd3-c628-445b-b97e-11156f6cd52e tempest-VolumesSnapshotTestJSON-1959179807 tempest-VolumesSnapshotTestJSON-1959179807-project] 10.222.0.31 "GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680" status: 404 len: 111 microversion: 2.1 time: 0.043545 Feb 12 21:29:49.827970 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2679/5491] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:49 2022] GET /compute/v2.1/servers/8ca553ab-0024-4fbf-8e16-f59d646c6680 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:29:49.861820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:49.870762 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-80b81b67-a747-4b64-b71d-22a15d925199 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1190 microversion: 2.1 time: 0.551775 Feb 12 21:29:49.871940 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2813/5492] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:49 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1190 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:50.893092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:50.894586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:50.917113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:50.917598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:50.918412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:50.921116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:51.077816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:51.121922 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ac5ff6c9-20d5-494e-ac73-7690709e2ea9 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1208 microversion: 2.1 time: 0.233398 Feb 12 21:29:51.129508 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2680/5493] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:50 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1208 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:29:52.152169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:52.153008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:52.178651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:52.178651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:52.179510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:52.179959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:52.356771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:52.372888 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49c48deb-801e-4311-95c2-01f11383da39 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1208 microversion: 2.1 time: 0.228622 Feb 12 21:29:52.377714 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2814/5494] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:52 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:53.389705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:53.395951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:53.401747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:53.402212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:53.403169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:53.403612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:53.687104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:53.714396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4dc981fc-f53e-4e7a-b138-a394a329edcd tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1208 microversion: 2.1 time: 0.326707 Feb 12 21:29:53.714396 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2681/5495] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:53 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1208 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:54.731148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:54.731773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:54.761676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:54.764390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:54.771519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:54.785007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:55.193081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:55.201761 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-90dc8906-babd-4b9e-bfe3-55582a32711b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.475045 Feb 12 21:29:55.202759 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2815/5496] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:54 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:56.219275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:56.219894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:56.227229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:56.228001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:56.229284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:56.229924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:56.683049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:56.692599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc2dbced-1c50-4056-9304-b23c82904f33 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.477139 Feb 12 21:29:56.693297 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2682/5497] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:56 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:29:57.589288 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-70824b92-923c-4de0-95af-471424d781ca req-91cbc5fb-5900-4412-9ff9-393fef3028b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b70a65-6aa4-49d4-8415-1eda9c7671c0", "tag": "eb4be2e6-f5ae-4480-94a3-2f75ffe8516f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:57.593082 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:29:57.593082 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:29:57.625081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-70824b92-923c-4de0-95af-471424d781ca req-91cbc5fb-5900-4412-9ff9-393fef3028b6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:57.626494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-70824b92-923c-4de0-95af-471424d781ca req-91cbc5fb-5900-4412-9ff9-393fef3028b6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:57.690530 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-70824b92-923c-4de0-95af-471424d781ca req-91cbc5fb-5900-4412-9ff9-393fef3028b6 service nova] Creating event network-changed:eb4be2e6-f5ae-4480-94a3-2f75ffe8516f for instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 on nch1-master-1 Feb 12 21:29:57.711569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:57.712324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:57.726075 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-70824b92-923c-4de0-95af-471424d781ca req-91cbc5fb-5900-4412-9ff9-393fef3028b6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143791 Feb 12 21:29:57.726792 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2816/5498] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:29:57.729370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:57.730391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:57.732950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:57.738895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:57.848107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-119339769", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "f038c5fc-05b8-4c68-ba2a-521a1ea8b670"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1911192451", "security_groups": [{"name": "tempest-secgroup-smoke-501368592"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:29:58.182120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:58.190220 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15fd9b73-04bc-4e1c-b054-dec91a033169 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.484120 Feb 12 21:29:58.202026 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2683/5499] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:57 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:29:58.219206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] validate_networks() for [('f038c5fc-05b8-4c68-ba2a-521a1ea8b670', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:29:59.216925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:29:59.217680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:29:59.230897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:59.233828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:59.236514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:59.236514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:59.521982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:29:59.536673 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1556e20b-ec72-4f7b-8997-b29e09efdbfb tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.323940 Feb 12 21:29:59.552944 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2684/5500] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:29:59 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:29:59.796110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:29:59.796626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:29:59.797038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:29:59.797480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:29:59.797901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:29:59.819014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:59.819502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:59.820691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:29:59.821155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:29:59.882538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:29:59.901969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:29:59.924072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:29:59.926988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:30:00.112888 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f6f3f048-93e0-41e1-a0d7-abeeb7212222 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.270629 Feb 12 21:30:00.114545 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2817/5501] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:29:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:30:00.125770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5427f917-518e-49ff-a66b-86f66b514ae2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:00.126682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5427f917-518e-49ff-a66b-86f66b514ae2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:00.218522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5427f917-518e-49ff-a66b-86f66b514ae2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:00.230082 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5427f917-518e-49ff-a66b-86f66b514ae2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1266 microversion: 2.1 time: 0.108699 Feb 12 21:30:00.239395 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2685/5502] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:00 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:00.571829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:00.572940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:00.580883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:00.581469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:00.582513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:00.583049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:01.248571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de692838-73f0-4f7b-91f2-c0493277f4c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:01.250882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de692838-73f0-4f7b-91f2-c0493277f4c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:01.413430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:01.423775 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-133dba42-6d5a-4397-bd5c-732fef344737 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.857083 Feb 12 21:30:01.445103 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2818/5503] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:00 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:01.453231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de692838-73f0-4f7b-91f2-c0493277f4c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:01.471570 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de692838-73f0-4f7b-91f2-c0493277f4c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1266 microversion: 2.1 time: 0.216499 Feb 12 21:30:01.472827 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2686/5504] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:01 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:02.448666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:02.449925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:02.474407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:02.474877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:02.475706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:02.476154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:02.487924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b42dd71a-8315-4998-9155-87e92acf32a4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:02.488523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b42dd71a-8315-4998-9155-87e92acf32a4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:02.752483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b42dd71a-8315-4998-9155-87e92acf32a4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:02.760898 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b42dd71a-8315-4998-9155-87e92acf32a4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1266 microversion: 2.1 time: 0.276520 Feb 12 21:30:02.770893 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2687/5505] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:02 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:30:02.855301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:02.870037 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb50dc8f-3123-4327-bb2d-86868f315c5c tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.422698 Feb 12 21:30:02.871939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2819/5506] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:02 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:03.779130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:03.779847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:03.793919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:03.799014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:03.799014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:03.799014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:03.871550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:03.879868 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1117f3cf-76fc-49eb-b932-55fe973fda3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1270 microversion: 2.1 time: 0.105586 Feb 12 21:30:03.895884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:03.897562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:03.900961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2688/5507] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:03 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1270 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:03.920457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:03.920457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:03.920457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:03.920457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:04.280576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:04.288414 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a6860d6f-e8f9-4011-9de0-84be3e146bd8 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.401456 Feb 12 21:30:04.288999 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2820/5508] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:03 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:04.897415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:04.898260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:04.919360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:04.919832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:04.920647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:04.921098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:05.060807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:05.067248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e6a88f24-8ba8-41c0-b162-5d32c7f876cb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1270 microversion: 2.1 time: 0.173762 Feb 12 21:30:05.067836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2821/5509] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:04 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:30:05.191593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f5ee0018-35d8-4ee9-9283-030f729776a0 req-74b1e581-1a49-40ae-9d1f-3110bb548b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b70a65-6aa4-49d4-8415-1eda9c7671c0", "name": "network-vif-plugged", "status": "completed", "tag": "eb4be2e6-f5ae-4480-94a3-2f75ffe8516f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:05.194218 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:05.194218 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:30:05.214463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f5ee0018-35d8-4ee9-9283-030f729776a0 req-74b1e581-1a49-40ae-9d1f-3110bb548b34 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:05.214934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f5ee0018-35d8-4ee9-9283-030f729776a0 req-74b1e581-1a49-40ae-9d1f-3110bb548b34 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:05.228392 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f5ee0018-35d8-4ee9-9283-030f729776a0 req-74b1e581-1a49-40ae-9d1f-3110bb548b34 service nova] Creating event network-vif-plugged:eb4be2e6-f5ae-4480-94a3-2f75ffe8516f for instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 on nch1-master-1 Feb 12 21:30:05.234079 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f5ee0018-35d8-4ee9-9283-030f729776a0 req-74b1e581-1a49-40ae-9d1f-3110bb548b34 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340419 Feb 12 21:30:05.235255 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2689/5510] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:30:05.309027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:05.310274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:05.317045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:05.317562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:05.318654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:05.319118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:05.561015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:05.570283 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-629d20e2-d5b0-4e3b-9096-e3dd1be4446d tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.268978 Feb 12 21:30:05.571571 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2822/5511] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:05 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:06.089282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:06.091628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:06.116149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:06.120218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:06.121535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:06.122179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:06.207740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:06.217654 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a2c804a-b5c7-440d-9091-ae385e9c300b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1326 microversion: 2.1 time: 0.135664 Feb 12 21:30:06.218447 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2690/5512] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:06 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:06.589606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:06.590474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:06.598558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:06.599134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:06.600014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:06.600560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:06.795136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:06.814362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9eda005b-113a-4c88-bd78-9f80342662c4 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1263 microversion: 2.1 time: 0.219676 Feb 12 21:30:06.815448 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2823/5513] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:06 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1263 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:07.239123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:07.239803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:07.251355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:07.251581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:07.252778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:07.254037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:07.375145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:07.394803 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-17c541db-8efc-488d-b323-3e7350b18f9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1324 microversion: 2.1 time: 0.160579 Feb 12 21:30:07.397556 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2691/5514] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:07 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:07.823956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:07.824365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:07.832478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:07.833219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:07.834222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:07.834889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:08.120741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:08.128495 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a224245-01cb-4311-9ace-b256c477d259 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1451 microversion: 2.1 time: 0.309247 Feb 12 21:30:08.133330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2824/5515] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:07 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1451 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:08.150268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:08.151360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:08.162866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:08.164396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:08.167683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:08.168622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:08.413432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:08.414803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:08.420895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:08.421389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:08.422420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:08.422796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:08.656511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:08.708836 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d3c07f9-7177-4770-868c-143a06bd5604 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1391 microversion: 2.1 time: 0.279133 Feb 12 21:30:08.711147 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2825/5516] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:08 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1391 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:30:08.751278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:08.764224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec688fd6-9a34-49b9-8c19-382e871d0595 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1451 microversion: 2.1 time: 0.618454 Feb 12 21:30:08.764840 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2692/5517] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:08 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1451 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:09.730466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:09.732094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:09.741137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:09.742074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:09.743207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:09.744421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:09.818532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6b9d0260-4ee2-4e21-9e8a-11864adbc539 req-f28b2564-1204-4408-ba54-7e22b166e652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:09.821392 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:09.821392 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:30:09.863724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6b9d0260-4ee2-4e21-9e8a-11864adbc539 req-f28b2564-1204-4408-ba54-7e22b166e652 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:09.866358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6b9d0260-4ee2-4e21-9e8a-11864adbc539 req-f28b2564-1204-4408-ba54-7e22b166e652 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:09.907974 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6b9d0260-4ee2-4e21-9e8a-11864adbc539 req-f28b2564-1204-4408-ba54-7e22b166e652 service nova] Creating event network-changed:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch2-master-1 Feb 12 21:30:09.914918 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6b9d0260-4ee2-4e21-9e8a-11864adbc539 req-f28b2564-1204-4408-ba54-7e22b166e652 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109602 Feb 12 21:30:09.920446 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2693/5518] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:30:10.641993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:10.651909 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dd788257-2d9b-4036-b83e-51698d0f9777 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1391 microversion: 2.1 time: 0.928296 Feb 12 21:30:10.653285 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2826/5519] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:09 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1391 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:11.670466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:11.671184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:11.688897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:11.689498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:11.690722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:11.691401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:11.840034 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:30:11.848867 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 21:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 (ip 10.222.0.31) !!! Feb 12 21:30:12.674947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:12.683265 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-235cd95a-2130-4c9b-afe5-cb5ea4a3979a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1391 microversion: 2.1 time: 1.018869 Feb 12 21:30:12.684010 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2694/5520] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:11 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1391 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:13.700455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:13.701717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:13.716168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:13.716967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:13.718054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:13.718709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:14.267950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:14.272985 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2044eda-b046-4024-b9ae-aae45643ae0c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1391 microversion: 2.1 time: 0.576350 Feb 12 21:30:14.276237 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2827/5521] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:13 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1391 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:14.758129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6c895909-f0d1-4466-9db1-87b9b537bbfa req-f6b140fd-149e-4526-a3fe-0ea02f52e33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "name": "network-vif-plugged", "status": "completed", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:14.764110 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:14.764110 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:30:14.778158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6c895909-f0d1-4466-9db1-87b9b537bbfa req-f6b140fd-149e-4526-a3fe-0ea02f52e33f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:14.778603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6c895909-f0d1-4466-9db1-87b9b537bbfa req-f6b140fd-149e-4526-a3fe-0ea02f52e33f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:14.789660 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6c895909-f0d1-4466-9db1-87b9b537bbfa req-f6b140fd-149e-4526-a3fe-0ea02f52e33f service nova] Creating event network-vif-plugged:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch2-master-1 Feb 12 21:30:14.795528 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6c895909-f0d1-4466-9db1-87b9b537bbfa req-f6b140fd-149e-4526-a3fe-0ea02f52e33f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042374 Feb 12 21:30:14.796133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2695/5522] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:30:15.293808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:15.295034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:15.303631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:15.304778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:15.308991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:15.314307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:15.600015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:15.610515 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c8e9ba2-f889-463e-ac11-9005aae8918e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1391 microversion: 2.1 time: 0.320941 Feb 12 21:30:15.613135 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2696/5523] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:15 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:30:15.661680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a7357c60-58da-4cc4-bb54-9907591bac23 req-8b73f643-6c69-44f4-9ff3-9dda4df81e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b70a65-6aa4-49d4-8415-1eda9c7671c0", "tag": "eb4be2e6-f5ae-4480-94a3-2f75ffe8516f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:15.663709 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:15.663709 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:30:15.679107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a7357c60-58da-4cc4-bb54-9907591bac23 req-8b73f643-6c69-44f4-9ff3-9dda4df81e5e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:15.679541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a7357c60-58da-4cc4-bb54-9907591bac23 req-8b73f643-6c69-44f4-9ff3-9dda4df81e5e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:15.709664 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a7357c60-58da-4cc4-bb54-9907591bac23 req-8b73f643-6c69-44f4-9ff3-9dda4df81e5e service nova] Creating event network-changed:eb4be2e6-f5ae-4480-94a3-2f75ffe8516f for instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 on nch1-master-1 Feb 12 21:30:15.719778 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a7357c60-58da-4cc4-bb54-9907591bac23 req-8b73f643-6c69-44f4-9ff3-9dda4df81e5e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478016 Feb 12 21:30:15.722531 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2828/5524] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:30:16.630300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:16.633135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:16.640966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:16.641771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:16.642981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:16.643987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:17.264889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:17.291374 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-07823625-c47e-4f23-8c98-fa619e8d589f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1564 microversion: 2.1 time: 0.663164 Feb 12 21:30:17.292158 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2697/5525] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:16 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1564 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:30:17.309348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:17.310778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:17.320450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:17.321123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:17.322323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:17.322949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:17.597212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:17.604797 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8490b6db-3b47-4db3-b5ad-b5d26dafcfca tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1564 microversion: 2.1 time: 0.299518 Feb 12 21:30:17.605393 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2829/5526] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:17 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1564 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:21.461146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:21.461873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:21.482321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:21.482781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:21.483803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:21.484429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:21.509866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-70590ced-d10d-450f-8170-fc75d9049459 req-79446dce-84a3-4f93-9e39-74edc24f4e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:21.511706 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:21.511706 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:30:21.527098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-70590ced-d10d-450f-8170-fc75d9049459 req-79446dce-84a3-4f93-9e39-74edc24f4e79 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:21.535124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-70590ced-d10d-450f-8170-fc75d9049459 req-79446dce-84a3-4f93-9e39-74edc24f4e79 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:21.541825 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-70590ced-d10d-450f-8170-fc75d9049459 req-79446dce-84a3-4f93-9e39-74edc24f4e79 service nova] Creating event network-changed:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch2-master-1 Feb 12 21:30:21.548455 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-70590ced-d10d-450f-8170-fc75d9049459 req-79446dce-84a3-4f93-9e39-74edc24f4e79 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042919 Feb 12 21:30:21.549991 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2830/5527] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:30:21.924182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:21.935415 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-70a50609-86b9-4a26-9e07-f0034b676d6a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1564 microversion: 2.1 time: 0.477978 Feb 12 21:30:21.936249 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2698/5528] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:21 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1564 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:33.372342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1563043763", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:33.440003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:30:33.879029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:30:33.879029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:30:33.879029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:30:33.879029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:30:33.879655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:30:33.892840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:33.893486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:33.895673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:33.896251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:33.935336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Getting quotas for project 4fb7edbcd0864f13be6f5138d1350e12. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:30:33.942245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Getting quotas for user d083b81672cd463fb6cce6f8a602bb4f and project 4fb7edbcd0864f13be6f5138d1350e12. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:30:33.962261 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:30:33.965851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:30:34.101293 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e9016a5e-447b-4b55-bce9-d9a36eb28863 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734995 Feb 12 21:30:34.114081 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3d40ee88-2b09-443c-88a8-967c7ededd66 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:34.115338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3d40ee88-2b09-443c-88a8-967c7ededd66 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:34.121765 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2831/5529] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:30:34.253721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3d40ee88-2b09-443c-88a8-967c7ededd66 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:34.265004 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3d40ee88-2b09-443c-88a8-967c7ededd66 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1214 microversion: 2.1 time: 0.155924 Feb 12 21:30:34.283933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2699/5530] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:34 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:35.296914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2cdc7195-e7f4-4cc1-83a5-f44de7c8ee0c tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:35.298848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2cdc7195-e7f4-4cc1-83a5-f44de7c8ee0c tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:35.456791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cdc7195-e7f4-4cc1-83a5-f44de7c8ee0c tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:35.502139 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2cdc7195-e7f4-4cc1-83a5-f44de7c8ee0c tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1214 microversion: 2.1 time: 0.209088 Feb 12 21:30:35.504440 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2832/5531] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:35 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:36.525368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:36.527080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:36.545709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:36.549549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:36.549549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:36.550073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:36.654753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:36.670203 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-307e7a27-8eba-4413-b5ea-be3f94dd2c64 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1266 microversion: 2.1 time: 0.148195 Feb 12 21:30:36.670203 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2700/5532] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:36 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:37.685248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:37.685902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:37.700881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:37.701741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:37.702755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:37.703438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:37.858782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:37.867258 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c10f5d2d-c95a-4275-bcc6-a42c48c8025a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1284 microversion: 2.1 time: 0.186939 Feb 12 21:30:37.868991 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2833/5533] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:37 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:38.885933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:38.886720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:38.896400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:38.897221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:38.899444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:38.900127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:39.283635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:39.293835 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb604938-5a60-4029-97a3-fde6e62b7237 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.413259 Feb 12 21:30:39.295764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2701/5534] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:38 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:39.594116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:39.595344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:39.609281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:39.613971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:39.614966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:39.615582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:39.699306 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dd5e505a-6bd6-44e0-9c9e-638be84482d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action" status: 200 len: 24566 microversion: 2.1 time: 0.109488 Feb 12 21:30:39.699306 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2834/5535] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:30:39 2022] POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action => generated 24566 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:30:40.312350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:40.312979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:40.327965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:40.338614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:40.342166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:40.343403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:40.886057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:40.896251 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6ccf9019-479d-4c7c-966a-004aabb0e209 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.587476 Feb 12 21:30:40.898043 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2702/5536] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:40 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:41.185448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5a8184e0-de49-4193-b22a-b72ddf47c9ad req-fccffe96-b8cd-469f-98d9-de8824f351a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2bbf62a-7a91-43c1-82bc-ec91c40dbde3", "tag": "fce44142-693c-41f1-af3f-bb370c995071"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:41.187566 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:41.187566 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:30:41.208504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5a8184e0-de49-4193-b22a-b72ddf47c9ad req-fccffe96-b8cd-469f-98d9-de8824f351a3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:41.208970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5a8184e0-de49-4193-b22a-b72ddf47c9ad req-fccffe96-b8cd-469f-98d9-de8824f351a3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:41.229962 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5a8184e0-de49-4193-b22a-b72ddf47c9ad req-fccffe96-b8cd-469f-98d9-de8824f351a3 service nova] Creating event network-changed:fce44142-693c-41f1-af3f-bb370c995071 for instance f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 on nch1-master-1 Feb 12 21:30:41.235677 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5a8184e0-de49-4193-b22a-b72ddf47c9ad req-fccffe96-b8cd-469f-98d9-de8824f351a3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054532 Feb 12 21:30:41.236799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2835/5537] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:30:41.918981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:41.922168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:41.932923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:41.934987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:41.934987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:41.934987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:42.635536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:42.645114 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-91b4b3ff-f19d-4384-86d1-9acf95c7753d tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.729975 Feb 12 21:30:42.646165 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2703/5538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:41 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:43.667676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:43.667676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:43.673062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:43.673809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:43.675072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:43.675698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:43.913436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:43.938118 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-edcd511f-715c-4749-8400-e29e4f129623 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.268046 Feb 12 21:30:43.938118 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2836/5539] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:43 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:44.945615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:44.946423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:44.953609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:44.954270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:44.955263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:44.956022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:45.126009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:45.135268 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-07d790fe-34df-48ce-b8e2-7a97599ac777 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.193745 Feb 12 21:30:45.135865 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2704/5540] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:44 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:46.157650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:46.158581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:46.166581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:46.167207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:46.168142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:46.169194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:46.746394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:46.756422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6568f783-e2ad-4a53-9022-75231ad7ee5f tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.607099 Feb 12 21:30:46.757023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2837/5541] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:46 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:47.775471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:47.776123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:47.790932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:47.790932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:47.791718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:47.792472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:48.014019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:48.023276 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80807636-a5c0-4bdb-a405-df09c2eb00dc tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.252181 Feb 12 21:30:48.024342 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2705/5542] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:47 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:49.040508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:49.041145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:49.048656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:49.049483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:49.050309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:49.050762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:49.416577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:49.447449 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-238f525a-f958-414f-a843-6d30aa95feb1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.409556 Feb 12 21:30:49.450368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2838/5543] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:49 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:49.523100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-559732b2-8f32-4a55-9b89-a64bcb56c085 req-cc79f559-c8c8-49f8-b309-c7dc10a32361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bbf62a-7a91-43c1-82bc-ec91c40dbde3", "name": "network-vif-plugged", "status": "completed", "tag": "fce44142-693c-41f1-af3f-bb370c995071"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:49.526641 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:30:49.526641 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:30:49.535320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-559732b2-8f32-4a55-9b89-a64bcb56c085 req-cc79f559-c8c8-49f8-b309-c7dc10a32361 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:49.536055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-559732b2-8f32-4a55-9b89-a64bcb56c085 req-cc79f559-c8c8-49f8-b309-c7dc10a32361 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:49.547839 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-559732b2-8f32-4a55-9b89-a64bcb56c085 req-cc79f559-c8c8-49f8-b309-c7dc10a32361 service nova] Creating event network-vif-plugged:fce44142-693c-41f1-af3f-bb370c995071 for instance f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 on nch1-master-1 Feb 12 21:30:49.559707 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-559732b2-8f32-4a55-9b89-a64bcb56c085 req-cc79f559-c8c8-49f8-b309-c7dc10a32361 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049505 Feb 12 21:30:49.560333 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2706/5544] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:30:50.468867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:50.469535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:50.477888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:50.484130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:50.485188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:50.485700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:50.625896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:50.634733 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0fbecb26-f6b3-4298-b1fa-52cb5120601b tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1314 microversion: 2.1 time: 0.169780 Feb 12 21:30:50.635685 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2839/5545] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:50 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:50.751832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:50.752540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:50.759775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:50.760225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:50.761264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:50.761467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.478717 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7efb8398-03c0-4b41-a26d-ee31c2d633a6 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1833 microversion: 2.1 time: 0.731601 Feb 12 21:30:51.479669 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2707/5546] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:50 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1833 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:51.498205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:51.502572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:51.506121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:51.506694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.507770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:51.508955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.654870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:51.655487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:51.662233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:51.662687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.663507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:51.663941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.808907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:51.816952 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a1f1767-039d-48ef-9a4f-0680f7169923 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1682 microversion: 2.1 time: 0.323940 Feb 12 21:30:51.819559 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2840/5547] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:51 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:51.835398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:51.846083 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab685166-227a-4500-8e26-fb542eb63625 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1464 microversion: 2.1 time: 0.197359 Feb 12 21:30:51.849718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2708/5548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:51 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:30:51.865303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d099d6f-2ad2-42c9-afe0-4edb1118f461", "device": "/dev/sdb"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:51.866711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:51.873921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:51.874401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.875226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:51.875683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:51.993264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:51.994573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:52.009966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:52.010829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:52.011938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:52.013568 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:52.092352 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23cb10d4-4d48-499c-9ce0-8e2a0439d419 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action" status: 200 len: 32637 microversion: 2.1 time: 0.104186 Feb 12 21:30:52.093325 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2709/5549] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:30:51 2022] POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action => generated 32637 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:30:52.256124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:30:52.257301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:52.277469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:52.278381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:52.279361 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:52.279979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:52.331197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fdb227d0404f431b907c63e4f01690be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bf2d1931f5422f88f3c3b59905406f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:52.332240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: c607d778-8d84-4f12-a699-036c43189c10] flavor_id is None. Assuming migration. {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4093}} Feb 12 21:30:52.332862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: c607d778-8d84-4f12-a699-036c43189c10] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:30:52.858384 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a4a5d3dc-f0f0-41ca-bbf6-9e3baf0fd1a7 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action" status: 202 len: 0 microversion: 2.1 time: 0.612769 Feb 12 21:30:52.859540 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2710/5550] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:30:52 2022] POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:30:52.874459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:52.875707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:52.896370 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7a44cfc-53a5-42b3-be82-9db451513978 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "POST /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.034803 Feb 12 21:30:52.901823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:52.902349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:52.903449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:52.903792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:52.905270 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2841/5551] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:30:51 2022] POST /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3/os-volume_attachments => generated 194 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:30:53.216499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:53.227933 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c1df275-adc6-42cd-b786-346f7aaff3f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1691 microversion: 2.1 time: 0.360609 Feb 12 21:30:53.227933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2711/5552] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:52 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1691 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:54.251720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:54.252455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:54.273503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:54.275597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:54.276903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:54.277596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:54.493389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:54.500358 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e805f45e-b2d0-45ff-8998-23a37b13f706 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1691 microversion: 2.1 time: 0.258170 Feb 12 21:30:54.506077 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2842/5553] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:54 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1691 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:55.519548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:55.523717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:55.533280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:55.534011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:55.534925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:55.535593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:55.777965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:55.787076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-05228070-d43a-4558-ab4f-79773b5a5a4e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1691 microversion: 2.1 time: 0.272124 Feb 12 21:30:55.787783 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2712/5554] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:55 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:56.806790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:56.813981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:56.821885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:56.822550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:56.823363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:56.823808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:57.053461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:57.062362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00c9dc3e-c8a0-41ac-bc56-1bfcf6501bf1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1691 microversion: 2.1 time: 0.260855 Feb 12 21:30:57.062881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2843/5555] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:56 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1691 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:58.081326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:58.082190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:58.089749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:58.090208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:58.091046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:58.091488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:58.396440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:58.409908 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09717bca-216b-454b-9873-f256c3e5702d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.333334 Feb 12 21:30:58.411380 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2713/5556] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:58 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:30:59.432400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:30:59.433218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:30:59.449813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:59.451008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:59.452327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:30:59.453769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:30:59.717874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:30:59.725374 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-00a290f1-7866-4764-b0a7-b1b94b46a60e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.296879 Feb 12 21:30:59.726042 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2844/5557] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:30:59 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:00.751283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:00.751916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:00.762423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:00.763250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:00.764353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:00.764930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:01.093577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:01.110531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-545522bf-e12a-4cc1-bdf9-3a773bad1bf0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.369881 Feb 12 21:31:01.111441 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2714/5558] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:00 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:02.129519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:02.130155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:02.138253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:02.138723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:02.139736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:02.140532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:02.313947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:02.322483 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-391af967-f28d-466d-86cb-aec3ad8af073 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.196795 Feb 12 21:31:02.323090 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2845/5559] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:02 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:03.357194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:03.359957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:03.369949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:03.371283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:03.372501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:03.373107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:03.885573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:03.895368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5842429b-ad75-4a92-ae7f-f8cb781b75fa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.543384 Feb 12 21:31:03.895969 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2715/5560] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:03 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:04.912011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:04.912638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:04.919769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:04.920247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:04.921053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:04.921693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:05.134002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:05.141724 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f15520eb-c359-4ab5-ac4e-84e6b9211b3f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.233475 Feb 12 21:31:05.142292 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2846/5561] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:04 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:06.159756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:06.160728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:06.169697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:06.170240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:06.171228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:06.171763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:06.314181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:06.327842 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80983c6e-fe6d-4859-8a68-0571296d78b4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.172019 Feb 12 21:31:06.338295 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2716/5562] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:06 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:07.354106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:07.354764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:07.362408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:07.362880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:07.363691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:07.364175 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:07.553139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:07.562229 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ca0ea01b-715b-4c1d-9eac-17de0647fba5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.212714 Feb 12 21:31:07.562824 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2847/5563] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:07 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:08.579618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:08.581128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:08.589113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:08.589862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:08.591016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:08.591606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:08.876372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:08.885088 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4711c241-1858-432f-b4bb-1925a4fbe4e6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1696 microversion: 2.1 time: 0.309656 Feb 12 21:31:08.885720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2717/5564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:08 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1696 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:09.903931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:09.904628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:09.913437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:09.913597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:09.915035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:09.915534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:10.080274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-23a7b941-cdea-44f0-a1b4-dd723c5e8ebf req-71ae74cb-f2f5-4d63-b383-95fa0706fd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "name": "network-vif-unplugged", "status": "completed", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:10.082855 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:31:10.082855 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:31:10.104865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-23a7b941-cdea-44f0-a1b4-dd723c5e8ebf req-71ae74cb-f2f5-4d63-b383-95fa0706fd58 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:10.105605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-23a7b941-cdea-44f0-a1b4-dd723c5e8ebf req-71ae74cb-f2f5-4d63-b383-95fa0706fd58 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:10.126196 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-23a7b941-cdea-44f0-a1b4-dd723c5e8ebf req-71ae74cb-f2f5-4d63-b383-95fa0706fd58 service nova] Creating event network-vif-unplugged:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch1-master-1 Feb 12 21:31:10.128958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:10.136071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-23a7b941-cdea-44f0-a1b4-dd723c5e8ebf req-71ae74cb-f2f5-4d63-b383-95fa0706fd58 service nova] Instance c607d778-8d84-4f12-a699-036c43189c10 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:31:10.138611 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2a3c1d04-3977-481a-a558-987270026320 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1695 microversion: 2.1 time: 0.239491 Feb 12 21:31:10.156334 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2848/5565] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:09 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1695 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:10.167196 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-23a7b941-cdea-44f0-a1b4-dd723c5e8ebf req-71ae74cb-f2f5-4d63-b383-95fa0706fd58 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092381 Feb 12 21:31:10.169083 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2718/5566] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:31:11.168379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:11.168999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:11.175974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:11.176441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:11.177244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:11.177883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:11.437137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:11.458202 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73e2216f-bbdc-484c-8eeb-807cc16f05ff tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1695 microversion: 2.1 time: 0.293950 Feb 12 21:31:11.459532 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2849/5567] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:11 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1695 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:12.204220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e06df0db-447f-4e17-8e42-23c3a38e6a1d req-3b6edb35-9115-4656-8db0-a9668477a89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:12.204220 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:31:12.204220 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:31:12.214200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e06df0db-447f-4e17-8e42-23c3a38e6a1d req-3b6edb35-9115-4656-8db0-a9668477a89a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:12.221421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e06df0db-447f-4e17-8e42-23c3a38e6a1d req-3b6edb35-9115-4656-8db0-a9668477a89a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:12.238861 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e06df0db-447f-4e17-8e42-23c3a38e6a1d req-3b6edb35-9115-4656-8db0-a9668477a89a service nova] Creating event network-changed:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch1-master-1 Feb 12 21:31:12.244931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-e06df0db-447f-4e17-8e42-23c3a38e6a1d req-3b6edb35-9115-4656-8db0-a9668477a89a service nova] Instance c607d778-8d84-4f12-a699-036c43189c10 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:31:12.261286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e06df0db-447f-4e17-8e42-23c3a38e6a1d req-3b6edb35-9115-4656-8db0-a9668477a89a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066657 Feb 12 21:31:12.262729 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2719/5568] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:31:12.476526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:12.477412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:12.485030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:12.485822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:12.486669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:12.487122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:12.743378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:12.756541 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9b42c7e-81ca-44e5-a767-bd0135366eea tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1695 microversion: 2.1 time: 0.283999 Feb 12 21:31:12.768583 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2850/5569] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:12 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1695 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:13.777129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:13.778414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:13.787151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:13.787607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:13.788403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:13.788837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:13.974767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:13.989602 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99f3bb21-fc52-4a77-8695-f7339ea96d51 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1693 microversion: 2.1 time: 0.218644 Feb 12 21:31:13.991366 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2720/5570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:13 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1693 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:15.009224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:15.009993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:15.034398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:15.035328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:15.039438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:15.041788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:15.380612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:15.389106 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27a98a5d-e05b-4405-a289-b6d24ff33217 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1693 microversion: 2.1 time: 0.384749 Feb 12 21:31:15.390198 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2851/5571] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:15 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1693 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:16.423205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:16.423840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:16.443754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:16.444470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:16.445730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:16.446617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:16.754940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:16.768922 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-117cfe64-c757-4b2f-8f02-2548e11742aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1690 microversion: 2.1 time: 0.365260 Feb 12 21:31:16.770007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2721/5572] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:16 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1690 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:16.791479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:16.792250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:16.802996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:16.807021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:16.808158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:16.810485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:17.040559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9fa61cb-7464-4989-a294-a3aaa98de05a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action" status: 204 len: 0 microversion: 2.1 time: 0.254462 Feb 12 21:31:17.046813 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2852/5573] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:31:16 2022] POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:31:17.063537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:17.064746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:17.076344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:17.076916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:17.078035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:17.078623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:17.408866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:17.442864 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-027ea5f5-91dc-493c-8697-bd79df81ef25 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1690 microversion: 2.1 time: 0.392145 Feb 12 21:31:17.457311 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2722/5574] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:17 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1690 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:18.462808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:18.463492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:18.470421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:18.470805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:18.471699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:18.472353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:19.125185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-144db543-390d-47ac-b91f-79bfb9a99230 req-e5d2d821-93d5-4843-8c38-01383ce8ec7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "name": "network-vif-plugged", "status": "completed", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:19.129267 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:31:19.129267 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:31:19.141013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-144db543-390d-47ac-b91f-79bfb9a99230 req-e5d2d821-93d5-4843-8c38-01383ce8ec7f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:19.142201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-144db543-390d-47ac-b91f-79bfb9a99230 req-e5d2d821-93d5-4843-8c38-01383ce8ec7f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:19.145258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:19.156559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3f42ce7-ab7b-4353-a4e3-9a6d843ff5c5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1690 microversion: 2.1 time: 0.699663 Feb 12 21:31:19.161457 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2853/5575] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:18 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1690 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:19.161589 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-144db543-390d-47ac-b91f-79bfb9a99230 req-e5d2d821-93d5-4843-8c38-01383ce8ec7f service nova] Creating event network-vif-plugged:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch1-master-1 Feb 12 21:31:19.164092 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-144db543-390d-47ac-b91f-79bfb9a99230 req-e5d2d821-93d5-4843-8c38-01383ce8ec7f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045070 Feb 12 21:31:19.165769 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2723/5576] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:31:20.176838 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:20.178171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:20.186783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:20.187256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:20.188074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:20.188525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:20.430615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:20.438241 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1128e4bc-8465-414d-b56d-3e0e03cd234b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1682 microversion: 2.1 time: 0.265279 Feb 12 21:31:20.438812 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2854/5577] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:20 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:23.112195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:23.112871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:23.120062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:23.120516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:23.121527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:23.121967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:23.245530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lazy-loading 'services' on Instance uuid f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:31:23.537014 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6a092c11-4a4c-42e2-aca8-2588acf176f4 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3/os-volume_attachments/3d099d6f-2ad2-42c9-afe0-4edb1118f461" status: 202 len: 0 microversion: 2.1 time: 0.429315 Feb 12 21:31:23.538157 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2724/5578] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:31:23 2022] DELETE /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3/os-volume_attachments/3d099d6f-2ad2-42c9-afe0-4edb1118f461 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:31:25.765535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:25.766043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:25.774402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:25.780132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:25.780132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:25.780132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:25.806832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:31:26.251800 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d264e6e5-9814-4b5d-8dfb-34c202a19cca tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 204 len: 0 microversion: 2.1 time: 0.489557 Feb 12 21:31:26.253234 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2855/5579] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:31:25 2022] DELETE /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:31:26.264734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:26.266439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:26.275422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:26.283498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:26.283498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:26.283498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:26.505953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:26.514357 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe9e1e56-c0ac-4a58-8688-7c81f492f915 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1470 microversion: 2.1 time: 0.256696 Feb 12 21:31:26.514933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2725/5580] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:26 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:31:27.532610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:27.533275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:27.540169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:27.540642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:27.541677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:27.542577 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:27.763053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:27.771264 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6df47d22-9c09-4c08-9058-983fc9334151 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1470 microversion: 2.1 time: 0.242868 Feb 12 21:31:27.771852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2856/5581] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:27 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:28.771077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f0029a30-6fcb-4a81-ad69-b91e0e5f6734 req-473846b9-6cdc-432c-b9a0-fdd333ce6938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bbf62a-7a91-43c1-82bc-ec91c40dbde3", "name": "network-vif-deleted", "tag": "fce44142-693c-41f1-af3f-bb370c995071"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:28.774244 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:31:28.774244 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:31:28.783574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f0029a30-6fcb-4a81-ad69-b91e0e5f6734 req-473846b9-6cdc-432c-b9a0-fdd333ce6938 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:28.795205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f0029a30-6fcb-4a81-ad69-b91e0e5f6734 req-473846b9-6cdc-432c-b9a0-fdd333ce6938 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:28.795362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:28.795362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:28.799485 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f0029a30-6fcb-4a81-ad69-b91e0e5f6734 req-473846b9-6cdc-432c-b9a0-fdd333ce6938 service nova] Creating event network-vif-deleted:fce44142-693c-41f1-af3f-bb370c995071 for instance f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 on nch1-master-1 Feb 12 21:31:28.802180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:28.802720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:28.805314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:28.806176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:28.806853 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f0029a30-6fcb-4a81-ad69-b91e0e5f6734 req-473846b9-6cdc-432c-b9a0-fdd333ce6938 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039800 Feb 12 21:31:28.809039 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2726/5582] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:31:28.889938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:28.898154 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9028ced6-6e9b-4280-ba85-850c59d128e1 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1428 microversion: 2.1 time: 0.111897 Feb 12 21:31:28.899704 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2857/5583] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:28 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:29.918133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:29.918850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:29.926736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:29.927458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:29.928473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:29.929056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:29.966322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:29.967724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:29.968374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lazy-loading 'fault' on Instance uuid f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:31:30.012028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd083b81672cd463fb6cce6f8a602bb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb7edbcd0864f13be6f5138d1350e12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:30.019965 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60c21d7b-8393-4763-8a6b-3a03c49d4388 tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 200 len: 1304 microversion: 2.1 time: 0.107583 Feb 12 21:31:30.021732 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2727/5584] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:29 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:31.038280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:31.040259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] [instance: f2bbf62a-7a91-43c1-82bc-ec91c40dbde3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:31.047614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:31.048086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:31.048888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:31.049460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:31.064172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] HTTP exception thrown: Instance f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 could not be found. Feb 12 21:31:31.066061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] Returning 404 to user: Instance f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:31:31.066061 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-765b7e13-635e-4ed9-85f5-51c909aa290a tempest-VolumesBackupsTest-835000994 tempest-VolumesBackupsTest-835000994-project] 10.222.0.31 "GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3" status: 404 len: 111 microversion: 2.1 time: 0.031373 Feb 12 21:31:31.066379 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2858/5585] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:31 2022] GET /compute/v2.1/servers/f2bbf62a-7a91-43c1-82bc-ec91c40dbde3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:31:42.627842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:42.628771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:42.636813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:42.637267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:42.638138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:42.638748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:42.692198 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-732b7bf9-af12-4365-a742-85d0e065c24f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action" status: 200 len: 24528 microversion: 2.1 time: 0.068098 Feb 12 21:31:42.693773 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2728/5586] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:31:42 2022] POST /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10/action => generated 24528 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:31:49.170817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:49.171451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:49.183229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:49.187790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:49.187790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:49.187790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:49.396764 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89585a7a-0bbf-44c1-bb4e-15c9e1ffd321 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1833 microversion: 2.1 time: 0.230839 Feb 12 21:31:49.397367 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2859/5587] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:49 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1833 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:50.636967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:50.638125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:50.648932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d6decaed-05b1-4a20-acce-3b3a2da685f2 req-8b6762da-7f2b-4136-b605-35f23a55bea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:50.654397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:50.654397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:50.655125 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:31:50.655125 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:31:50.655273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:50.655273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:50.667095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d6decaed-05b1-4a20-acce-3b3a2da685f2 req-8b6762da-7f2b-4136-b605-35f23a55bea5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:50.668286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d6decaed-05b1-4a20-acce-3b3a2da685f2 req-8b6762da-7f2b-4136-b605-35f23a55bea5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:50.692538 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d6decaed-05b1-4a20-acce-3b3a2da685f2 req-8b6762da-7f2b-4136-b605-35f23a55bea5 service nova] Creating event network-changed:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch1-master-1 Feb 12 21:31:50.703573 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d6decaed-05b1-4a20-acce-3b3a2da685f2 req-8b6762da-7f2b-4136-b605-35f23a55bea5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065016 Feb 12 21:31:50.705069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2860/5588] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:31:50.756243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:31:51.373002 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6ffbb604-706b-4367-a7f1-a09dd646a375 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 204 len: 0 microversion: 2.1 time: 0.740538 Feb 12 21:31:51.373651 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2729/5589] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:31:50 2022] DELETE /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:31:51.382525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:51.383423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:51.407222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:51.408098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:51.409186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:51.409819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:51.435481 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:31:51.435871 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 21:31:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 (ip 10.222.0.31) !!! Feb 12 21:31:51.682485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:51.691860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5bac78bd-8a90-46a3-b47b-de614a6241f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1688 microversion: 2.1 time: 0.313531 Feb 12 21:31:51.707410 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2861/5590] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:51 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1688 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:51.746802 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:31:51.747637 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 21:31:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:31:52.727798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:52.728550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:52.736131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:52.747115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:52.754212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:52.754212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:53.544316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:53.560945 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffc02f32-07db-4d87-b602-32485c6452e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1570 microversion: 2.1 time: 0.839769 Feb 12 21:31:53.573118 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2730/5591] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:52 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1570 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:53.987865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-633433c1-68d3-408e-b0fb-07304a0d96ee req-dfa863a9-b50e-4a57-acb1-65476aebf833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c607d778-8d84-4f12-a699-036c43189c10", "name": "network-vif-deleted", "tag": "91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:31:53.991610 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:31:53.991610 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:31:54.005015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-633433c1-68d3-408e-b0fb-07304a0d96ee req-dfa863a9-b50e-4a57-acb1-65476aebf833 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:54.005691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-633433c1-68d3-408e-b0fb-07304a0d96ee req-dfa863a9-b50e-4a57-acb1-65476aebf833 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:54.020579 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-633433c1-68d3-408e-b0fb-07304a0d96ee req-dfa863a9-b50e-4a57-acb1-65476aebf833 service nova] Creating event network-vif-deleted:91d0cbf6-2c43-4e08-8ed1-9cc3ca1475e6 for instance c607d778-8d84-4f12-a699-036c43189c10 on nch1-master-1 Feb 12 21:31:54.027471 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-633433c1-68d3-408e-b0fb-07304a0d96ee req-dfa863a9-b50e-4a57-acb1-65476aebf833 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043302 Feb 12 21:31:54.031170 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2862/5592] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:31:54.589985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:54.590603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:54.614478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:54.614932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:54.615836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:54.616275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:54.659082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:54.659213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:54.659614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lazy-loading 'fault' on Instance uuid c607d778-8d84-4f12-a699-036c43189c10 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:31:54.732024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:31:54.741348 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6c39dc30-348c-4fd3-8573-1702e5c709f8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 200 len: 1356 microversion: 2.1 time: 0.155347 Feb 12 21:31:54.742134 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2731/5593] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:54 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:31:55.764336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:31:55.765655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: c607d778-8d84-4f12-a699-036c43189c10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:31:55.776652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:55.777196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:55.778143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:31:55.778799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:31:55.802039 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] HTTP exception thrown: Instance c607d778-8d84-4f12-a699-036c43189c10 could not be found. Feb 12 21:31:55.802754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Returning 404 to user: Instance c607d778-8d84-4f12-a699-036c43189c10 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:31:55.803687 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-211b2b71-d76b-4a00-9acd-30350ae2bbba tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10" status: 404 len: 111 microversion: 2.1 time: 0.048292 Feb 12 21:31:55.804347 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2863/5594] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:31:55 2022] GET /compute/v2.1/servers/c607d778-8d84-4f12-a699-036c43189c10 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:32:01.161638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ae031fb-0140-4ac2-8bdc-879b00e3872e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '.version_select at 0x7fa8fd2550d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:01.264830 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ae031fb-0140-4ac2-8bdc-879b00e3872e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1911192451" status: 202 len: 0 microversion: 2.1 time: 0.107124 Feb 12 21:32:01.266128 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2732/5595] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 21:32:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1911192451 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:32:01.300521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c30fc688-8a29-46ec-ac97-36df8b379751 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: .version_select at 0x7fa8fc6c0e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2140969605"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:01.323392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c30fc688-8a29-46ec-ac97-36df8b379751 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:32:01.331005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c30fc688-8a29-46ec-ac97-36df8b379751 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:32:01.509274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c30fc688-8a29-46ec-ac97-36df8b379751 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:32:01.514828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-c30fc688-8a29-46ec-ac97-36df8b379751 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:32:01.531376 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c30fc688-8a29-46ec-ac97-36df8b379751 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.234651 Feb 12 21:32:01.532253 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2864/5596] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:32:01 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:11.583874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-614661464", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "1810a1d4-616d-4b30-be12-037b7e4e2756"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2140969605", "security_groups": [{"name": "tempest-secgroup-smoke-341134535"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:11.772807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] validate_networks() for [('1810a1d4-616d-4b30-be12-037b7e4e2756', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:32:12.534883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:32:12.536235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:32:12.537008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:32:12.537918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:32:12.538845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:32:12.549859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:12.550311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:12.551124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:12.552297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:12.570445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:32:12.579048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:32:12.601138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:32:12.606213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:32:12.723468 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98d57f58-0520-4575-8f52-e206cc8575f3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.143467 Feb 12 21:32:12.724298 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2733/5597] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:32:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:32:12.735139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-886f993c-5aef-4eac-b469-6c66d52f4dfe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:12.736010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-886f993c-5aef-4eac-b469-6c66d52f4dfe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:13.268372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-886f993c-5aef-4eac-b469-6c66d52f4dfe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:13.275288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-886f993c-5aef-4eac-b469-6c66d52f4dfe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1266 microversion: 2.1 time: 0.543071 Feb 12 21:32:13.276071 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2865/5598] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:12 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1266 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:14.294994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:14.295821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:14.305759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:14.307468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:14.308747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:14.309340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:14.392216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:14.401893 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e079baa5-951e-4d16-aa69-17b0c35093e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1262 microversion: 2.1 time: 0.111285 Feb 12 21:32:14.402969 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2734/5599] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:14 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1262 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:15.420078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:15.421232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:15.429856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:15.430358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:15.431777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:15.432894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:15.498219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:15.507334 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-22a6655d-5721-4a09-a32f-5e4e836e283b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1336 microversion: 2.1 time: 0.091905 Feb 12 21:32:15.508177 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2866/5600] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:15 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1336 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:16.524808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:16.525553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:16.532575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:16.533022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:16.533835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:16.534268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:16.759083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:16.767404 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-134d1c95-90c7-483d-b0a4-06c4cbe5ffa4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.246517 Feb 12 21:32:16.768046 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2735/5601] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:16 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:17.591738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ee4bc298-2d29-45ef-ab94-35dacf8f8430 req-f9156912-fe7c-4170-9320-d82050fb716f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:17.594004 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:32:17.594004 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:32:17.602299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ee4bc298-2d29-45ef-ab94-35dacf8f8430 req-f9156912-fe7c-4170-9320-d82050fb716f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:17.602761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ee4bc298-2d29-45ef-ab94-35dacf8f8430 req-f9156912-fe7c-4170-9320-d82050fb716f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:17.624750 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ee4bc298-2d29-45ef-ab94-35dacf8f8430 req-f9156912-fe7c-4170-9320-d82050fb716f service nova] Creating event network-changed:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:32:17.630034 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ee4bc298-2d29-45ef-ab94-35dacf8f8430 req-f9156912-fe7c-4170-9320-d82050fb716f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043042 Feb 12 21:32:17.630639 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2867/5602] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:32:17.788239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:17.788902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:17.798749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:17.799200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:17.799996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:17.800430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:18.486144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:18.493594 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f687aba0-1747-4f35-b225-97c57f9b79d0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.709647 Feb 12 21:32:18.494416 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2736/5603] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:17 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:19.511691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:19.512480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:19.519850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:19.520315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:19.521715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:19.522167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:19.666763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:19.674966 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e0a5210-a873-442c-9078-33ee01dee30f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.167325 Feb 12 21:32:19.675476 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2868/5604] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:19 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:32:20.692771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:20.693446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:20.701200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:20.701848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:20.702705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:20.703127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:20.850347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:20.857899 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27f84791-1f81-4fd5-aa72-dfa4bd18b16e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.169673 Feb 12 21:32:20.858479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2737/5605] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:20 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:21.876173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:21.881620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:21.885539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:21.886017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:21.886841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:21.887300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:22.035311 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:22.043386 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a678b84d-2c68-4cbe-80e7-2e8857c3ed79 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.171960 Feb 12 21:32:22.043980 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2869/5606] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:21 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:23.060976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:23.061628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:23.069672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:23.070122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:23.070944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:23.071472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:23.112939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fc7e4b6a-3c15-49ee-8f22-4c4b571be244 req-d3190675-5737-4c39-bb9a-bcee13717777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "name": "network-vif-plugged", "status": "completed", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:23.115311 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:32:23.115311 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:32:23.125208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fc7e4b6a-3c15-49ee-8f22-4c4b571be244 req-d3190675-5737-4c39-bb9a-bcee13717777 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:23.125695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fc7e4b6a-3c15-49ee-8f22-4c4b571be244 req-d3190675-5737-4c39-bb9a-bcee13717777 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:23.142340 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fc7e4b6a-3c15-49ee-8f22-4c4b571be244 req-d3190675-5737-4c39-bb9a-bcee13717777 service nova] Creating event network-vif-plugged:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:32:23.149860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fc7e4b6a-3c15-49ee-8f22-4c4b571be244 req-d3190675-5737-4c39-bb9a-bcee13717777 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038852 Feb 12 21:32:23.149860 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2870/5607] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:32:23.274372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:23.282447 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51858c18-8e3e-4f3b-a105-5823946d36d8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.225232 Feb 12 21:32:23.283276 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2738/5608] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:23 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:24.301319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:24.303087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:24.314765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:24.316137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:24.320358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:24.320358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:24.503172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:24.512695 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9310324f-14b4-4f65-94e2-793691030598 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1391 microversion: 2.1 time: 0.215437 Feb 12 21:32:24.523345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2871/5609] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:24 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:25.530119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:25.530671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:25.537665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:25.538117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:25.538910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:25.539348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:25.688252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:25.695626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e82eeaeb-cb3f-40a6-b5a2-371bd5572c49 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1563 microversion: 2.1 time: 0.169378 Feb 12 21:32:25.696206 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2739/5610] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:25 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:25.712110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:25.713238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:25.720029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:25.720561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:25.721382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:25.721839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:25.865377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:25.879799 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-95303ede-fca3-45d6-b3d9-ea85d7e71c9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1563 microversion: 2.1 time: 0.165772 Feb 12 21:32:25.879799 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2872/5611] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:25 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:28.405214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:28.405881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:28.415417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-93a78370-0346-4a18-913e-6e0e1f92fc11 req-e02727b0-f61f-4a6d-b1d9-41d377a7b6bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:28.418515 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:32:28.418515 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:32:28.427164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:28.432523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-93a78370-0346-4a18-913e-6e0e1f92fc11 req-e02727b0-f61f-4a6d-b1d9-41d377a7b6bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:28.432523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-93a78370-0346-4a18-913e-6e0e1f92fc11 req-e02727b0-f61f-4a6d-b1d9-41d377a7b6bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:28.433911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:28.434740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:28.435190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:28.448024 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-93a78370-0346-4a18-913e-6e0e1f92fc11 req-e02727b0-f61f-4a6d-b1d9-41d377a7b6bb service nova] Creating event network-changed:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:32:28.454001 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-93a78370-0346-4a18-913e-6e0e1f92fc11 req-e02727b0-f61f-4a6d-b1d9-41d377a7b6bb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042587 Feb 12 21:32:28.454972 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2873/5612] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:32:28.683674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:28.705558 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-18a6cd94-0985-4aa2-a6d7-03dee14308e8 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1563 microversion: 2.1 time: 0.294399 Feb 12 21:32:28.712033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2740/5613] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:28 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1563 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:48.034341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:48.035363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:48.042682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:48.043155 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:48.043965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:48.044447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:48.096065 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-18c0c2b9-9eef-4f8f-80eb-1f942a4d4cfa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action" status: 200 len: 24571 microversion: 2.1 time: 0.066603 Feb 12 21:32:48.096883 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2874/5614] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:32:48 2022] POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:32:59.085840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:59.086689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:59.093325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.093944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.095131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.095505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.302676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c844927-f110-4824-9bce-ee73eb8a8b80 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1833 microversion: 2.1 time: 0.220971 Feb 12 21:32:59.306566 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2741/5615] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:59 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1833 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:59.319646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:32:59.320349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:59.328705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.329197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.330011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.330459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.484964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:59.492937 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1bf81e9-66c7-4903-92cf-309ac5237f61 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1682 microversion: 2.1 time: 0.177222 Feb 12 21:32:59.493553 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2875/5616] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:32:59 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:32:59.595262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:59.596252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:59.602666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.603127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.603970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.604418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.654024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a557a45f-b159-4f97-86f6-360f2f6aaf3a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action" status: 200 len: 32649 microversion: 2.1 time: 0.062632 Feb 12 21:32:59.654792 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2742/5617] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:32:59 2022] POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action => generated 32649 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:32:59.813153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:32:59.813760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:32:59.820374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.820832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.821710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:32:59.822113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:32:59.867659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fdb227d0404f431b907c63e4f01690be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bf2d1931f5422f88f3c3b59905406f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:32:59.868282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] flavor_id is None. Assuming migration. {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4093}} Feb 12 21:32:59.868765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:33:00.263082 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [a72e85b0-f60e-468d-9ed6-d5aae93a2076] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 21:33:01.273142 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [a72e85b0-f60e-468d-9ed6-d5aae93a2076] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 35232. Feb 12 21:33:01.276793 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-989742ae-9e07-4c83-8e95-a8670441cfbe tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action" status: 202 len: 0 microversion: 2.1 time: 1.468123 Feb 12 21:33:01.277703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2876/5618] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:32:59 2022] POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action => generated 0 bytes in 1470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:33:01.287351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:01.300083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:01.300083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:01.300083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:01.300083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:01.300083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:01.449945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:01.458213 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d8698cde-7cb9-4a62-a4cd-a555b94393e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.175078 Feb 12 21:33:01.458791 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2743/5619] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:01 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:02.477026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:02.477730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:02.486833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:02.486833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:02.486833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:02.486833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:02.647818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:02.658792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b7b1c61-f8e3-405f-9f2a-99acc4221100 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.186236 Feb 12 21:33:02.659917 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2877/5620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:02 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:03.681251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:03.682149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:03.689771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:03.690292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:03.691159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:03.691628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:03.836858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:03.852212 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-07534975-e616-43e1-b1f0-732e38762a02 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.175129 Feb 12 21:33:03.853202 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2744/5621] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:03 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:04.870058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:04.870689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:04.878347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:04.878843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:04.879668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:04.880130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:05.043620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:05.053136 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c43cb81d-f452-4b9e-a521-ba5aa06f27f1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.186057 Feb 12 21:33:05.054813 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2878/5622] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:04 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:06.069621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:06.070220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:06.077192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:06.077791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:06.078585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:06.079027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:06.219737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:06.227149 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f9c8bb91-c97f-4685-a847-c262170e62c0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.161459 Feb 12 21:33:06.227720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2745/5623] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:06 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:07.195718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1508203280", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:07.249622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:07.249622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:07.254863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] validate_networks() for None {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:33:07.264145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:07.264642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:07.265519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:07.266122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:07.485466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:33:07.486491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:33:07.487528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:33:07.487961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:33:07.488390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:33:07.498421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:07.498961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:07.499831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:07.500286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:07.505916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:07.517521 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9dee3816-846e-4da8-a12a-2629d9e91a4d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.274628 Feb 12 21:33:07.527226 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2746/5624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:07 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:07.531960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Getting quotas for project 753fef9387244d0d98dccfd7cf8ca9e2. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:33:07.531960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Getting quotas for user ad5f8388ce794f75bcb468047ef2393c and project 753fef9387244d0d98dccfd7cf8ca9e2. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:33:07.543149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:33:07.546029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:33:07.936881 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8354dd0a-dc8b-4ba2-b159-3fb791756642 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744939 Feb 12 21:33:07.937899 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2879/5625] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:33:07.952879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f7ac3f3d-2d5e-4795-be41-4205692da0fa tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:07.953697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f7ac3f3d-2d5e-4795-be41-4205692da0fa tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:08.019267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f7ac3f3d-2d5e-4795-be41-4205692da0fa tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:08.026777 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f7ac3f3d-2d5e-4795-be41-4205692da0fa tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1215 microversion: 2.1 time: 0.082687 Feb 12 21:33:08.027498 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2747/5626] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:07 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:08.542748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:08.545260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:08.557741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:08.558452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:08.559553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:08.560223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:08.744359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:08.752821 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05084ab6-6ae8-4ade-8ae1-5cb8e00a39ee tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1691 microversion: 2.1 time: 0.221367 Feb 12 21:33:08.753573 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2880/5627] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:08 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:09.050067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4cb94bcc-e51f-400d-ba9b-bc115498279d tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:09.050971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4cb94bcc-e51f-400d-ba9b-bc115498279d tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:09.138905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4cb94bcc-e51f-400d-ba9b-bc115498279d tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:09.146606 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4cb94bcc-e51f-400d-ba9b-bc115498279d tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1215 microversion: 2.1 time: 0.105747 Feb 12 21:33:09.147172 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2748/5628] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:09 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:09.770860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:09.771490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:09.778834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:09.779307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:09.780121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:09.780578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:09.929333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:09.937189 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-99595236-726f-4170-89eb-8098991d7670 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.171339 Feb 12 21:33:09.937785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2881/5629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:09 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:10.168695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:10.168695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:10.171091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:10.171544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:10.172342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:10.172782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:10.235022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:10.243116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99f2b1f1-8574-4884-b791-42fe70bddf6c tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1267 microversion: 2.1 time: 0.083679 Feb 12 21:33:10.244031 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2749/5630] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:10 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:10.955558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:10.956291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:10.962852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:10.963322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:10.964109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:10.964561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:11.126084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:11.135000 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd9b5d3f-87fd-46f2-a29e-ea7f6d7d4117 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.183778 Feb 12 21:33:11.137841 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2882/5631] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:10 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:11.266938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:11.266938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:11.271252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:11.271700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:11.272504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:11.272994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:11.360561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:11.368921 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5163c642-0c3a-41ce-a1f7-be6864129fa8 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1273 microversion: 2.1 time: 0.112584 Feb 12 21:33:11.369579 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2750/5632] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:11 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:12.153292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:12.157492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:12.163487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:12.164638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:12.165514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:12.166139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:12.390466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:12.391679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:12.391805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:12.401798 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ff54b7a-cff8-445d-a673-cb3dfeca8c09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.251958 Feb 12 21:33:12.402852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2883/5633] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:12 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:12.411773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:12.412554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:12.416599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:12.417310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:12.720831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:12.732186 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-24eb84bb-bc88-4b88-90d5-4cb3a90dd835 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1315 microversion: 2.1 time: 0.346760 Feb 12 21:33:12.732766 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2751/5634] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:12 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:13.217204 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-641a80e3-68a4-46be-81fb-9e053c2fc33e req-8fc247b5-0e5b-42c1-956f-aba8ff13f142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6992e5a4-e773-46c4-9be6-e732978d75ca", "tag": "ad42ba36-da75-4dd3-bf17-c5f08c548d83"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:13.219804 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:13.219804 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:33:13.272548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-641a80e3-68a4-46be-81fb-9e053c2fc33e req-8fc247b5-0e5b-42c1-956f-aba8ff13f142 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:13.272548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-641a80e3-68a4-46be-81fb-9e053c2fc33e req-8fc247b5-0e5b-42c1-956f-aba8ff13f142 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:13.272548 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-641a80e3-68a4-46be-81fb-9e053c2fc33e req-8fc247b5-0e5b-42c1-956f-aba8ff13f142 service nova] Creating event network-changed:ad42ba36-da75-4dd3-bf17-c5f08c548d83 for instance 6992e5a4-e773-46c4-9be6-e732978d75ca on nch2-master-1 Feb 12 21:33:13.276885 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-641a80e3-68a4-46be-81fb-9e053c2fc33e req-8fc247b5-0e5b-42c1-956f-aba8ff13f142 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067645 Feb 12 21:33:13.277904 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2884/5635] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:13.420465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:13.421090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:13.429433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:13.430043 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:13.430868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:13.431314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:13.648653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:13.656498 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-beef71d7-fe5e-4334-863f-205289f274ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.240247 Feb 12 21:33:13.657280 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2752/5636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:13 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:13.756492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:13.757253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:13.778222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:13.778222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:13.801641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:13.804793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:14.066197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:14.073578 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b376dce-5bad-4cbd-95c1-1f1724e98160 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1315 microversion: 2.1 time: 0.322196 Feb 12 21:33:14.074156 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2885/5637] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:13 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:14.677892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:14.679360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:14.688182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:14.694771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:14.694771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:14.694771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:14.849481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:14.858348 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e5ca616-1f6f-4a1d-a806-722fbcd5bdde tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.187539 Feb 12 21:33:14.858935 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2753/5638] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:14 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:15.098150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:15.098773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:15.105013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:15.105653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:15.106818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:15.107292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:15.375786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:15.389571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-20481106-86fa-4fab-8b81-06ff4b981be4 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1315 microversion: 2.1 time: 0.296106 Feb 12 21:33:15.393836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2886/5639] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:15 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:15.876030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:15.877331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:15.884576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:15.885026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:15.885886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:15.886318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:16.046745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:16.054343 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57cf1ade-ad25-461b-b8e4-df094cc1fafc tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.182183 Feb 12 21:33:16.054927 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2754/5640] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:15 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:16.410482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:16.411113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:16.418721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:16.419191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:16.429536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:16.429536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:16.668615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:16.677026 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f073fbc-ad47-4947-9c21-b127527969ac tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1315 microversion: 2.1 time: 0.271364 Feb 12 21:33:16.677663 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2887/5641] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:16 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:17.073722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:17.075650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:17.090584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:17.093382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:17.095129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:17.096473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:17.342302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:17.355115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-efeeb36c-55e6-4eac-8c35-328bf1af6fa2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.286577 Feb 12 21:33:17.356062 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2755/5642] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:17 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:17.462123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4ce20ad8-76c3-4d1d-9c86-946e6cd8c7d9 req-ed81c51e-1997-415c-ac08-a9d195928a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6992e5a4-e773-46c4-9be6-e732978d75ca", "name": "network-vif-plugged", "status": "completed", "tag": "ad42ba36-da75-4dd3-bf17-c5f08c548d83"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:17.465199 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:17.465199 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:33:17.476138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4ce20ad8-76c3-4d1d-9c86-946e6cd8c7d9 req-ed81c51e-1997-415c-ac08-a9d195928a57 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:17.477107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4ce20ad8-76c3-4d1d-9c86-946e6cd8c7d9 req-ed81c51e-1997-415c-ac08-a9d195928a57 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:17.496211 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4ce20ad8-76c3-4d1d-9c86-946e6cd8c7d9 req-ed81c51e-1997-415c-ac08-a9d195928a57 service nova] Creating event network-vif-plugged:ad42ba36-da75-4dd3-bf17-c5f08c548d83 for instance 6992e5a4-e773-46c4-9be6-e732978d75ca on nch2-master-1 Feb 12 21:33:17.503047 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4ce20ad8-76c3-4d1d-9c86-946e6cd8c7d9 req-ed81c51e-1997-415c-ac08-a9d195928a57 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050021 Feb 12 21:33:17.503666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2888/5643] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:17.699317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:17.704258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:17.713729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:17.714336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:17.715155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:17.715600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:17.887955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:17.896856 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f1fff4ee-d3e0-40c8-b9ce-0aae3b7b41c9 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1315 microversion: 2.1 time: 0.203301 Feb 12 21:33:17.897478 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2756/5644] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:17 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:18.375541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:18.378942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:18.383868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:18.384345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:18.385156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:18.385828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:18.674745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:18.687028 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e69c7c83-4d0b-4b2d-bdc7-7be56110b648 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.315605 Feb 12 21:33:18.687984 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2889/5645] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:18 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:18.919711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:18.921171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:18.928871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:18.929594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:18.930506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:18.931027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.088706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:19.097347 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4779efce-136b-412b-b103-cb7bfb10d526 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1465 microversion: 2.1 time: 0.185024 Feb 12 21:33:19.097968 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2757/5646] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:18 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:19.145931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:19.149120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:19.156259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:19.162239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.163554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:19.164284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.200375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:33:19.578090 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dfe654ee-48b5-41be-8f80-8decd733a766 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 204 len: 0 microversion: 2.1 time: 0.444737 Feb 12 21:33:19.578836 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2890/5647] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:33:19 2022] DELETE /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:33:19.588414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:19.589046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:19.603039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:19.603529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.604384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:19.607247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.733094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:19.734112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:19.757208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:19.757722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.759812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:19.760439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:19.837590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:19.855774 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0f32ad0-c8e3-4b59-a2c2-e90e76a68a22 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1471 microversion: 2.1 time: 0.265893 Feb 12 21:33:19.857199 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2758/5648] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:19 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:19.963267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:19.968913 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-451b5900-aa6b-46ea-a189-bbabb4e137d5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.268575 Feb 12 21:33:19.969837 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2891/5649] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:19 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:20.882613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:20.883326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:20.902467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:20.910198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:20.911347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:20.911850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:20.989819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:20.990533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:20.999647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:21.000882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:21.002343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:21.003080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:21.250039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:21.279731 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-641c2f4d-6bdc-41a9-a6b8-fa81e3111ff3 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1471 microversion: 2.1 time: 0.407051 Feb 12 21:33:21.280906 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2759/5650] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:20 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:21.482382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:21.493160 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-127d3636-1b8d-4877-b4bc-715ba486e87c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.509768 Feb 12 21:33:21.494150 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2892/5651] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:20 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:22.126038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-dea71bc8-0138-409e-b3a7-07a4bacdd685 req-a872a82d-deb6-402f-bdc6-a0a4d8ae8287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6992e5a4-e773-46c4-9be6-e732978d75ca", "name": "network-vif-deleted", "tag": "ad42ba36-da75-4dd3-bf17-c5f08c548d83"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:22.137722 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:22.137722 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:22.169032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-dea71bc8-0138-409e-b3a7-07a4bacdd685 req-a872a82d-deb6-402f-bdc6-a0a4d8ae8287 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:22.169032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-dea71bc8-0138-409e-b3a7-07a4bacdd685 req-a872a82d-deb6-402f-bdc6-a0a4d8ae8287 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:22.170319 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-dea71bc8-0138-409e-b3a7-07a4bacdd685 req-a872a82d-deb6-402f-bdc6-a0a4d8ae8287 service nova] Creating event network-vif-deleted:ad42ba36-da75-4dd3-bf17-c5f08c548d83 for instance 6992e5a4-e773-46c4-9be6-e732978d75ca on nch2-master-1 Feb 12 21:33:22.176187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-dea71bc8-0138-409e-b3a7-07a4bacdd685 req-a872a82d-deb6-402f-bdc6-a0a4d8ae8287 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.385012 Feb 12 21:33:22.176798 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2760/5652] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:22.308259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:22.308876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:22.323494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:22.323494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:22.323494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:22.323494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:22.353805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:22.354358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:22.355542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lazy-loading 'fault' on Instance uuid 6992e5a4-e773-46c4-9be6-e732978d75ca {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:33:22.464910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad5f8388ce794f75bcb468047ef2393c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753fef9387244d0d98dccfd7cf8ca9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:22.473593 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bee5264c-da73-40e1-b946-e21f4b8613db tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 200 len: 1305 microversion: 2.1 time: 0.168936 Feb 12 21:33:22.474189 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2893/5653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:22 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:22.513891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:22.514825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:22.522201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:22.523005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:22.524243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:22.525196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:22.803099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:22.811734 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4b6f4a79-55af-4eee-9108-70f5fabf7c99 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.302186 Feb 12 21:33:22.811734 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2761/5654] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:22 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:23.490983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:23.491627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] [instance: 6992e5a4-e773-46c4-9be6-e732978d75ca] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:23.505304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:23.506035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:23.507148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:23.507899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:23.524315 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] HTTP exception thrown: Instance 6992e5a4-e773-46c4-9be6-e732978d75ca could not be found. Feb 12 21:33:23.525476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] Returning 404 to user: Instance 6992e5a4-e773-46c4-9be6-e732978d75ca could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:33:23.526777 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d897eff-7b2f-4899-86dc-783fc2c26c73 tempest-VolumesNegativeTest-910208263 tempest-VolumesNegativeTest-910208263-project] 10.222.0.31 "GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca" status: 404 len: 111 microversion: 2.1 time: 0.040585 Feb 12 21:33:23.527646 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2894/5655] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:23 2022] GET /compute/v2.1/servers/6992e5a4-e773-46c4-9be6-e732978d75ca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:33:23.834247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:23.834881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:23.856779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:23.859013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:23.868135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:23.869035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:24.181698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:24.191794 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-98860619-3db2-4c3f-a57c-dd1d3f4b22c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.367657 Feb 12 21:33:24.201992 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2762/5656] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:23 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:25.216140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:25.219509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:25.234900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:25.235624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:25.236702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:25.237430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:25.635121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:25.648191 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-46defc51-d86c-4b70-b8a4-009a1b825b5e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.441591 Feb 12 21:33:25.649220 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2895/5657] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:25 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:26.671921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:26.672601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:26.689779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:26.689779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:26.690638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:26.691237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:26.985156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:26.996889 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe7e7959-96f4-4a06-a0ea-1d28a492b111 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.328657 Feb 12 21:33:26.998848 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2763/5658] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:26 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:28.017916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:28.019249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:28.024066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a37092b-941c-430b-82c0-001c04cf2bbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Action: 'create', calling method: .version_select at 0x7fa8fc64a940>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1827759374"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:28.034382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:28.034839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:28.035682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:28.041164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:28.057514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8a37092b-941c-430b-82c0-001c04cf2bbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for project 11ee0199776b422d91d8368c75898fd8. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:33:28.063475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8a37092b-941c-430b-82c0-001c04cf2bbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for user f5bfde3e7e2e4f689e48688765442489 and project 11ee0199776b422d91d8368c75898fd8. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:33:28.678775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:28.686533 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5656f3b8-4ca3-49e6-bd02-1964ccc8a882 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.674840 Feb 12 21:33:28.687281 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2764/5659] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:28 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:28.761083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8a37092b-941c-430b-82c0-001c04cf2bbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for project 11ee0199776b422d91d8368c75898fd8. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:33:28.770680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8a37092b-941c-430b-82c0-001c04cf2bbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for user f5bfde3e7e2e4f689e48688765442489 and project 11ee0199776b422d91d8368c75898fd8. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:33:28.788478 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a37092b-941c-430b-82c0-001c04cf2bbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.964795 Feb 12 21:33:28.789796 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2896/5660] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:33:27 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:29.703940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:29.705076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:29.711880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:29.712341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:29.713136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:29.713766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:29.961300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:29.980385 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b6e8f691-6dfa-47cc-80a8-c52475189378 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.279966 Feb 12 21:33:29.984339 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2765/5661] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:29 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:30.999350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:31.000668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:31.011066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:31.015397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:31.016317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:31.017082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:31.234072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:31.242234 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f733031b-67b3-4755-9e9d-e2a9939cf3b3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1696 microversion: 2.1 time: 0.247051 Feb 12 21:33:31.242945 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2897/5662] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:30 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1696 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:31.642393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1305996692", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1827759374", "security_groups": [{"name": "tempest-secgroup-smoke-1232547091"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5a275d54-c4f2-43ea-a3af-6f48ceb00c04"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:31.843634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] validate_networks() for [('5a275d54-c4f2-43ea-a3af-6f48ceb00c04', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:33:32.259423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:32.260044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:32.276806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:32.278041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:32.281165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:32.282172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:32.363207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for project 11ee0199776b422d91d8368c75898fd8. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:33:32.369491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for user f5bfde3e7e2e4f689e48688765442489 and project 11ee0199776b422d91d8368c75898fd8. Resources: dict_keys(['metadata_items']) {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:33:32.384584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:33:32.385192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:33:32.390645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:33:32.391369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:33:32.391971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:33:32.404033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:32.405149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:32.406666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:32.407292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:32.465831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:32.479285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for project 11ee0199776b422d91d8368c75898fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:33:32.490842 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa332ecb-d8e4-423a-90ab-7dc902599324 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1695 microversion: 2.1 time: 0.235161 Feb 12 21:33:32.491976 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2898/5663] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:32 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1695 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:32.499440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Getting quotas for user f5bfde3e7e2e4f689e48688765442489 and project 11ee0199776b422d91d8368c75898fd8. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:33:32.514734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:33:32.526987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:33:32.720683 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c20d2c6-7856-496b-8d8a-e1bf0392bba7 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.082217 Feb 12 21:33:32.730335 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2766/5664] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:33:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:33:32.739794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b20ebfb-1949-4925-887f-f478ba259a69 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:32.740658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5b20ebfb-1949-4925-887f-f478ba259a69 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:32.882944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5b20ebfb-1949-4925-887f-f478ba259a69 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:32.892768 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b20ebfb-1949-4925-887f-f478ba259a69 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1303 microversion: 2.1 time: 0.160924 Feb 12 21:33:32.894402 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2899/5665] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:32 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:33.227533 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e99e5b3c-a6ea-4f35-9a22-b3f307e772aa req-a0a9cd71-7c6f-4922-a217-6520fe062cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "name": "network-vif-unplugged", "status": "completed", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:33.231811 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:33.231811 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:33.238440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e99e5b3c-a6ea-4f35-9a22-b3f307e772aa req-a0a9cd71-7c6f-4922-a217-6520fe062cc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:33.239213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e99e5b3c-a6ea-4f35-9a22-b3f307e772aa req-a0a9cd71-7c6f-4922-a217-6520fe062cc6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:33.251373 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e99e5b3c-a6ea-4f35-9a22-b3f307e772aa req-a0a9cd71-7c6f-4922-a217-6520fe062cc6 service nova] Creating event network-vif-unplugged:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch1-master-1 Feb 12 21:33:33.260898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-e99e5b3c-a6ea-4f35-9a22-b3f307e772aa req-a0a9cd71-7c6f-4922-a217-6520fe062cc6 service nova] Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:33:33.282743 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e99e5b3c-a6ea-4f35-9a22-b3f307e772aa req-a0a9cd71-7c6f-4922-a217-6520fe062cc6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059034 Feb 12 21:33:33.289324 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2767/5666] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:33.509012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:33.510465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:33.534704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:33.535376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:33.536733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:33.541597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:33.789399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:33.798438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-21dd1dfe-404e-495a-a32e-6209980c990e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1695 microversion: 2.1 time: 0.294076 Feb 12 21:33:33.799026 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2900/5667] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:33 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1695 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:33.913259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-58ed19f7-8562-48dc-8bb4-8919ae097d2b tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:33.914630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-58ed19f7-8562-48dc-8bb4-8919ae097d2b tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:33.982584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-58ed19f7-8562-48dc-8bb4-8919ae097d2b tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:33.994442 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-58ed19f7-8562-48dc-8bb4-8919ae097d2b tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1303 microversion: 2.1 time: 0.086632 Feb 12 21:33:33.995353 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2768/5668] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:33 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:34.822620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:34.823546 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:34.837100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:34.837805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:34.839232 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:34.839710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:35.011707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:35.012584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:35.013003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:35.020865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:35.021072 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-99c02b95-0030-46f1-a5dc-30e899f6a766 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1695 microversion: 2.1 time: 0.202313 Feb 12 21:33:35.021616 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2901/5669] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:34 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:35.022144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:35.023049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:35.023569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:35.095047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:35.104152 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eead77ea-c092-41ca-be18-95f2b1ccf236 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1299 microversion: 2.1 time: 0.096367 Feb 12 21:33:35.104936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2769/5670] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:35 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:35.297376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-19a81887-6d2f-43d6-939d-4a32f7fcc966 req-ffef7b03-02d0-4eff-b8f2-ba7812a8ae68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:35.298940 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:35.298940 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:33:35.306623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-19a81887-6d2f-43d6-939d-4a32f7fcc966 req-ffef7b03-02d0-4eff-b8f2-ba7812a8ae68 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:35.307078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-19a81887-6d2f-43d6-939d-4a32f7fcc966 req-ffef7b03-02d0-4eff-b8f2-ba7812a8ae68 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:35.318564 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-19a81887-6d2f-43d6-939d-4a32f7fcc966 req-ffef7b03-02d0-4eff-b8f2-ba7812a8ae68 service nova] Creating event network-changed:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch1-master-1 Feb 12 21:33:35.324162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-19a81887-6d2f-43d6-939d-4a32f7fcc966 req-ffef7b03-02d0-4eff-b8f2-ba7812a8ae68 service nova] Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:33:35.335599 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-19a81887-6d2f-43d6-939d-4a32f7fcc966 req-ffef7b03-02d0-4eff-b8f2-ba7812a8ae68 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041884 Feb 12 21:33:35.341564 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2902/5671] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:36.045469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:36.045469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:36.052831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:36.053300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:36.054285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:36.055620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:36.123061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:36.124449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:36.131889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:36.132644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:36.133684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:36.134354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:36.200503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:36.235374 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-662645bc-0829-47f8-bf26-6bca7227868c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1361 microversion: 2.1 time: 0.117036 Feb 12 21:33:36.236265 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2903/5672] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:36 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1361 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:36.835762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:36.846086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fdaec1fb-3903-4433-b9f5-f58641d4ca2c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1693 microversion: 2.1 time: 0.807679 Feb 12 21:33:36.847087 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2770/5673] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:36 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1693 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:37.253339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:37.255018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:37.262322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:37.262787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:37.263655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:37.264305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:37.337137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:37.352970 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a14267f-2745-4aef-886c-ff09e6f4b592 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1361 microversion: 2.1 time: 0.103207 Feb 12 21:33:37.364072 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2904/5674] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:37 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1361 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:37.864867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:37.866106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:37.874336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:37.874802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:37.875616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:37.876064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.143702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:38.152670 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bd19b4dc-eefd-4f82-93a8-c335d9c61740 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1690 microversion: 2.1 time: 0.292542 Feb 12 21:33:38.153517 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2771/5675] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:37 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1690 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:38.171621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:38.172165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:38.179158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.179630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.180444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.180895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.371142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:38.372028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:38.391301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.392108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.393130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.393688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.555136 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-33e4df9a-faf1-4649-a970-c600ec2f527c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action" status: 202 len: 0 microversion: 2.1 time: 0.386648 Feb 12 21:33:38.556740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2905/5676] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:33:38 2022] POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:33:38.567754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:38.570620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:38.578459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.578936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.579769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.580224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.657942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:38.667401 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e10e42a3-2b15-450c-8962-7a4f0b0c6370 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1429 microversion: 2.1 time: 0.299518 Feb 12 21:33:38.668463 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2772/5677] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:38 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1429 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:38.792708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:38.802685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-23da8bdf-643b-4149-8ac4-09e141f13cae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.241394 Feb 12 21:33:38.803275 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2906/5678] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:38 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:38.867153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1db0ea22-f45f-4f43-aaef-e7a251e997ae req-670e9f81-1e8f-4fe8-9f9f-e1d58279d320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb651ad-6909-4814-b97a-a1331757b728", "tag": "f8d754d1-34dc-4a41-ac74-e83b17271343"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:38.870377 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:38.870377 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:38.880453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1db0ea22-f45f-4f43-aaef-e7a251e997ae req-670e9f81-1e8f-4fe8-9f9f-e1d58279d320 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:38.880914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1db0ea22-f45f-4f43-aaef-e7a251e997ae req-670e9f81-1e8f-4fe8-9f9f-e1d58279d320 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:38.897523 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1db0ea22-f45f-4f43-aaef-e7a251e997ae req-670e9f81-1e8f-4fe8-9f9f-e1d58279d320 service nova] Creating event network-changed:f8d754d1-34dc-4a41-ac74-e83b17271343 for instance 9eb651ad-6909-4814-b97a-a1331757b728 on nch2-master-1 Feb 12 21:33:38.904420 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1db0ea22-f45f-4f43-aaef-e7a251e997ae req-670e9f81-1e8f-4fe8-9f9f-e1d58279d320 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043371 Feb 12 21:33:38.906133 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2773/5679] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:39.683909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:39.684559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:39.694150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:39.695039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:39.696630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:39.697141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:39.748891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e8e94e59-16e6-43aa-9100-254042f6c22d req-09333ebe-10db-4cbe-b359-e22cbaa6b384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "name": "network-vif-plugged", "status": "completed", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:39.752838 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:39.752838 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:39.759182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e8e94e59-16e6-43aa-9100-254042f6c22d req-09333ebe-10db-4cbe-b359-e22cbaa6b384 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:39.759878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e8e94e59-16e6-43aa-9100-254042f6c22d req-09333ebe-10db-4cbe-b359-e22cbaa6b384 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:39.772581 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e8e94e59-16e6-43aa-9100-254042f6c22d req-09333ebe-10db-4cbe-b359-e22cbaa6b384 service nova] Creating event network-vif-plugged:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch1-master-1 Feb 12 21:33:39.779321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-e8e94e59-16e6-43aa-9100-254042f6c22d req-09333ebe-10db-4cbe-b359-e22cbaa6b384 service nova] Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:33:39.804160 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e8e94e59-16e6-43aa-9100-254042f6c22d req-09333ebe-10db-4cbe-b359-e22cbaa6b384 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062103 Feb 12 21:33:39.810879 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2774/5680] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:39.829236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:39.830098 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:39.837434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:39.838297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:39.839324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:39.839961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:39.884427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:39.894073 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4805f181-8035-4582-bf7f-afcac83344f4 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1429 microversion: 2.1 time: 0.212813 Feb 12 21:33:39.894666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2907/5681] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:39 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:40.127372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:40.136173 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34c33b4d-669e-4a6b-9b13-e8464f7d4625 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.312272 Feb 12 21:33:40.136818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2775/5682] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:39 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:40.911079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:40.911702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:40.918832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:40.919293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:40.920079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:40.920523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:41.071674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:41.079505 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-596c1c12-4c55-45ce-94d5-a247a3b97a47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1429 microversion: 2.1 time: 0.172288 Feb 12 21:33:41.080080 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2908/5683] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:40 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1429 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:41.158152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:41.159492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:41.176802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:41.176802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:41.176802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:41.176802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:41.334429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:41.342870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cba0c925-ebe8-474c-b20e-d378ca5fc617 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.190050 Feb 12 21:33:41.343453 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2776/5684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:41 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:42.097937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:42.098499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:42.105812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:42.106308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:42.107113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:42.107560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:42.272121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:42.283996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2cc42831-670e-4985-9c46-d4192cabf40f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1429 microversion: 2.1 time: 0.191411 Feb 12 21:33:42.284848 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2909/5685] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:42 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1429 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:42.360536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:42.361075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:42.368589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:42.369493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:42.370015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:42.370454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:42.562641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:42.571769 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68b1e052-ffc0-4c2f-96bb-422dc32e7b4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.214992 Feb 12 21:33:42.572733 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2777/5686] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:42 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:43.100494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1629f2b9-68af-4a06-8dcd-0cebc64ff5f7 req-10c30d2e-bfca-4017-80ef-c975d25597c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "name": "network-vif-unplugged", "status": "completed", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:43.102761 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:43.102761 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:33:43.111060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1629f2b9-68af-4a06-8dcd-0cebc64ff5f7 req-10c30d2e-bfca-4017-80ef-c975d25597c6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:43.111751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1629f2b9-68af-4a06-8dcd-0cebc64ff5f7 req-10c30d2e-bfca-4017-80ef-c975d25597c6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:43.125935 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1629f2b9-68af-4a06-8dcd-0cebc64ff5f7 req-10c30d2e-bfca-4017-80ef-c975d25597c6 service nova] Creating event network-vif-unplugged:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:33:43.133207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-1629f2b9-68af-4a06-8dcd-0cebc64ff5f7 req-10c30d2e-bfca-4017-80ef-c975d25597c6 service nova] Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:33:43.142703 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1629f2b9-68af-4a06-8dcd-0cebc64ff5f7 req-10c30d2e-bfca-4017-80ef-c975d25597c6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047177 Feb 12 21:33:43.143311 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2910/5687] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:43.302274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:43.307594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:43.313268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:43.315649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:43.316494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:43.318931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:43.592093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:43.594344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:43.597952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:43.605765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7e8aac9d-c7f3-4a1e-a228-df80aa24c3b0 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1429 microversion: 2.1 time: 0.305838 Feb 12 21:33:43.606084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:43.606847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:43.606985 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2778/5688] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:43 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1429 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:43.608740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:43.609558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:43.629045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d644fbe1-7e4c-4f68-9047-a4aa920a8e01 req-744e3a69-4a12-4a09-ac9f-1f4bbd2847d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb651ad-6909-4814-b97a-a1331757b728", "name": "network-vif-plugged", "status": "completed", "tag": "f8d754d1-34dc-4a41-ac74-e83b17271343"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:43.633642 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:43.633642 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:43.641013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d644fbe1-7e4c-4f68-9047-a4aa920a8e01 req-744e3a69-4a12-4a09-ac9f-1f4bbd2847d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:43.641822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d644fbe1-7e4c-4f68-9047-a4aa920a8e01 req-744e3a69-4a12-4a09-ac9f-1f4bbd2847d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:43.654834 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d644fbe1-7e4c-4f68-9047-a4aa920a8e01 req-744e3a69-4a12-4a09-ac9f-1f4bbd2847d1 service nova] Creating event network-vif-plugged:f8d754d1-34dc-4a41-ac74-e83b17271343 for instance 9eb651ad-6909-4814-b97a-a1331757b728 on nch2-master-1 Feb 12 21:33:43.660459 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d644fbe1-7e4c-4f68-9047-a4aa920a8e01 req-744e3a69-4a12-4a09-ac9f-1f4bbd2847d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037752 Feb 12 21:33:43.661099 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2779/5689] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:43.774561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:43.782539 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-163c00a1-5b29-4bec-8e44-ce958e994437 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.196708 Feb 12 21:33:43.783201 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2911/5690] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:43 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:44.624897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:44.625647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:44.631993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:44.632438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:44.633226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:44.633694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:44.800706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:44.801465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:44.808475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:44.812277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:44.812277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:44.812277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:44.870261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:44.881943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28dd939a-9643-463d-9677-93c2c7736f8f tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1429 microversion: 2.1 time: 0.261748 Feb 12 21:33:44.882553 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2780/5691] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:44 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1429 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:44.972558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:44.980793 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-06af88cb-fb52-4743-8a71-c2254f21de13 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.184068 Feb 12 21:33:44.981383 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2912/5692] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:44 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:45.156887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-85cfcce3-fe71-4590-bf13-5228db6a05dc req-d8b41dec-e74e-4b45-a26d-1263067d01ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:45.158422 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:45.158422 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:45.165997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-85cfcce3-fe71-4590-bf13-5228db6a05dc req-d8b41dec-e74e-4b45-a26d-1263067d01ed service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:45.169039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-85cfcce3-fe71-4590-bf13-5228db6a05dc req-d8b41dec-e74e-4b45-a26d-1263067d01ed service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:45.180334 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-85cfcce3-fe71-4590-bf13-5228db6a05dc req-d8b41dec-e74e-4b45-a26d-1263067d01ed service nova] Creating event network-changed:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:33:45.186049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-85cfcce3-fe71-4590-bf13-5228db6a05dc req-d8b41dec-e74e-4b45-a26d-1263067d01ed service nova] Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:33:45.197622 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-85cfcce3-fe71-4590-bf13-5228db6a05dc req-d8b41dec-e74e-4b45-a26d-1263067d01ed service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044335 Feb 12 21:33:45.198224 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2781/5693] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:45.899166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:45.899790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:45.906826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:45.907295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:45.908103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:45.908550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.001067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:46.001901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:46.008820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:46.012147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.012147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:46.012147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.059332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:46.070573 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc356106-e031-438c-ad4b-c118e7271c47 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1608 microversion: 2.1 time: 0.173303 Feb 12 21:33:46.073349 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2913/5694] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:45 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1608 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:46.089887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:46.090532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:46.096940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:46.097492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.098292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:46.098737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.199578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:46.212598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb676ab3-d3ec-4a4a-9aae-5a61ff58d19f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1689 microversion: 2.1 time: 0.217515 Feb 12 21:33:46.222131 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2782/5695] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:45 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:46.265178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:46.273335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb90ecf8-6153-4ccd-a168-eee65175479d tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1608 microversion: 2.1 time: 0.187121 Feb 12 21:33:46.274115 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2914/5696] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:46 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1608 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:46.291716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:46.292334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:46.298458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:46.298916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.299700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:46.300140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:46.443810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:46.452108 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-33c76f5f-d7c4-4a3a-98fc-f9fccd6526e5 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1608 microversion: 2.1 time: 0.163960 Feb 12 21:33:46.452708 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2783/5697] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:46 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1608 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:47.239790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:47.241274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:47.248606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:47.249073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:47.250110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:47.250568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:47.543648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:47.559149 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b4480fae-3abc-4048-af21-1ffc0cee4286 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1682 microversion: 2.1 time: 0.323959 Feb 12 21:33:47.560376 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2915/5698] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:47 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1682 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:48.291862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:48.293757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:48.308523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:48.308979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:48.310117 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:48.310790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:48.377725 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9514d689-784b-4ae1-a566-c11682037132 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "POST /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0/action" status: 200 len: 24562 microversion: 2.1 time: 0.294185 Feb 12 21:33:48.380408 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2784/5699] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:33:48 2022] POST /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0/action => generated 24562 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:33:49.072150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ec81ad84-5cdf-4723-8c36-eb51910de45c req-473e139c-f096-4909-b9a1-1c49583ad259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb651ad-6909-4814-b97a-a1331757b728", "tag": "f8d754d1-34dc-4a41-ac74-e83b17271343"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:49.074892 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:49.074892 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:33:49.087658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ec81ad84-5cdf-4723-8c36-eb51910de45c req-473e139c-f096-4909-b9a1-1c49583ad259 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:49.088396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ec81ad84-5cdf-4723-8c36-eb51910de45c req-473e139c-f096-4909-b9a1-1c49583ad259 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:49.103462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ec81ad84-5cdf-4723-8c36-eb51910de45c req-473e139c-f096-4909-b9a1-1c49583ad259 service nova] Creating event network-changed:f8d754d1-34dc-4a41-ac74-e83b17271343 for instance 9eb651ad-6909-4814-b97a-a1331757b728 on nch2-master-1 Feb 12 21:33:49.110545 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ec81ad84-5cdf-4723-8c36-eb51910de45c req-473e139c-f096-4909-b9a1-1c49583ad259 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056361 Feb 12 21:33:49.111498 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2916/5700] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:49.588645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ee1e358c-67ee-4546-a926-19d526e24daf req-fc3cc6ea-ae14-4f4b-808a-c504a16ccbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "name": "network-vif-plugged", "status": "completed", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:49.590700 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:49.590700 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:49.602319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ee1e358c-67ee-4546-a926-19d526e24daf req-fc3cc6ea-ae14-4f4b-808a-c504a16ccbe8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:49.603028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ee1e358c-67ee-4546-a926-19d526e24daf req-fc3cc6ea-ae14-4f4b-808a-c504a16ccbe8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:49.615032 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ee1e358c-67ee-4546-a926-19d526e24daf req-fc3cc6ea-ae14-4f4b-808a-c504a16ccbe8 service nova] Creating event network-vif-plugged:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:33:49.623008 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ee1e358c-67ee-4546-a926-19d526e24daf req-fc3cc6ea-ae14-4f4b-808a-c504a16ccbe8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042645 Feb 12 21:33:49.623707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2785/5701] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:49.778924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-69a5d9ce-80c8-4e5e-9fb9-1576c83ac1e2 req-5f510ef3-5c56-4caf-a59b-91bfa8e9b05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b70a65-6aa4-49d4-8415-1eda9c7671c0", "tag": "eb4be2e6-f5ae-4480-94a3-2f75ffe8516f"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:49.780419 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:49.780419 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:33:49.785578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:49.787429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:49.796383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:49.796855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:49.800094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-69a5d9ce-80c8-4e5e-9fb9-1576c83ac1e2 req-5f510ef3-5c56-4caf-a59b-91bfa8e9b05a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:49.800606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:49.801316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:49.806522 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-69a5d9ce-80c8-4e5e-9fb9-1576c83ac1e2 req-5f510ef3-5c56-4caf-a59b-91bfa8e9b05a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:49.829902 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-69a5d9ce-80c8-4e5e-9fb9-1576c83ac1e2 req-5f510ef3-5c56-4caf-a59b-91bfa8e9b05a service nova] Creating event network-changed:eb4be2e6-f5ae-4480-94a3-2f75ffe8516f for instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 on nch1-master-1 Feb 12 21:33:49.841632 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-69a5d9ce-80c8-4e5e-9fb9-1576c83ac1e2 req-5f510ef3-5c56-4caf-a59b-91bfa8e9b05a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066786 Feb 12 21:33:49.842810 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2786/5702] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:49.859370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:33:50.322636 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5974be4-ee1b-47a4-bb36-478fecdf6ed1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 204 len: 0 microversion: 2.1 time: 0.552543 Feb 12 21:33:50.325657 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2917/5703] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:33:49 2022] DELETE /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:33:50.335057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:50.335748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:50.359726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:50.361640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:50.363952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:50.366977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:50.747394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:50.766398 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6cb79e6a-93c0-42a4-823b-e104a43ea741 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1576 microversion: 2.1 time: 0.435115 Feb 12 21:33:50.768691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2787/5704] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:50 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1576 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:51.785996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:51.786704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:51.793268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:51.793767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:51.794559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:51.795008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:51.942521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:51.950725 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f22bfd0-2427-4162-8e14-1f475ec30449 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1457 microversion: 2.1 time: 0.168852 Feb 12 21:33:51.951300 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2918/5705] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:51 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1457 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:33:52.979213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:52.979842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:52.991046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e5f0de0f-e95b-49cd-9954-37d4a65c070a req-9b111ad7-a383-4f44-b413-e3bfe32d38a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b70a65-6aa4-49d4-8415-1eda9c7671c0", "name": "network-vif-deleted", "tag": "eb4be2e6-f5ae-4480-94a3-2f75ffe8516f"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:33:52.993596 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:33:52.993596 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:33:52.998893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:52.999356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:53.000172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:53.000647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:53.001480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e5f0de0f-e95b-49cd-9954-37d4a65c070a req-9b111ad7-a383-4f44-b413-e3bfe32d38a7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:53.001966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e5f0de0f-e95b-49cd-9954-37d4a65c070a req-9b111ad7-a383-4f44-b413-e3bfe32d38a7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:53.015084 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e5f0de0f-e95b-49cd-9954-37d4a65c070a req-9b111ad7-a383-4f44-b413-e3bfe32d38a7 service nova] Creating event network-vif-deleted:eb4be2e6-f5ae-4480-94a3-2f75ffe8516f for instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 on nch1-master-1 Feb 12 21:33:53.020230 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e5f0de0f-e95b-49cd-9954-37d4a65c070a req-9b111ad7-a383-4f44-b413-e3bfe32d38a7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Feb 12 21:33:53.020880 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2919/5706] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:33:53.078728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:53.094176 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85560625-c81d-4369-863b-b0658444f6ad tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1390 microversion: 2.1 time: 0.111741 Feb 12 21:33:53.095424 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2788/5707] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:52 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1390 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:54.113987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:54.114876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:54.121340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:54.122033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:54.123183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:54.123822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:54.159676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:54.160153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:54.160624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lazy-loading 'fault' on Instance uuid a6b70a65-6aa4-49d4-8415-1eda9c7671c0 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:33:54.210888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc56a9a0488e44d7935295ed39bfbb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c11b938ee814f3180aa6e0f37c4e1f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:33:54.219612 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a60a2a27-2ad1-4095-b3ba-cf29ff5d27e1 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 200 len: 1228 microversion: 2.1 time: 0.110887 Feb 12 21:33:54.229113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2920/5708] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:54 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 1228 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:33:55.237711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:33:55.244438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] [instance: a6b70a65-6aa4-49d4-8415-1eda9c7671c0] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:33:55.254181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:55.256528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:55.256528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:33:55.257393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:33:55.279204 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] HTTP exception thrown: Instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 could not be found. Feb 12 21:33:55.279855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Returning 404 to user: Instance a6b70a65-6aa4-49d4-8415-1eda9c7671c0 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:33:55.284719 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d78fb7c4-578d-4a13-855a-69ea75cd8825 tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0" status: 404 len: 111 microversion: 2.1 time: 0.047678 Feb 12 21:33:55.284719 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2789/5709] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:33:55 2022] GET /compute/v2.1/servers/a6b70a65-6aa4-49d4-8415-1eda9c7671c0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:34:06.297007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19723891-f56f-4c4d-9468-e953386d381e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:06.298524 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:06.298524 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:06.299987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19723891-f56f-4c4d-9468-e953386d381e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:06.300483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19723891-f56f-4c4d-9468-e953386d381e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:06.301312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19723891-f56f-4c4d-9468-e953386d381e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:06.301789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19723891-f56f-4c4d-9468-e953386d381e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:06.330804 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19723891-f56f-4c4d-9468-e953386d381e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.204327 Feb 12 21:34:06.331405 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2921/5710] 10.222.0.31 () {58 vars in 1184 bytes} [Sat Feb 12 21:34:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:06.438216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1457719521", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "bab0920a-852a-49c9-a3f2-4c8b53842adb"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:06.505682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] validate_networks() for [('bab0920a-852a-49c9-a3f2-4c8b53842adb', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:34:06.920999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:34:06.921728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:34:06.922381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:34:06.922795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:34:06.923209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:34:06.932358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:06.932839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:06.933698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:06.934133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:06.951136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Getting quotas for project dcf968a096f1465189bcff1b8cdd3f35. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:06.957060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Getting quotas for user c66652b2a22c4bbbbebd4705d4b8ea1b and project dcf968a096f1465189bcff1b8cdd3f35. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:06.969867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:34:06.972334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:34:07.066452 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e368d3cf-1c70-4799-8ca2-fed623dd962e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631889 Feb 12 21:34:07.067348 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2790/5711] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:34:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:34:07.084073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5babef52-0c53-4b96-9712-0333d091a4e2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:07.085096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5babef52-0c53-4b96-9712-0333d091a4e2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:07.151122 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5babef52-0c53-4b96-9712-0333d091a4e2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1329 microversion: 2.1 time: 0.076984 Feb 12 21:34:07.151786 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2922/5712] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:07 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1329 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:08.168322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9eb34c34-5c1c-4002-8b35-bb6cc6e55c30 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:08.170057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9eb34c34-5c1c-4002-8b35-bb6cc6e55c30 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:08.250595 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9eb34c34-5c1c-4002-8b35-bb6cc6e55c30 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1329 microversion: 2.1 time: 0.086180 Feb 12 21:34:08.251509 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2791/5713] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:08 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1329 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:09.269220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:09.269893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:09.283629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:09.284103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:09.285055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:09.285650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:09.367602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70629c64-1442-4f8c-a3bf-f2ffe8d071e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1416 microversion: 2.1 time: 0.102988 Feb 12 21:34:09.368235 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2923/5714] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:09 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1416 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:10.386760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:10.387381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:10.401898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:10.401898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:10.401898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:10.401898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:10.594457 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-37fe69d2-d9ab-45df-9dea-fa73f44ec2cb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1464 microversion: 2.1 time: 0.211990 Feb 12 21:34:10.595047 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2792/5715] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:10 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:11.374056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-02d418a2-a620-471c-8830-28295901c2f4 req-9d00f3ca-a0ae-4541-b691-601ad8588461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71329122-faa4-485f-86b6-d5c458f79b0b", "tag": "7b28568e-09b2-43a3-8d6c-7b5a5efddc9c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:11.377098 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:11.377098 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:11.385841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-02d418a2-a620-471c-8830-28295901c2f4 req-9d00f3ca-a0ae-4541-b691-601ad8588461 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:11.386372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-02d418a2-a620-471c-8830-28295901c2f4 req-9d00f3ca-a0ae-4541-b691-601ad8588461 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:11.401834 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-02d418a2-a620-471c-8830-28295901c2f4 req-9d00f3ca-a0ae-4541-b691-601ad8588461 service nova] Creating event network-changed:7b28568e-09b2-43a3-8d6c-7b5a5efddc9c for instance 71329122-faa4-485f-86b6-d5c458f79b0b on nch2-master-1 Feb 12 21:34:11.425328 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-02d418a2-a620-471c-8830-28295901c2f4 req-9d00f3ca-a0ae-4541-b691-601ad8588461 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047050 Feb 12 21:34:11.425328 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2924/5716] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:11.615833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:11.618132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:11.625951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:11.626408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:11.627211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:11.627654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:11.813181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:11.814233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:11.832237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:11.832237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:11.837981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:11.837981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:11.847191 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99727124-63fc-4659-89e6-356a70b5b1b7 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1464 microversion: 2.1 time: 0.238268 Feb 12 21:34:11.848415 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2793/5717] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:11 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:11.897756 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-85db5b00-1a67-4542-9a12-1adc6d575389 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action" status: 200 len: 63162 microversion: 2.1 time: 0.088407 Feb 12 21:34:11.899058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2925/5718] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:34:11 2022] POST /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a/action => generated 63162 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 12 21:34:12.870495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:12.871921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:12.878508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:12.882988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:12.882988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:12.882988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:13.024528 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97556a00-6719-4536-8c8b-df467911f729 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1464 microversion: 2.1 time: 0.158263 Feb 12 21:34:13.025328 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2794/5719] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:12 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:14.043679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:14.044409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:14.052472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:14.052662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:14.053764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:14.054211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:14.201879 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2fe9e472-d32b-444e-a2d0-eb3d64be4f23 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1464 microversion: 2.1 time: 0.163195 Feb 12 21:34:14.202448 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2926/5720] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:14 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:15.219390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:15.220006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:15.227595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:15.228169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:15.228961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:15.229430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:15.362411 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee934301-eb1b-4c81-8b06-973e03728a36 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1464 microversion: 2.1 time: 0.146627 Feb 12 21:34:15.362985 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2795/5721] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:15 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:15.750544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9e049a51-b266-42f1-bde2-105b234b985e req-a847ef69-2ac7-4d82-97b1-037f5e19e07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71329122-faa4-485f-86b6-d5c458f79b0b", "name": "network-vif-plugged", "status": "completed", "tag": "7b28568e-09b2-43a3-8d6c-7b5a5efddc9c"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:15.752606 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:15.752606 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:15.761804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9e049a51-b266-42f1-bde2-105b234b985e req-a847ef69-2ac7-4d82-97b1-037f5e19e07b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:15.762263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9e049a51-b266-42f1-bde2-105b234b985e req-a847ef69-2ac7-4d82-97b1-037f5e19e07b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:15.772329 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9e049a51-b266-42f1-bde2-105b234b985e req-a847ef69-2ac7-4d82-97b1-037f5e19e07b service nova] Creating event network-vif-plugged:7b28568e-09b2-43a3-8d6c-7b5a5efddc9c for instance 71329122-faa4-485f-86b6-d5c458f79b0b on nch2-master-1 Feb 12 21:34:15.778470 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9e049a51-b266-42f1-bde2-105b234b985e req-a847ef69-2ac7-4d82-97b1-037f5e19e07b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031809 Feb 12 21:34:15.779059 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2927/5722] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:16.380789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:16.381393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:16.388324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:16.388775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:16.389582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:16.390017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:16.527993 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8ccc94d2-a999-4fdc-9e9a-0c659c16ae94 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1464 microversion: 2.1 time: 0.150637 Feb 12 21:34:16.528592 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2796/5723] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:16 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:17.547125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:17.547782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:17.554172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:17.554635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:17.555448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:17.555929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:17.691289 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-09b0500b-59c3-40c0-a0d9-81adcc762990 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1648 microversion: 2.1 time: 0.149110 Feb 12 21:34:17.692269 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2928/5724] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:17 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1648 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:17.708136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:17.708822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:17.716303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:17.716832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:17.717694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:17.718203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:17.868008 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5a6df87c-57dc-46bb-8eb5-cb60a7289c61 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1648 microversion: 2.1 time: 0.163319 Feb 12 21:34:17.868613 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2797/5725] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:17 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1648 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:17.883907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:17.885066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:17.890960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:17.891424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:17.892228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:17.892716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:18.024845 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6469f7a9-9e1d-4ff2-84a5-afe976415907 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1648 microversion: 2.1 time: 0.144492 Feb 12 21:34:18.025537 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2929/5726] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:17 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1648 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:18.080208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1451757989", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "bab0920a-852a-49c9-a3f2-4c8b53842adb"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:18.134340 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] validate_networks() for [('bab0920a-852a-49c9-a3f2-4c8b53842adb', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:34:18.288277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:18.288948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:18.295502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:18.295974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:18.296829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:18.297326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:18.451396 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96dde767-2ec3-4d73-8950-2ea741cbe63e tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1833 microversion: 2.1 time: 0.167191 Feb 12 21:34:18.452140 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2930/5727] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:18 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1833 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:18.516366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:34:18.516815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:34:18.517624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:34:18.518036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:34:18.518450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:34:18.530598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:18.531319 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:18.532346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:18.533027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:18.552273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Getting quotas for project dcf968a096f1465189bcff1b8cdd3f35. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:18.558550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Getting quotas for user c66652b2a22c4bbbbebd4705d4b8ea1b and project dcf968a096f1465189bcff1b8cdd3f35. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:18.570818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:34:18.573698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:34:18.767757 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-557ec9ab-a43f-43b2-9dab-6d9634be2536 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691318 Feb 12 21:34:18.773525 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2798/5728] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:34:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:34:18.779637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-536509b1-d978-4237-a7c0-3e9696f39f3c tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:18.782751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-536509b1-d978-4237-a7c0-3e9696f39f3c tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:18.866738 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-536509b1-d978-4237-a7c0-3e9696f39f3c tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1329 microversion: 2.1 time: 0.091877 Feb 12 21:34:18.867900 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2931/5729] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:18 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:19.792053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b6ba85f8-f12a-4637-a0e8-1f95a146d7f4 req-69cbe9ac-9654-4f48-acd9-881312367bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:19.793543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:19.803352 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:19.803352 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:19.803551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:19.803551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:19.803551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:19.803551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:19.803551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:19.803921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b6ba85f8-f12a-4637-a0e8-1f95a146d7f4 req-69cbe9ac-9654-4f48-acd9-881312367bde service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:19.803921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b6ba85f8-f12a-4637-a0e8-1f95a146d7f4 req-69cbe9ac-9654-4f48-acd9-881312367bde service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:19.815572 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b6ba85f8-f12a-4637-a0e8-1f95a146d7f4 req-69cbe9ac-9654-4f48-acd9-881312367bde service nova] Creating event network-changed:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:34:19.820744 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b6ba85f8-f12a-4637-a0e8-1f95a146d7f4 req-69cbe9ac-9654-4f48-acd9-881312367bde service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037242 Feb 12 21:34:19.821675 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2932/5730] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:19.830349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:34:19.897109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:19.897877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:19.911988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:19.912697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:19.913872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:19.915049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:19.999991 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb477f23-6d8a-42a5-b76b-6ce4f4b823f8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1346 microversion: 2.1 time: 0.112175 Feb 12 21:34:20.001469 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2933/5731] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:19 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:20.281259 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e4f06871-904b-4c7b-b07c-14f610f0756c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 204 len: 0 microversion: 2.1 time: 0.498559 Feb 12 21:34:20.282466 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2799/5732] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:34:19 2022] DELETE /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:34:20.298710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:20.298710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:20.301796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:20.302280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:20.303457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:20.308952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:20.474123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:20.486000 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e4118c1-c84d-4d0b-b852-533d5f34a5bd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1688 microversion: 2.1 time: 0.198731 Feb 12 21:34:20.486708 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2934/5733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:20 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:21.018913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:21.019696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:21.027454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:21.028170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:21.028974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:21.029451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:21.110845 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-16717224-efde-4809-a8df-8938bf18c0b5 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1424 microversion: 2.1 time: 0.096148 Feb 12 21:34:21.111459 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2800/5734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:21 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:21.505922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:21.506633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:21.515227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:21.516035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:21.516485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:21.516930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:21.681128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:21.690367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d5e44d1-c717-4f0f-9049-f77869a22f8c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1569 microversion: 2.1 time: 0.190217 Feb 12 21:34:21.691164 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2935/5735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:21 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:22.128055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:22.137439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:22.137439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:22.137439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:22.137439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:22.138074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:22.464732 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-127a4fa7-42da-49cf-851b-ec8fe3af80be tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1464 microversion: 2.1 time: 0.340248 Feb 12 21:34:22.465322 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2801/5736] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:22 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:22.664554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2f036917-0088-4985-a47d-b1c3796585c5 req-485ab7b5-d419-4a9b-a2c4-b5bf33834caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03238736-f48f-4c6f-bca2-0c8fd48f1b1a", "name": "network-vif-deleted", "tag": "89068433-479e-4d1b-a647-4c64ef98daba"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:22.666482 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:22.666482 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:22.674470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2f036917-0088-4985-a47d-b1c3796585c5 req-485ab7b5-d419-4a9b-a2c4-b5bf33834caa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:22.675104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2f036917-0088-4985-a47d-b1c3796585c5 req-485ab7b5-d419-4a9b-a2c4-b5bf33834caa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:22.686606 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2f036917-0088-4985-a47d-b1c3796585c5 req-485ab7b5-d419-4a9b-a2c4-b5bf33834caa service nova] Creating event network-vif-deleted:89068433-479e-4d1b-a647-4c64ef98daba for instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a on nch2-master-1 Feb 12 21:34:22.691694 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2f036917-0088-4985-a47d-b1c3796585c5 req-485ab7b5-d419-4a9b-a2c4-b5bf33834caa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Feb 12 21:34:22.692636 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2936/5737] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:22.710343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:22.711214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:22.717884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:22.718335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:22.719267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:22.719733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:22.800937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:22.808750 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6891d698-e862-4d2d-9104-5d96cd80fdb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 200 len: 1502 microversion: 2.1 time: 0.102627 Feb 12 21:34:22.809720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2802/5738] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:22 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 1502 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:23.482984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:23.483736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:23.490642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:23.491133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:23.491954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:23.492409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:23.665149 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-193e9e15-edda-42e9-8e38-b7b5140841d6 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1464 microversion: 2.1 time: 0.186206 Feb 12 21:34:23.666284 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2937/5739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:23 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:23.826580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:23.827362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: 03238736-f48f-4c6f-bca2-0c8fd48f1b1a] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:23.834660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:23.835346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:23.836304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:23.836741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:23.851708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] HTTP exception thrown: Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a could not be found. Feb 12 21:34:23.852313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Returning 404 to user: Instance 03238736-f48f-4c6f-bca2-0c8fd48f1b1a could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:34:23.854661 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7737d611-4b6e-4e0d-b8b7-dfb21475db44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a" status: 404 len: 111 microversion: 2.1 time: 0.030746 Feb 12 21:34:23.855931 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2803/5740] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:23 2022] GET /compute/v2.1/servers/03238736-f48f-4c6f-bca2-0c8fd48f1b1a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:34:24.686901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:24.687526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:24.693697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:24.694154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:24.694955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:24.695406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:24.707658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f36b7a10-60d5-482e-946b-efcd717b71d4 req-2e8e1a31-c3a5-4dff-95dd-1f20c3d576bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c", "tag": "687cdb81-1252-4df8-94df-3da9a19b94d9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:24.709511 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:24.709511 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:34:24.716874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f36b7a10-60d5-482e-946b-efcd717b71d4 req-2e8e1a31-c3a5-4dff-95dd-1f20c3d576bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:24.717455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f36b7a10-60d5-482e-946b-efcd717b71d4 req-2e8e1a31-c3a5-4dff-95dd-1f20c3d576bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:24.732906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f36b7a10-60d5-482e-946b-efcd717b71d4 req-2e8e1a31-c3a5-4dff-95dd-1f20c3d576bf service nova] Creating event network-changed:687cdb81-1252-4df8-94df-3da9a19b94d9 for instance 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c on nch1-master-1 Feb 12 21:34:24.738438 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f36b7a10-60d5-482e-946b-efcd717b71d4 req-2e8e1a31-c3a5-4dff-95dd-1f20c3d576bf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034789 Feb 12 21:34:24.739367 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2804/5741] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:24.919975 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0f012ee9-262d-4806-ad90-a72f8810c59a tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1464 microversion: 2.1 time: 0.238508 Feb 12 21:34:24.920566 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2938/5742] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:24 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:25.467154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:25.468264 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:25.475300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:25.475759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:25.476550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:25.476984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:25.504415 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a7e3d59-5cea-40a1-9fc1-2bca4a331b14 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042082 Feb 12 21:34:25.505400 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2805/5743] 10.222.0.31 () {58 vars in 1292 bytes} [Sat Feb 12 21:34:25 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:25.937052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:25.937763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:25.946487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:25.947442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:25.948260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:25.948876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:26.216462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d2ef8fb-096f-4ff5-a4bd-0e6b3f55773f tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1464 microversion: 2.1 time: 0.283388 Feb 12 21:34:26.217058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2939/5744] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:25 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:27.234670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:27.235305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:27.242920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:27.242920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:27.247972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:27.247972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:27.498414 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d67d007c-3df2-4c8a-b5b4-abab0c119776 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1464 microversion: 2.1 time: 0.268585 Feb 12 21:34:27.499674 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2806/5745] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:27 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:27.864357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5b9168d7-f0f3-4bf1-a48a-01cac55730aa req-0fbc2e35-9d4f-4ffb-8687-dc69be75ad9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c", "name": "network-vif-plugged", "status": "completed", "tag": "687cdb81-1252-4df8-94df-3da9a19b94d9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:27.868221 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:27.868221 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:27.888449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5b9168d7-f0f3-4bf1-a48a-01cac55730aa req-0fbc2e35-9d4f-4ffb-8687-dc69be75ad9b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:27.888837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5b9168d7-f0f3-4bf1-a48a-01cac55730aa req-0fbc2e35-9d4f-4ffb-8687-dc69be75ad9b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:27.901988 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5b9168d7-f0f3-4bf1-a48a-01cac55730aa req-0fbc2e35-9d4f-4ffb-8687-dc69be75ad9b service nova] Creating event network-vif-plugged:687cdb81-1252-4df8-94df-3da9a19b94d9 for instance 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c on nch1-master-1 Feb 12 21:34:27.909926 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5b9168d7-f0f3-4bf1-a48a-01cac55730aa req-0fbc2e35-9d4f-4ffb-8687-dc69be75ad9b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048345 Feb 12 21:34:27.909926 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2940/5746] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:28.113311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df6ac385-f887-493c-b83d-60edee8eeacf tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '.version_select at 0x7fa8fd934280>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:28.190502 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df6ac385-f887-493c-b83d-60edee8eeacf tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2140969605" status: 202 len: 0 microversion: 2.1 time: 0.080915 Feb 12 21:34:28.195129 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2807/5747] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 21:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2140969605 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:34:28.228535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05e216f1-4c23-4da6-9221-369e5c6e340b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: .version_select at 0x7fa8fc5fbd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1864177865"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:28.242367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-05e216f1-4c23-4da6-9221-369e5c6e340b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:28.248158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-05e216f1-4c23-4da6-9221-369e5c6e340b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:28.473786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-05e216f1-4c23-4da6-9221-369e5c6e340b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:28.479616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-05e216f1-4c23-4da6-9221-369e5c6e340b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:28.507670 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05e216f1-4c23-4da6-9221-369e5c6e340b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.283316 Feb 12 21:34:28.508291 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2941/5748] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:34:28 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:28.517245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:28.518129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:28.528195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:28.529027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:28.530013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:28.530684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:28.718089 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1bcbf4d-2d47-45ad-91ff-7a14337c8fb3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1464 microversion: 2.1 time: 0.205624 Feb 12 21:34:28.719077 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2808/5749] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:28 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1464 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:28.770689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5d57828-f83a-437a-b2f8-8150478ed07b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] Calling method '.version_select at 0x7fa8fd788430>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:28.890430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5d57828-f83a-437a-b2f8-8150478ed07b tempest-TestVolumeBootPattern-1530501963 tempest-TestVolumeBootPattern-1530501963-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-78159880" status: 202 len: 0 microversion: 2.1 time: 0.123310 Feb 12 21:34:28.891148 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2942/5750] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 21:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-78159880 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:34:29.735798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:29.736488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:29.743491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:29.744197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:29.751030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:29.751776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:29.910774 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-057c1034-868b-425c-9384-b2b606a521a3 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1648 microversion: 2.1 time: 0.178797 Feb 12 21:34:29.924605 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2809/5751] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:29 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1648 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:29.930729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:29.932875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:29.946073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:29.946548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:29.948169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:29.948799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:30.279039 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ea2026fc-03ea-4699-92c9-6805f007c0fe tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1648 microversion: 2.1 time: 0.354308 Feb 12 21:34:30.279625 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2943/5752] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:29 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1648 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:30.295528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:30.296135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:30.302414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:30.302867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:30.303651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:30.304090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:30.469569 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-763437f8-89d3-4ae1-bb5f-5e574a322df8 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1648 microversion: 2.1 time: 0.177689 Feb 12 21:34:30.470153 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2810/5753] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:30 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1648 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:30.486090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:30.486596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:30.492990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:30.493531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:30.494689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:30.495144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:30.520432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:34:30.915208 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-731b1252-4b6a-4f9b-9a49-3f5cf28eeff1 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "DELETE /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 204 len: 0 microversion: 2.1 time: 0.432387 Feb 12 21:34:30.917177 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2944/5754] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:34:30 2022] DELETE /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:34:30.926167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:30.927704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:30.942007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:30.943011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:30.943964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:30.944596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:31.121400 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9273215-fb70-4eb2-93fb-be3396e7b028 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1654 microversion: 2.1 time: 0.199862 Feb 12 21:34:31.123429 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2811/5755] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:30 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1654 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:32.139619 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:32.141074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:32.151389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:32.152301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:32.153725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:32.154330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:32.372342 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f723f1d-642c-400e-b341-c57337ce4787 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1654 microversion: 2.1 time: 0.237285 Feb 12 21:34:32.373136 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2945/5756] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:32 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1654 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:33.214787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-cd6301da-5038-418a-8935-f485d4d2ca93 req-e78e583d-2e0c-486b-b29e-3bb7bec4a9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c", "name": "network-vif-deleted", "tag": "687cdb81-1252-4df8-94df-3da9a19b94d9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:33.218068 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:33.218068 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:34:33.227744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-cd6301da-5038-418a-8935-f485d4d2ca93 req-e78e583d-2e0c-486b-b29e-3bb7bec4a9c7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:33.228629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-cd6301da-5038-418a-8935-f485d4d2ca93 req-e78e583d-2e0c-486b-b29e-3bb7bec4a9c7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:33.253621 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-cd6301da-5038-418a-8935-f485d4d2ca93 req-e78e583d-2e0c-486b-b29e-3bb7bec4a9c7 service nova] Creating event network-vif-deleted:687cdb81-1252-4df8-94df-3da9a19b94d9 for instance 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c on nch1-master-1 Feb 12 21:34:33.259994 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-cd6301da-5038-418a-8935-f485d4d2ca93 req-e78e583d-2e0c-486b-b29e-3bb7bec4a9c7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056883 Feb 12 21:34:33.261074 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2812/5757] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:33.392389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:33.392841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:33.399357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:33.399831 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:33.401082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:33.401759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:33.892542 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e92600c-7a72-42e4-90c2-672a59f2648e tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 200 len: 1449 microversion: 2.1 time: 0.505310 Feb 12 21:34:33.902310 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2946/5758] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:33 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 1449 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:34.914872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:34.917384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:34.928377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:34.928845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:34.930241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:34.930704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:34.952069 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] HTTP exception thrown: Instance 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c could not be found. Feb 12 21:34:34.952989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Returning 404 to user: Instance 4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:34:34.954041 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7395c4de-6fd5-43af-b2a2-7769ec7fe8e9 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c" status: 404 len: 111 microversion: 2.1 time: 0.045937 Feb 12 21:34:34.955105 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2813/5759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:34 2022] GET /compute/v2.1/servers/4ea2ba0e-2686-43d0-9932-fb55fb1d3a9c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:34:34.963539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:34.964918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:34.976004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:34.976602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:34.980221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:34.980221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:35.005967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:34:35.320526 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91e3d65c-d1f6-4fc6-ac6e-0ae315bcb0fb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "DELETE /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 204 len: 0 microversion: 2.1 time: 0.361096 Feb 12 21:34:35.321111 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2947/5760] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:34:34 2022] DELETE /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:34:35.334202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:35.334202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:35.344650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:35.345120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:35.345972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:35.346423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:35.646112 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-20cc0c0c-fa2a-468a-87e1-b91021dce5e0 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1654 microversion: 2.1 time: 0.319831 Feb 12 21:34:35.648034 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2814/5761] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:35 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1654 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:36.669052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:36.669950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:36.679654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:36.679654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:36.679654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:36.679909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:36.845296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82fe2f09-0757-4944-8c68-8553dd5962eb tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1654 microversion: 2.1 time: 0.181484 Feb 12 21:34:36.846657 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2948/5762] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:36 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1654 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:37.850371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6451738e-2400-42e7-8191-431737e67bcf req-a430b1db-7494-4dac-8bca-4bbeed8c073c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71329122-faa4-485f-86b6-d5c458f79b0b", "name": "network-vif-deleted", "tag": "7b28568e-09b2-43a3-8d6c-7b5a5efddc9c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:37.852597 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:37.852597 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:34:37.866416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:37.867355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:37.874281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6451738e-2400-42e7-8191-431737e67bcf req-a430b1db-7494-4dac-8bca-4bbeed8c073c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:37.875107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6451738e-2400-42e7-8191-431737e67bcf req-a430b1db-7494-4dac-8bca-4bbeed8c073c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:37.883064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:37.883550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:37.885460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:37.885858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:37.895118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6451738e-2400-42e7-8191-431737e67bcf req-a430b1db-7494-4dac-8bca-4bbeed8c073c service nova] Creating event network-vif-deleted:7b28568e-09b2-43a3-8d6c-7b5a5efddc9c for instance 71329122-faa4-485f-86b6-d5c458f79b0b on nch2-master-1 Feb 12 21:34:37.909555 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6451738e-2400-42e7-8191-431737e67bcf req-a430b1db-7494-4dac-8bca-4bbeed8c073c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063294 Feb 12 21:34:37.915022 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2815/5763] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:38.166992 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f00233df-6aae-415b-aff2-16db39f4dcf2 tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 200 len: 1612 microversion: 2.1 time: 0.307186 Feb 12 21:34:38.177536 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2949/5764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:37 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 1612 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:39.185629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:39.186619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] [instance: 71329122-faa4-485f-86b6-d5c458f79b0b] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:39.194113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:39.200722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:39.200722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:39.200722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:39.211565 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] HTTP exception thrown: Instance 71329122-faa4-485f-86b6-d5c458f79b0b could not be found. Feb 12 21:34:39.212126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] Returning 404 to user: Instance 71329122-faa4-485f-86b6-d5c458f79b0b could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:34:39.216565 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8a5655cf-0b28-4376-9c3c-55fc9c80b8ee tempest-TestServerMultinode-213434313 tempest-TestServerMultinode-213434313-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b" status: 404 len: 111 microversion: 2.1 time: 0.035206 Feb 12 21:34:39.225285 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2816/5765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:39 2022] GET /compute/v2.1/servers/71329122-faa4-485f-86b6-d5c458f79b0b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:34:41.355797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1090963983", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "c7a0fc29-f76a-4c5e-92c8-a653107cbf0f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1864177865", "security_groups": [{"name": "tempest-secgroup-smoke-623653110"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:41.563917 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] validate_networks() for [('c7a0fc29-f76a-4c5e-92c8-a653107cbf0f', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:34:42.439576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:34:42.441033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:34:42.442159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:34:42.442767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:34:42.443367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:34:42.463569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:42.464364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:42.467009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:42.473002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:42.501581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:42.508219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:42.522661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:34:42.526186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:34:42.707648 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47e8194e-221b-4339-9a27-328032a08f8d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.357090 Feb 12 21:34:42.709133 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2950/5766] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:34:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:34:42.728882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e6c6a5c-d6f1-4c65-987b-fd9a76148c91 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:42.735056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e6c6a5c-d6f1-4c65-987b-fd9a76148c91 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:42.909502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0e6c6a5c-d6f1-4c65-987b-fd9a76148c91 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:42.917956 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e6c6a5c-d6f1-4c65-987b-fd9a76148c91 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1267 microversion: 2.1 time: 0.198178 Feb 12 21:34:42.929035 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2817/5767] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:42 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:43.938516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:43.939152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:43.954063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:43.954722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:43.955938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:43.957458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:44.072864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:44.083488 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81492f4c-8a6e-4e5d-a0a6-e485b6ac3f4c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1271 microversion: 2.1 time: 0.150658 Feb 12 21:34:44.096767 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2951/5768] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:43 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:45.105075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:45.105776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:45.134563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:45.134563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:45.134563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:45.134563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:45.262120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:45.285520 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e834a7ac-b133-4af3-b7da-2f75df4bed47 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1319 microversion: 2.1 time: 0.187139 Feb 12 21:34:45.286442 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2818/5769] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:45 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:45.354985 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fbe28947-04b2-488c-adc8-afead31da066 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Action: 'create', calling method: .version_select at 0x7fa8fd783b80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1173202455"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:45.382769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fbe28947-04b2-488c-adc8-afead31da066 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Getting quotas for project cfcb9d238a52483a94553e900468a87c. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:45.393476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fbe28947-04b2-488c-adc8-afead31da066 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Getting quotas for user dd1a01a1f86a4f4ca3997db04ed1b4f8 and project cfcb9d238a52483a94553e900468a87c. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:45.643584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fbe28947-04b2-488c-adc8-afead31da066 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Getting quotas for project cfcb9d238a52483a94553e900468a87c. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:45.658537 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-fbe28947-04b2-488c-adc8-afead31da066 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Getting quotas for user dd1a01a1f86a4f4ca3997db04ed1b4f8 and project cfcb9d238a52483a94553e900468a87c. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:45.686176 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fbe28947-04b2-488c-adc8-afead31da066 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.335855 Feb 12 21:34:45.686868 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2952/5770] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:34:45 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:46.310388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:46.311160 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:46.318711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:46.319165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:46.320688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:46.321275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:46.596227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:46.604694 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1a0c761-da5c-4dbe-9748-cdc6fb203568 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.299978 Feb 12 21:34:46.614173 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2819/5771] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:46 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:47.530809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0a7df437-4392-49bc-8c79-905e28c3f1fe req-ea246736-ff54-4e30-acd8-b045ca542c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:47.533375 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:47.533375 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:47.549933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0a7df437-4392-49bc-8c79-905e28c3f1fe req-ea246736-ff54-4e30-acd8-b045ca542c4b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:47.552767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0a7df437-4392-49bc-8c79-905e28c3f1fe req-ea246736-ff54-4e30-acd8-b045ca542c4b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:47.576591 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0a7df437-4392-49bc-8c79-905e28c3f1fe req-ea246736-ff54-4e30-acd8-b045ca542c4b service nova] Creating event network-changed:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:34:47.585652 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0a7df437-4392-49bc-8c79-905e28c3f1fe req-ea246736-ff54-4e30-acd8-b045ca542c4b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061393 Feb 12 21:34:47.591402 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2953/5772] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:47.626167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:47.627743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:47.636962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:47.637539 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:47.638748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:47.639547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:48.341228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:48.350727 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-575d3ef0-04bf-41bc-b710-0672be27276d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.730893 Feb 12 21:34:48.358489 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2820/5773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:47 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:49.368707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:49.370309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:49.376529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:49.376997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:49.377846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:49.378307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:49.564530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:49.586073 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f64a1b7-f625-4177-aa21-b355e73eeefe tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.222270 Feb 12 21:34:49.588464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2954/5774] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:49 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:49.605210 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-19303161", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "29b7e6aa-158b-4248-a1b3-80e64eeff62a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1173202455", "security_groups": [{"name": "tempest-secgroup-smoke-365336808"}], "networks": [{"uuid": "7b73a427-9588-4cc4-abcf-a42a5fb9215f"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:49.783867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] validate_networks() for [('7b73a427-9588-4cc4-abcf-a42a5fb9215f', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:34:50.403883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:34:50.404439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:34:50.404856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:34:50.405251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:34:50.405699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:34:50.414492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:50.414943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:50.415836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:50.416278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:50.433411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Getting quotas for project cfcb9d238a52483a94553e900468a87c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:34:50.438543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Getting quotas for user dd1a01a1f86a4f4ca3997db04ed1b4f8 and project cfcb9d238a52483a94553e900468a87c. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:34:50.496592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:34:50.498795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29b7e6aa-158b-4248-a1b3-80e64eeff62a',volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:34:50.610348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:50.611008 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:50.618041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:50.619287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:50.620237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:50.620701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:50.762503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:50.772951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38dd6c3f-0ab3-4181-8c8f-eb7228a203d2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.166609 Feb 12 21:34:50.773645 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2955/5775] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:50 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:50.933452 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ddceb450-f7cc-4ec8-b806-9417e7f7118c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.332290 Feb 12 21:34:50.934104 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2821/5776] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:34:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:34:50.944201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f9dace04-5942-44db-a990-0c7f6ddeb50a tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:50.945031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f9dace04-5942-44db-a990-0c7f6ddeb50a tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:51.005666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f9dace04-5942-44db-a990-0c7f6ddeb50a tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:51.013388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f9dace04-5942-44db-a990-0c7f6ddeb50a tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1097 microversion: 2.1 time: 0.073092 Feb 12 21:34:51.014194 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2956/5777] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:50 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1097 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:51.792388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:51.793022 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:51.800110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:51.801739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:51.807882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:51.813150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:51.965032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:51.972582 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5be986d9-28fb-426a-9071-e80a2ff5fd32 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.185785 Feb 12 21:34:51.973191 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2822/5778] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:51 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:52.034526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aeecf81e-fcc0-499f-a72b-9535dd42786d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:52.035834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aeecf81e-fcc0-499f-a72b-9535dd42786d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:52.096646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aeecf81e-fcc0-499f-a72b-9535dd42786d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:52.105063 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aeecf81e-fcc0-499f-a72b-9535dd42786d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1097 microversion: 2.1 time: 0.074958 Feb 12 21:34:52.106333 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2957/5779] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:52 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1097 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:52.990404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:52.991127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:52.999112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:52.999595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:53.000506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:53.000949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:53.122785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:53.123428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:53.132826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:53.133298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:53.134140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:53.134595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:53.145335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:53.153380 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88673c6c-ae4f-4e31-baaf-f02f464356aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.166693 Feb 12 21:34:53.154231 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2823/5780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:52 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:53.207559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:53.215113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-270b3b86-bbb0-465d-97d0-48d5f346ee44 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1195 microversion: 2.1 time: 0.096712 Feb 12 21:34:53.220881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2958/5781] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:53 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1195 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:53.987144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-82c16e6d-56ca-4d1d-984d-60108742cfb1 req-2fb22972-a89a-4913-9f15-444f37340712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "name": "network-vif-plugged", "status": "completed", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:53.989024 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:53.989024 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:34:54.000006 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-82c16e6d-56ca-4d1d-984d-60108742cfb1 req-2fb22972-a89a-4913-9f15-444f37340712 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:54.001107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-82c16e6d-56ca-4d1d-984d-60108742cfb1 req-2fb22972-a89a-4913-9f15-444f37340712 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:54.014380 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-82c16e6d-56ca-4d1d-984d-60108742cfb1 req-2fb22972-a89a-4913-9f15-444f37340712 service nova] Creating event network-vif-plugged:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:34:54.021018 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-82c16e6d-56ca-4d1d-984d-60108742cfb1 req-2fb22972-a89a-4913-9f15-444f37340712 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039863 Feb 12 21:34:54.021694 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2824/5782] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:54.170855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:54.172085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:54.179591 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:54.180256 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:54.181285 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:54.181939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:54.234866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:54.235598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:54.247811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:54.248631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:54.249050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:54.249517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:54.348892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:54.358459 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96e012dc-4489-4d6a-98a1-b946e6228498 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.192631 Feb 12 21:34:54.359773 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2959/5783] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:54 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:54.360241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:54.368418 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a7151d61-ca4c-4811-b90b-6dc5e14b695e tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1213 microversion: 2.1 time: 0.138468 Feb 12 21:34:54.369042 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2825/5784] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:54 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:55.376324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:55.376953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:55.384127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:55.384825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:55.385845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:55.386487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:55.387509 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:55.388262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:55.399388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:55.400265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:55.401305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:55.401840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:55.620558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:55.630836 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a6441210-4287-483d-98e5-5721f99a9c96 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1392 microversion: 2.1 time: 0.258170 Feb 12 21:34:55.632074 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2960/5785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:55 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:55.731188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:55.739000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77d4f99d-d2bb-40c9-bcfa-717eb338024c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1280 microversion: 2.1 time: 0.355902 Feb 12 21:34:55.739502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2826/5786] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:55 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1280 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:55.878215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ffaacfb8-8d11-43bf-89d6-fe42ccd3d5ec req-745e2356-3aa3-4492-8091-b6fc61021a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:55.880347 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:55.880347 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:55.890622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ffaacfb8-8d11-43bf-89d6-fe42ccd3d5ec req-745e2356-3aa3-4492-8091-b6fc61021a7d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:55.891470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ffaacfb8-8d11-43bf-89d6-fe42ccd3d5ec req-745e2356-3aa3-4492-8091-b6fc61021a7d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:55.906090 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ffaacfb8-8d11-43bf-89d6-fe42ccd3d5ec req-745e2356-3aa3-4492-8091-b6fc61021a7d service nova] Creating event network-changed:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:34:55.916819 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ffaacfb8-8d11-43bf-89d6-fe42ccd3d5ec req-745e2356-3aa3-4492-8091-b6fc61021a7d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042308 Feb 12 21:34:55.917859 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2961/5787] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:56.648258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:56.648909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:56.656389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:56.656850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:56.659830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:56.659830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:56.756978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:56.757823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:56.766352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:56.766822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:56.767631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:56.768081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:56.799119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:56.807219 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-12eeadde-41c1-4aca-afd2-4271aaa897c1 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1564 microversion: 2.1 time: 0.162663 Feb 12 21:34:56.807797 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2827/5788] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:56 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:56.826227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:56.826845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:56.832892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:56.833348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:56.834185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:56.834626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:56.914055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:56.922124 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b03fe3b-0089-4ab5-8ff8-064d69254aa9 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1268 microversion: 2.1 time: 0.169437 Feb 12 21:34:56.922771 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2962/5789] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:56 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:56.976612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:56.984865 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4d97f36a-9208-4e24-b780-3c646fcdde21 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1564 microversion: 2.1 time: 0.162597 Feb 12 21:34:56.985472 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2828/5790] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:56 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:34:57.940282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:57.940889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:57.948937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:57.950664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:57.951496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:57.951988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:58.527403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:58.536007 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-24a36765-ba6f-4671-ad80-efea50215bc4 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1268 microversion: 2.1 time: 0.599650 Feb 12 21:34:58.536769 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2963/5791] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:57 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1268 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:59.534181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:59.535414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:59.539870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-24b3b7e6-e70a-4dff-b5ce-38745f7bdbcb req-9028f8c3-a18f-4f64-9019-811a40bb7a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:34:59.542157 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:34:59.542157 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:34:59.547537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:59.548474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:59.550278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:59.550278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:59.553062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-24b3b7e6-e70a-4dff-b5ce-38745f7bdbcb req-9028f8c3-a18f-4f64-9019-811a40bb7a02 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:59.553768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-24b3b7e6-e70a-4dff-b5ce-38745f7bdbcb req-9028f8c3-a18f-4f64-9019-811a40bb7a02 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:59.568022 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-24b3b7e6-e70a-4dff-b5ce-38745f7bdbcb req-9028f8c3-a18f-4f64-9019-811a40bb7a02 service nova] Creating event network-changed:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:34:59.574896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-24b3b7e6-e70a-4dff-b5ce-38745f7bdbcb req-9028f8c3-a18f-4f64-9019-811a40bb7a02 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038234 Feb 12 21:34:59.575762 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2964/5792] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:34:59.583867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:34:59.584804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:34:59.593291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:59.593795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:59.595054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:34:59.595054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:34:59.767532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:59.776727 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fed1b5e1-49c8-4196-85e6-aa03073890dd tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1268 microversion: 2.1 time: 0.195827 Feb 12 21:34:59.777428 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2965/5793] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:59 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:34:59.828302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:34:59.838675 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d95956ec-5063-46d3-b72a-58a857a47a8f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1564 microversion: 2.1 time: 0.308125 Feb 12 21:34:59.849735 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2829/5794] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:34:59 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1564 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:00.793704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:00.795806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:00.803015 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:00.803490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:00.804316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:00.804796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:00.955606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:00.972572 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9ef8bd3-aedc-4337-9f90-2055a949fc37 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1268 microversion: 2.1 time: 0.182273 Feb 12 21:35:00.974431 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2966/5795] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:00 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:01.990412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:01.991114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:01.998201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:01.998658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:01.999471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:01.999910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:02.022045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ca9683e9-3b30-4851-a67d-836e8df36e65 req-26cf0039-484a-4bb8-9e02-8567826d42b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "name": "network-vif-plugged", "status": "completed", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:02.023600 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:02.023600 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:35:02.033407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ca9683e9-3b30-4851-a67d-836e8df36e65 req-26cf0039-484a-4bb8-9e02-8567826d42b6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:02.034165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ca9683e9-3b30-4851-a67d-836e8df36e65 req-26cf0039-484a-4bb8-9e02-8567826d42b6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:02.045961 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ca9683e9-3b30-4851-a67d-836e8df36e65 req-26cf0039-484a-4bb8-9e02-8567826d42b6 service nova] Creating event network-vif-plugged:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:35:02.050982 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ca9683e9-3b30-4851-a67d-836e8df36e65 req-26cf0039-484a-4bb8-9e02-8567826d42b6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Feb 12 21:35:02.051584 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2967/5796] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:02.243580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:02.252767 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c02c72d5-a32c-4227-b2d8-93e2a6de4f6d tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1268 microversion: 2.1 time: 0.266082 Feb 12 21:35:02.253437 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2830/5797] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:01 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1268 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:35:03.273637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:03.274323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:03.282215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:03.282691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:03.283624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:03.283976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:03.423966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:03.431839 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2f74a31d-d5ae-4d37-9519-82452000b30f tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1268 microversion: 2.1 time: 0.165010 Feb 12 21:35:03.432438 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2968/5798] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:03 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:04.448012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:04.448553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:04.455928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:04.456385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:04.457164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:04.457630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:04.597381 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:04.605044 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-49b1f100-87ed-495f-a939-88f662ee3662 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1457 microversion: 2.1 time: 0.160980 Feb 12 21:35:04.605661 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2831/5799] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:04 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1457 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:04.621445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:04.622070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:04.629469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:04.629942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:04.630777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:04.631253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:04.771894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:04.779921 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3999a2b-fce9-41eb-aa0c-27b9a7139b12 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1457 microversion: 2.1 time: 0.162792 Feb 12 21:35:04.780491 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2969/5800] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:04 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:06.936558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6b5fcdc8-952d-4437-b2e3-c88a6393971f req-83e1d4ae-bb90-4fb3-bf93-307f5ff4e1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:06.938263 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:06.938263 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:06.946298 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6b5fcdc8-952d-4437-b2e3-c88a6393971f req-83e1d4ae-bb90-4fb3-bf93-307f5ff4e1a1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:06.946879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6b5fcdc8-952d-4437-b2e3-c88a6393971f req-83e1d4ae-bb90-4fb3-bf93-307f5ff4e1a1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:06.958859 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6b5fcdc8-952d-4437-b2e3-c88a6393971f req-83e1d4ae-bb90-4fb3-bf93-307f5ff4e1a1 service nova] Creating event network-changed:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:35:06.964175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6b5fcdc8-952d-4437-b2e3-c88a6393971f req-83e1d4ae-bb90-4fb3-bf93-307f5ff4e1a1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031518 Feb 12 21:35:06.965916 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2832/5801] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:08.653249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1a76cca6-fc6d-4b19-aff9-9686a1159b9c req-485257e0-c1dd-4a47-87d3-ec49cad064d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:08.657998 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:08.657998 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:35:08.670164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1a76cca6-fc6d-4b19-aff9-9686a1159b9c req-485257e0-c1dd-4a47-87d3-ec49cad064d3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:08.670654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1a76cca6-fc6d-4b19-aff9-9686a1159b9c req-485257e0-c1dd-4a47-87d3-ec49cad064d3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:08.682126 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1a76cca6-fc6d-4b19-aff9-9686a1159b9c req-485257e0-c1dd-4a47-87d3-ec49cad064d3 service nova] Creating event network-changed:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:35:08.686989 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1a76cca6-fc6d-4b19-aff9-9686a1159b9c req-485257e0-c1dd-4a47-87d3-ec49cad064d3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044590 Feb 12 21:35:08.688966 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2970/5802] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:10.703597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-476111f2-acfe-467f-9cc7-48ffa0170097 req-efac89f7-7c1d-4799-a970-de35c8db30d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:10.705090 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:10.705090 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:10.713019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-476111f2-acfe-467f-9cc7-48ffa0170097 req-efac89f7-7c1d-4799-a970-de35c8db30d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:10.713482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-476111f2-acfe-467f-9cc7-48ffa0170097 req-efac89f7-7c1d-4799-a970-de35c8db30d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:10.725315 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-476111f2-acfe-467f-9cc7-48ffa0170097 req-efac89f7-7c1d-4799-a970-de35c8db30d1 service nova] Creating event network-changed:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:35:10.730101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-476111f2-acfe-467f-9cc7-48ffa0170097 req-efac89f7-7c1d-4799-a970-de35c8db30d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030999 Feb 12 21:35:10.731394 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2833/5803] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:35:22.241864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:22.242877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:22.249272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:22.249851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:22.250660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:22.251115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:22.306814 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ad5c426-3d79-4bfa-a33c-0cd100fa7c04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action" status: 200 len: 24576 microversion: 2.1 time: 0.069822 Feb 12 21:35:22.307481 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2971/5804] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:35:22 2022] POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action => generated 24576 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:35:33.308813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:33.309864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:33.315946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:33.319348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:33.319348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:33.319348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:33.460612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:33.469007 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1dbf1557-741e-4a5a-8364-3b22ae9ceb9e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1683 microversion: 2.1 time: 0.165174 Feb 12 21:35:33.469612 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2834/5805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:33 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:33.564984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:33.566071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:33.573404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:33.573885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:33.575436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:33.576089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:33.629685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fc595127-5905-4d22-872f-a15d7ffd1d7a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action" status: 200 len: 32642 microversion: 2.1 time: 0.068642 Feb 12 21:35:33.787029 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2972/5806] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:35:33 2022] POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action => generated 32642 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:35:33.953831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:33.954448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:33.960502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:33.963379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:33.963379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:33.963379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:34.098984 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4a10f84-4d2f-4a33-9d9c-51e0807a3cac tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1834 microversion: 2.1 time: 0.149344 Feb 12 21:35:34.099567 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2835/5807] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:33 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1834 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:34.116413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:34.117660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:34.125401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:34.125858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:34.126663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:34.127112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:34.153069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lazy-loading 'flavor' on Instance uuid f72d15d9-f2cd-4a89-bff2-6a01c79d446f {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:35:34.166679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Going to try to live migrate instance to another host {{(pid=141727) live_migrate /opt/stack/nova/nova/compute/api.py:5279}} Feb 12 21:35:36.801577 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60c9e14e-1bdf-4357-9dd6-d0ba626d35a9 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action" status: 202 len: 0 microversion: 2.1 time: 2.689101 Feb 12 21:35:36.802393 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2973/5808] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:35:34 2022] POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action => generated 0 bytes in 2691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:35:36.810262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:36.810883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:36.817872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:36.818332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:36.819168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:36.819640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:36.973178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:36.980699 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cca71c1b-5c7b-49ba-a646-491a5f5917af tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.174180 Feb 12 21:35:36.981418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2836/5809] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:36 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:37.998612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:37.999216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:38.009205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:38.014514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:38.014514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:38.014514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:38.159998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:38.168404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-301a0848-c56e-4991-b6cc-0ee3948ab57d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.174471 Feb 12 21:35:38.169493 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2974/5810] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:37 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:38.547681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b54b71d0-6090-4e96-8980-5cdff2e43f31 req-aee38def-5d81-4f9f-b2bd-075d8b10eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "name": "network-vif-unplugged", "status": "completed", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:38.549239 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:38.549239 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:38.557011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b54b71d0-6090-4e96-8980-5cdff2e43f31 req-aee38def-5d81-4f9f-b2bd-075d8b10eb63 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:38.558266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b54b71d0-6090-4e96-8980-5cdff2e43f31 req-aee38def-5d81-4f9f-b2bd-075d8b10eb63 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:38.568565 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b54b71d0-6090-4e96-8980-5cdff2e43f31 req-aee38def-5d81-4f9f-b2bd-075d8b10eb63 service nova] Creating event network-vif-unplugged:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:35:38.573939 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b54b71d0-6090-4e96-8980-5cdff2e43f31 req-aee38def-5d81-4f9f-b2bd-075d8b10eb63 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030510 Feb 12 21:35:38.578548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2837/5811] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:39.188541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:39.189116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:39.196826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:39.197312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:39.198176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:39.198637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:39.739291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:39.754708 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a07ef696-2d68-4712-b52e-281576fdd8fd tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.572346 Feb 12 21:35:39.755988 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2975/5812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:39 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:39.775747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f5c1b4a4-97cd-4fde-889a-63796f94fd93 req-d7388fae-8f75-4f80-9559-2857003477e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "name": "network-vif-plugged", "status": "completed", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:39.777486 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:39.777486 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:39.787238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f5c1b4a4-97cd-4fde-889a-63796f94fd93 req-d7388fae-8f75-4f80-9559-2857003477e1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:39.787715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f5c1b4a4-97cd-4fde-889a-63796f94fd93 req-d7388fae-8f75-4f80-9559-2857003477e1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:39.803721 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f5c1b4a4-97cd-4fde-889a-63796f94fd93 req-d7388fae-8f75-4f80-9559-2857003477e1 service nova] Creating event network-vif-plugged:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:35:39.808585 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f5c1b4a4-97cd-4fde-889a-63796f94fd93 req-d7388fae-8f75-4f80-9559-2857003477e1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197088 Feb 12 21:35:39.809227 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2838/5813] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:40.587966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-b2b383b1-62e9-4aac-803c-f7ddc184aad7 req-9b711cf7-f761-4a9d-ba69-5aa6e1124371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:40.589759 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:40.589759 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:35:40.599406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b2b383b1-62e9-4aac-803c-f7ddc184aad7 req-9b711cf7-f761-4a9d-ba69-5aa6e1124371 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:40.599946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-b2b383b1-62e9-4aac-803c-f7ddc184aad7 req-9b711cf7-f761-4a9d-ba69-5aa6e1124371 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:40.612351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-b2b383b1-62e9-4aac-803c-f7ddc184aad7 req-9b711cf7-f761-4a9d-ba69-5aa6e1124371 service nova] Creating event network-changed:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:35:40.617342 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-b2b383b1-62e9-4aac-803c-f7ddc184aad7 req-9b711cf7-f761-4a9d-ba69-5aa6e1124371 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033182 Feb 12 21:35:40.618043 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2976/5814] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:40.780275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:40.780275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:40.784800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:40.785566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:40.786548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:40.787705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:41.034803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:41.042925 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b2d7a67f-07d2-4779-8d7b-3732d6302764 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.272775 Feb 12 21:35:41.045270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2839/5815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:40 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:42.064131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:42.064894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:42.071645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:42.072319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:42.073333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:42.073825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:42.252461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:42.262441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-171facc5-5764-44bb-896d-1dc3ba389770 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.203754 Feb 12 21:35:42.263236 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2977/5816] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:42 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:43.280370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:43.281170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:43.288528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:43.288954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:43.289799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:43.290240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:43.440874 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:43.448567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-baa142f0-d14d-45a1-8b4b-401c28294ce4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.172542 Feb 12 21:35:43.449204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2840/5817] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:43 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:44.466525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:44.467830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:44.475252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:44.475698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:44.476505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:44.476958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:44.634041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:44.643777 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13a636e0-779c-403f-9b54-5f4daa159f4f tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.180853 Feb 12 21:35:44.644287 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2978/5818] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:44 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:44.664227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-eb327532-bbe9-4878-96d4-96569ce835c0 req-dca326ef-28c5-41f4-bc3e-e61b297eb7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "name": "network-vif-unplugged", "status": "completed", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:44.664227 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:44.664227 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:44.666352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-eb327532-bbe9-4878-96d4-96569ce835c0 req-dca326ef-28c5-41f4-bc3e-e61b297eb7bc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:44.666805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-eb327532-bbe9-4878-96d4-96569ce835c0 req-dca326ef-28c5-41f4-bc3e-e61b297eb7bc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:44.677929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-eb327532-bbe9-4878-96d4-96569ce835c0 req-dca326ef-28c5-41f4-bc3e-e61b297eb7bc service nova] Creating event network-vif-unplugged:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch1-master-1 Feb 12 21:35:44.682882 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-eb327532-bbe9-4878-96d4-96569ce835c0 req-dca326ef-28c5-41f4-bc3e-e61b297eb7bc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030287 Feb 12 21:35:44.683474 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2841/5819] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:45.661799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:45.662420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:45.669468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:45.669842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:45.670851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:45.671303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:45.811167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:45.819910 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3192104d-1e92-4a05-8ee7-7bd6fa5d8556 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1693 microversion: 2.1 time: 0.161906 Feb 12 21:35:45.820919 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2979/5820] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:45 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:46.840181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:46.840889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:46.848033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:46.848493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:46.849326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:46.849818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:46.988449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:46.995895 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4f5671f-d612-49ed-ae8a-0ccb011583b2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1683 microversion: 2.1 time: 0.160769 Feb 12 21:35:46.996468 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2842/5821] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:46 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:47.012438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:47.013065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:47.020803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:47.021301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:47.022121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:47.022607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:47.176212 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-128da61d-e664-4dab-818d-8d287da7e940 tempest-TestNetworkAdvancedServerOps-1484886277 tempest-TestNetworkAdvancedServerOps-1484886277-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1834 microversion: 2.1 time: 0.167440 Feb 12 21:35:47.177114 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2980/5822] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:47 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1834 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:47.192285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:47.192906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:47.199000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:47.199450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:47.200247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:47.200691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:47.340292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:47.347731 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-993f1001-d813-44ff-a177-6c79dfeec4f4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1683 microversion: 2.1 time: 0.159247 Feb 12 21:35:47.348383 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2843/5823] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:47 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:47.440084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:47.446700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:47.447287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:47.447774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:47.448570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:47.449037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:47.498118 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5b29ae8-ded9-4513-b3cb-51e78eeef057 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action" status: 200 len: 38680 microversion: 2.1 time: 0.062545 Feb 12 21:35:47.498762 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2981/5824] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:35:47 2022] POST /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f/action => generated 38680 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:35:48.287500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7931e8c4-5d12-4206-b6bc-c58fcb15ddf6 req-47093d49-40d5-456f-a984-a22633222584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "name": "network-vif-plugged", "status": "completed", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:48.301844 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:48.301844 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:48.327072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7931e8c4-5d12-4206-b6bc-c58fcb15ddf6 req-47093d49-40d5-456f-a984-a22633222584 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:48.327705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7931e8c4-5d12-4206-b6bc-c58fcb15ddf6 req-47093d49-40d5-456f-a984-a22633222584 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:48.347690 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7931e8c4-5d12-4206-b6bc-c58fcb15ddf6 req-47093d49-40d5-456f-a984-a22633222584 service nova] Creating event network-vif-plugged:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch2-master-1 Feb 12 21:35:48.354536 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7931e8c4-5d12-4206-b6bc-c58fcb15ddf6 req-47093d49-40d5-456f-a984-a22633222584 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070952 Feb 12 21:35:48.355375 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2844/5825] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:48.592641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:48.593501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:48.601405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:48.601882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:48.602702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:48.603344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:48.638978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:35:48.763820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3df37275-5b6f-4c77-8823-d8016b417634 req-eff93c54-f7c9-44ab-aa67-c1894f253c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:48.765287 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:48.765287 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:35:48.772780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3df37275-5b6f-4c77-8823-d8016b417634 req-eff93c54-f7c9-44ab-aa67-c1894f253c43 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:48.773226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3df37275-5b6f-4c77-8823-d8016b417634 req-eff93c54-f7c9-44ab-aa67-c1894f253c43 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:48.785099 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3df37275-5b6f-4c77-8823-d8016b417634 req-eff93c54-f7c9-44ab-aa67-c1894f253c43 service nova] Creating event network-changed:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch2-master-1 Feb 12 21:35:48.789903 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3df37275-5b6f-4c77-8823-d8016b417634 req-eff93c54-f7c9-44ab-aa67-c1894f253c43 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199256 Feb 12 21:35:48.790544 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2845/5826] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:35:48.933241 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5792e01a-380d-4ed8-a2cb-0d2894c19abb tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 204 len: 0 microversion: 2.1 time: 0.344192 Feb 12 21:35:48.934028 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2982/5827] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:35:48 2022] DELETE /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:35:48.946181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:48.947683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:48.956876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:48.957664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:48.958784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:48.959955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:49.184333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:49.194108 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c5ed0fd-fb28-4b43-ae1a-48ae67e70296 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1689 microversion: 2.1 time: 0.254429 Feb 12 21:35:49.194785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2846/5828] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:48 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1689 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:35:49.995355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3b84fb2a-2233-43b8-817c-bfacb0314e93 req-ac4b8083-f4bf-488e-8cae-9ca301790586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f72d15d9-f2cd-4a89-bff2-6a01c79d446f", "name": "network-vif-deleted", "tag": "6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:49.996917 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:35:49.996917 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:35:50.006091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3b84fb2a-2233-43b8-817c-bfacb0314e93 req-ac4b8083-f4bf-488e-8cae-9ca301790586 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:50.006495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3b84fb2a-2233-43b8-817c-bfacb0314e93 req-ac4b8083-f4bf-488e-8cae-9ca301790586 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:50.017956 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3b84fb2a-2233-43b8-817c-bfacb0314e93 req-ac4b8083-f4bf-488e-8cae-9ca301790586 service nova] Creating event network-vif-deleted:6a8dd1ec-a3c4-46f7-94be-d2d1537bbd7d for instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f on nch2-master-1 Feb 12 21:35:50.022978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3b84fb2a-2233-43b8-817c-bfacb0314e93 req-ac4b8083-f4bf-488e-8cae-9ca301790586 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031675 Feb 12 21:35:50.023571 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2983/5829] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:35:50.212202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:50.212872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:50.222036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:50.222578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:50.223389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:50.223825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:50.289204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:35:50.299014 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e29b5c9-d2b3-433e-ace5-2e39a4e338aa tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 200 len: 1352 microversion: 2.1 time: 0.090122 Feb 12 21:35:50.299615 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2847/5830] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:50 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:35:51.321757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:51.322535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: f72d15d9-f2cd-4a89-bff2-6a01c79d446f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:35:51.329606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:51.330077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:51.330995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:35:51.331447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:35:51.344483 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] HTTP exception thrown: Instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f could not be found. Feb 12 21:35:51.345090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Returning 404 to user: Instance f72d15d9-f2cd-4a89-bff2-6a01c79d446f could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:35:51.346613 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62609143-207c-40a5-a781-c40c5b784a7d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f" status: 404 len: 111 microversion: 2.1 time: 0.034417 Feb 12 21:35:51.354473 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2984/5831] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:35:51 2022] GET /compute/v2.1/servers/f72d15d9-f2cd-4a89-bff2-6a01c79d446f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:35:55.011737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0825c481-6213-48af-9673-5593953bff09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '.version_select at 0x7fa8fd236e50>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:35:55.142759 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0825c481-6213-48af-9673-5593953bff09 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1864177865" status: 202 len: 0 microversion: 2.1 time: 0.134656 Feb 12 21:35:55.143358 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2848/5832] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 21:35:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1864177865 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:35:55.171649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5690403c-21db-415c-9762-97e58d764522 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: .version_select at 0x7fa8fc660700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1397736795"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:35:55.186871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5690403c-21db-415c-9762-97e58d764522 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:35:55.193889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5690403c-21db-415c-9762-97e58d764522 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:35:55.343337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5690403c-21db-415c-9762-97e58d764522 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:35:55.348500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5690403c-21db-415c-9762-97e58d764522 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:35:55.363227 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5690403c-21db-415c-9762-97e58d764522 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.195462 Feb 12 21:35:55.364053 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2985/5833] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:35:55 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:04.080579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-79962835", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "1f8d6081-2135-432e-a78b-a0506974e0cb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1397736795", "security_groups": [{"name": "tempest-secgroup-smoke-729196656"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:04.254120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] validate_networks() for [('1f8d6081-2135-432e-a78b-a0506974e0cb', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:36:04.766837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:36:04.767269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:36:04.767749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:36:04.768164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:36:04.768581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:36:04.779408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:04.779408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:04.779717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:04.780837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:04.801120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:36:04.807197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Getting quotas for user 4e415b4aefbf4e50ba15c2119de39190 and project bc1c557f5d984523b9dbe9c385659448. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:36:04.820576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:36:04.823124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:36:05.027841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a48f665-3b37-4d7e-8cc9-47d9049ca4f7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.951773 Feb 12 21:36:05.029708 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2849/5834] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:36:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:36:05.040553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b080956-8fc6-4428-91c2-1bfbff9ce041 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:05.045091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b080956-8fc6-4428-91c2-1bfbff9ce041 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:05.164696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0b080956-8fc6-4428-91c2-1bfbff9ce041 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:05.174876 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b080956-8fc6-4428-91c2-1bfbff9ce041 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1265 microversion: 2.1 time: 0.138304 Feb 12 21:36:05.181407 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2986/5835] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:05 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:36:06.208237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:06.209013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:06.227463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:06.228791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:06.230044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:06.236972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:06.376321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:06.390760 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0d45135-5aa9-4d62-a375-f0206f79de44 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1269 microversion: 2.1 time: 0.198653 Feb 12 21:36:06.392022 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2850/5836] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:06 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1269 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:07.410411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:07.410994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:07.421599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:07.422099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:07.423340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:07.423810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:07.505933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:07.519309 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-69f18e5b-25ef-4b2c-87b7-76506644c072 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1317 microversion: 2.1 time: 0.113980 Feb 12 21:36:07.520208 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2987/5837] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:07 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1317 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:08.536408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:08.537066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:08.545620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:08.546093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:08.551757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:08.551757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:08.779948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:08.788569 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6d24a807-b355-4d11-bb68-87b9058eb353 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.255985 Feb 12 21:36:08.789162 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2851/5838] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:08 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:09.805886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:09.806518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:09.813935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:09.814398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:09.815247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:09.815700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:09.950001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bc3151d2-6530-4234-80f9-0843fedc3627 req-2692f0ea-e395-4ecb-985f-4773a69a86a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:09.951781 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:36:09.951781 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:36:09.963595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bc3151d2-6530-4234-80f9-0843fedc3627 req-2692f0ea-e395-4ecb-985f-4773a69a86a7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:09.964058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bc3151d2-6530-4234-80f9-0843fedc3627 req-2692f0ea-e395-4ecb-985f-4773a69a86a7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:09.971874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:09.980829 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bc3151d2-6530-4234-80f9-0843fedc3627 req-2692f0ea-e395-4ecb-985f-4773a69a86a7 service nova] Creating event network-changed:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:36:09.986026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bc3151d2-6530-4234-80f9-0843fedc3627 req-2692f0ea-e395-4ecb-985f-4773a69a86a7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039665 Feb 12 21:36:09.987878 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2852/5839] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:36:09.994309 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2c2ee6bb-e05b-4ec9-8bbb-b73734dc67c6 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.193022 Feb 12 21:36:09.994978 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2988/5840] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:09 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:11.012908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:11.013718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:11.020025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:11.020489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:11.021394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:11.021924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:11.174770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:11.184062 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-352a5619-f7be-437f-9443-a8a49b774195 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.176045 Feb 12 21:36:11.186404 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2853/5841] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:11 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:12.200847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:12.201541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:12.208936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:12.221843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:12.221843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:12.221843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:12.376848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:12.385997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4e200a9c-5eea-4187-a092-6dad0cc391e0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.188891 Feb 12 21:36:12.387456 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2989/5842] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:12 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:13.404614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:13.405192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:13.412297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:13.412751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:13.413702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:13.414263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:13.549934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:13.557585 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92707896-22ca-4639-a153-351c770e107e tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.156940 Feb 12 21:36:13.558164 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2854/5843] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:13 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:14.523564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-19dc081c-f0f8-45f3-8a5e-4bcf5c71cf4c req-7108d200-d0b3-4582-b2ba-9ff7a7dcc00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "name": "network-vif-plugged", "status": "completed", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:14.525966 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:36:14.525966 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:36:14.533801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-19dc081c-f0f8-45f3-8a5e-4bcf5c71cf4c req-7108d200-d0b3-4582-b2ba-9ff7a7dcc00e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:14.535567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-19dc081c-f0f8-45f3-8a5e-4bcf5c71cf4c req-7108d200-d0b3-4582-b2ba-9ff7a7dcc00e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:14.545502 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-19dc081c-f0f8-45f3-8a5e-4bcf5c71cf4c req-7108d200-d0b3-4582-b2ba-9ff7a7dcc00e service nova] Creating event network-vif-plugged:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:36:14.550371 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-19dc081c-f0f8-45f3-8a5e-4bcf5c71cf4c req-7108d200-d0b3-4582-b2ba-9ff7a7dcc00e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030569 Feb 12 21:36:14.550955 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2990/5844] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:36:14.574555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:14.575233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:14.582455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:14.583223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:14.585238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:14.585895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:14.794229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:14.802138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-39286ea8-f359-48c3-b1c5-8b2b1bc3720d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.231629 Feb 12 21:36:14.803047 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2855/5845] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:14 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:15.828107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:15.828742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:15.835165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:15.835648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:15.837235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:15.837726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:15.989911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:15.998859 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c73e929a-abd3-4d0d-b413-863d4dff1ec0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1390 microversion: 2.1 time: 0.175833 Feb 12 21:36:15.999445 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2991/5846] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:15 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:17.016382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:17.017140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:17.023603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:17.024055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:17.024863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:17.025302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:17.166372 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:17.173813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-faa11e42-89f2-4a91-9e78-da44cb41c31b tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1563 microversion: 2.1 time: 0.161375 Feb 12 21:36:17.174378 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2856/5847] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:17 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:17.190163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:17.190782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:17.197749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:17.198218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:17.199014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:17.199492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:17.337799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:17.345103 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3078a05-6191-4a21-86f1-39b2519c1eda tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1563 microversion: 2.1 time: 0.158606 Feb 12 21:36:17.345714 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2992/5848] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:17 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:19.440562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:19.441271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:19.443255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9f562523-316c-45b1-bc08-4c3799ef948d req-0d4cb3a0-1830-401e-9b17-ac7ce9c4f8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:19.444827 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:36:19.444827 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:36:19.449028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:19.449661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:19.450515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:19.451178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:19.453545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9f562523-316c-45b1-bc08-4c3799ef948d req-0d4cb3a0-1830-401e-9b17-ac7ce9c4f8fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:19.454019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9f562523-316c-45b1-bc08-4c3799ef948d req-0d4cb3a0-1830-401e-9b17-ac7ce9c4f8fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:19.466001 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9f562523-316c-45b1-bc08-4c3799ef948d req-0d4cb3a0-1830-401e-9b17-ac7ce9c4f8fe service nova] Creating event network-changed:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:36:19.471027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9f562523-316c-45b1-bc08-4c3799ef948d req-0d4cb3a0-1830-401e-9b17-ac7ce9c4f8fe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Feb 12 21:36:19.471832 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2993/5849] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:36:19.719847 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:19.727875 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e7fa1965-db8a-498b-be0d-350b30c4abb3 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1563 microversion: 2.1 time: 0.291768 Feb 12 21:36:19.729420 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2857/5850] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:19 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1563 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:32.234274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60681e82-57dc-42e2-81c6-70e5d833b9de tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Action: 'create', calling method: .version_select at 0x7fa8fc612550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-357486827"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:32.243816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-60681e82-57dc-42e2-81c6-70e5d833b9de tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for project 14346d52af354b338f2253bc2f551829. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:36:32.248803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-60681e82-57dc-42e2-81c6-70e5d833b9de tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for user 51a6c5cb1c114c76a50eb68a2842c30d and project 14346d52af354b338f2253bc2f551829. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:36:32.663817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-60681e82-57dc-42e2-81c6-70e5d833b9de tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for project 14346d52af354b338f2253bc2f551829. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:36:32.669451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-60681e82-57dc-42e2-81c6-70e5d833b9de tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for user 51a6c5cb1c114c76a50eb68a2842c30d and project 14346d52af354b338f2253bc2f551829. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:36:32.684251 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60681e82-57dc-42e2-81c6-70e5d833b9de tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.624676 Feb 12 21:36:32.684849 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2994/5851] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:36:32 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:40.985070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1885361674-access_point-1087858710", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "3ce3f2c7-8999-4ea4-8e18-a9e610cff662"}], "key_name": "tempest-TestSecurityGroupsBasicOps-357486827", "security_groups": [{"name": "tempest-secgroup_access--715975448"}, {"name": "tempest-secgroup_general--1149998493"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:41.196332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] validate_networks() for [('3ce3f2c7-8999-4ea4-8e18-a9e610cff662', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:36:41.644953 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:36:41.645555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:36:41.646260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:36:41.646862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:36:41.647453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:36:41.659024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:41.659720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:41.660556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:41.661054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:41.679947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for project 14346d52af354b338f2253bc2f551829. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:36:41.685994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for user 51a6c5cb1c114c76a50eb68a2842c30d and project 14346d52af354b338f2253bc2f551829. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:36:41.700280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:36:41.702291 ncdv-master-1 devstack@n-api.service[141726]: WARNING nova.utils [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1885361674-access_point-1087858710 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1885361674-ac Feb 12 21:36:41.702998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:36:41.823307 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2228e59-eae7-4ad2-b560-a2ee1c4ca204 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.839466 Feb 12 21:36:41.823307 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2858/5852] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:36:40 2022] POST /compute/v2.1/servers => generated 457 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:36:41.832490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0028ce72-46ce-4c1a-9d06-e3fe40b77833 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:41.833855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0028ce72-46ce-4c1a-9d06-e3fe40b77833 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:41.897630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0028ce72-46ce-4c1a-9d06-e3fe40b77833 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:41.905767 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0028ce72-46ce-4c1a-9d06-e3fe40b77833 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1294 microversion: 2.1 time: 0.076305 Feb 12 21:36:41.913631 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2995/5853] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:41 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:42.924462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0656dae7-0ab7-44d8-981a-889808ea535d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:42.925086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0656dae7-0ab7-44d8-981a-889808ea535d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:42.978162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0656dae7-0ab7-44d8-981a-889808ea535d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:42.986185 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0656dae7-0ab7-44d8-981a-889808ea535d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1294 microversion: 2.1 time: 0.066566 Feb 12 21:36:42.986748 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2859/5854] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:42 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1294 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:43.033990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:43.035000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:43.046820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:43.047446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:43.052878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:43.052878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:43.107579 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e2eae230-0d2a-43c4-a033-9f3cfb4b6b19 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c/action" status: 200 len: 24566 microversion: 2.1 time: 0.077418 Feb 12 21:36:43.108341 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2996/5855] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:36:43 2022] POST /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c/action => generated 24566 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:36:44.002908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:44.003524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:44.014167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:44.014167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:44.014167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:44.014167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:44.075755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:44.083773 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3d546c6-d1aa-4bee-aa0a-ebd94bc68ced tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1346 microversion: 2.1 time: 0.084571 Feb 12 21:36:44.084387 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2860/5856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:43 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:45.100686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:45.101637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:45.110698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:45.118270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:45.118270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:45.118270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:45.277518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:45.286061 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98865673-f562-4597-ab39-22ab98834fae tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.189673 Feb 12 21:36:45.286992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2997/5857] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:45 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:45.992496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5e1084ba-a299-47c1-8b49-87edb63378c0 req-4abde06e-0853-41e5-9aa7-1e6f5804eaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2006c1c-0a08-4819-98d4-04c6365e67d8", "tag": "1071f810-ea07-4bba-9529-5d21596a9119"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:45.995713 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:36:45.995713 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:36:46.005072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5e1084ba-a299-47c1-8b49-87edb63378c0 req-4abde06e-0853-41e5-9aa7-1e6f5804eaa4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:46.005571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5e1084ba-a299-47c1-8b49-87edb63378c0 req-4abde06e-0853-41e5-9aa7-1e6f5804eaa4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:46.018594 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5e1084ba-a299-47c1-8b49-87edb63378c0 req-4abde06e-0853-41e5-9aa7-1e6f5804eaa4 service nova] Creating event network-changed:1071f810-ea07-4bba-9529-5d21596a9119 for instance a2006c1c-0a08-4819-98d4-04c6365e67d8 on nch2-master-1 Feb 12 21:36:46.023547 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5e1084ba-a299-47c1-8b49-87edb63378c0 req-4abde06e-0853-41e5-9aa7-1e6f5804eaa4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034790 Feb 12 21:36:46.024826 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2861/5858] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:36:46.304303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:46.304971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:46.324944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:46.327344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:46.328390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:46.329173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:46.499017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:46.506606 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e1c8cd2d-31e0-452b-86ed-9010d0d5bf5a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.206644 Feb 12 21:36:46.507176 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2998/5859] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:46 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:47.524987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:47.525638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:47.532328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:47.532780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:47.533602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:47.534051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:47.687232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:47.694682 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-300ce2d5-638b-4352-8127-8a009950d0ea tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.174676 Feb 12 21:36:47.695266 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2862/5860] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:47 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:48.712040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:48.712622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:48.720340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:48.721567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:48.721693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:48.722105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:48.865493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:48.874065 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b11b4a5b-65f7-49ed-ac66-3ba79b52700f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.165872 Feb 12 21:36:48.874641 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 2999/5861] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:48 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:36:49.891726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:49.892329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:49.899205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:49.899658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:49.900469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:49.900903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:50.044744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:50.052244 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a446a7e2-61ff-458c-a761-8cbf243d2612 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.164402 Feb 12 21:36:50.052818 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2863/5862] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:49 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:51.069259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:51.069960 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:51.077066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:51.077588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:51.078416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:51.078903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:51.223878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:51.231382 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2c5edea3-ff76-4903-9051-60545a346d4d tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.165876 Feb 12 21:36:51.232525 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3000/5863] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:51 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:52.248496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:52.249104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:52.255960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:52.259737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:52.259737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:52.259737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:52.407574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:52.415026 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccfd167d-82ae-4b30-953c-f86ab2e220cd tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.170680 Feb 12 21:36:52.415596 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2864/5864] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:52 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:52.592840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-8c737c1b-afa3-478f-98ad-9339490c13e1 req-789b2eb1-6152-4301-873f-bbc5db731692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2006c1c-0a08-4819-98d4-04c6365e67d8", "name": "network-vif-plugged", "status": "completed", "tag": "1071f810-ea07-4bba-9529-5d21596a9119"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:52.594450 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:36:52.594450 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:36:52.602323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8c737c1b-afa3-478f-98ad-9339490c13e1 req-789b2eb1-6152-4301-873f-bbc5db731692 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:52.602788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-8c737c1b-afa3-478f-98ad-9339490c13e1 req-789b2eb1-6152-4301-873f-bbc5db731692 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:52.614053 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-8c737c1b-afa3-478f-98ad-9339490c13e1 req-789b2eb1-6152-4301-873f-bbc5db731692 service nova] Creating event network-vif-plugged:1071f810-ea07-4bba-9529-5d21596a9119 for instance a2006c1c-0a08-4819-98d4-04c6365e67d8 on nch2-master-1 Feb 12 21:36:52.619092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-8c737c1b-afa3-478f-98ad-9339490c13e1 req-789b2eb1-6152-4301-873f-bbc5db731692 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 Feb 12 21:36:52.619666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3001/5865] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:36:53.431473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:53.432083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:53.439190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:53.439641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:53.440423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:53.440859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:53.768965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:53.776469 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe68a3aa-4cdc-4a81-ba63-6314745a1c80 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1471 microversion: 2.1 time: 0.348768 Feb 12 21:36:53.777042 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2865/5866] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:53 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:54.260350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:54.261837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:54.268198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.268672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.269501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.272467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.346329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:36:54.346775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:36:54.347271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:36:54.347702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:36:54.348133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:36:54.574965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:54.583085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.583706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.584543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.585003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.614231 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-186c7b94-46d4-48aa-a72e-b317d85b3bc2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c/action" status: 202 len: 1137 microversion: 2.1 time: 0.358979 Feb 12 21:36:54.614893 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3002/5867] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:36:54 2022] POST /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c/action => generated 1137 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 12 21:36:54.628862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:54.629673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:54.636704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.637165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.639466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.639466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.787230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:54.793495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:54.794149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:54.795647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c24a7e96-5457-453a-8bb7-4ccea84a0310 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.169939 Feb 12 21:36:54.796249 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2866/5868] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:54 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:54.801022 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.801530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.802337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.802789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.952309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:54.959915 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d84045bf-019a-4cbd-bf7b-9f84abe22f23 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1643 microversion: 2.1 time: 0.170193 Feb 12 21:36:54.960466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3003/5869] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:54 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1643 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:36:54.976040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:54.976879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:54.984080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.986482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:54.986787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:54.987228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:55.142154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:55.149653 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1925ec7f-c125-4445-8d05-9da227b97dc4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1643 microversion: 2.1 time: 0.177225 Feb 12 21:36:55.150232 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2867/5870] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:54 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1643 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:55.166667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:55.167291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:55.173238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:55.173761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:55.174557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:55.175007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:55.580806 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a53d60bc-ff3b-48bf-9de9-8d10f8561850 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1794 microversion: 2.1 time: 0.417653 Feb 12 21:36:55.581446 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3004/5871] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:55 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1794 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:55.813511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:55.814163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:55.820356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:55.820808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:55.821620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:55.822059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:55.970803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:55.978374 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28762746-6f1d-4400-ab6b-6a42a937701c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.169211 Feb 12 21:36:55.978961 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2868/5872] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:55 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:56.995763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:56.996385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:57.012477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:57.012477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:57.012477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:57.012477 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:57.308182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:57.318094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fe9437f-0859-4478-848e-f8cf73e38b1c tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.324523 Feb 12 21:36:57.318094 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3005/5873] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:56 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:57.815018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-00316680-e99a-4ef0-a0a9-2cbdd1a5c590 req-ebf01612-4a37-4bad-add3-f1e23847445d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2006c1c-0a08-4819-98d4-04c6365e67d8", "tag": "1071f810-ea07-4bba-9529-5d21596a9119"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:36:57.818923 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:36:57.818923 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:36:57.824637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-00316680-e99a-4ef0-a0a9-2cbdd1a5c590 req-ebf01612-4a37-4bad-add3-f1e23847445d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:57.825211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-00316680-e99a-4ef0-a0a9-2cbdd1a5c590 req-ebf01612-4a37-4bad-add3-f1e23847445d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:57.836908 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-00316680-e99a-4ef0-a0a9-2cbdd1a5c590 req-ebf01612-4a37-4bad-add3-f1e23847445d service nova] Creating event network-changed:1071f810-ea07-4bba-9529-5d21596a9119 for instance a2006c1c-0a08-4819-98d4-04c6365e67d8 on nch2-master-1 Feb 12 21:36:57.842983 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-00316680-e99a-4ef0-a0a9-2cbdd1a5c590 req-ebf01612-4a37-4bad-add3-f1e23847445d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031963 Feb 12 21:36:57.843766 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2869/5874] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:36:58.334673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:58.335911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:58.347355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:58.348443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:58.350328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:58.350790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:58.949266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:36:58.963291 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba17f880-26a6-4478-91e0-6ea6a0f465f0 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.628762 Feb 12 21:36:58.963291 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3006/5875] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:58 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:36:59.979094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:36:59.980066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:36:59.986480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:59.986933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:36:59.987715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:36:59.988152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:00.126816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:00.134308 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-533b6924-7793-499c-a46d-d1965efcaa18 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.161988 Feb 12 21:37:00.134879 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2870/5876] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:36:59 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:01.152005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:01.152630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:01.160300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:01.160770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:01.165774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:01.166240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:01.302050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:01.309856 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dae47e8d-5629-47fe-9cdc-8ca733c3f07a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.161711 Feb 12 21:37:01.310437 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3007/5877] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:01 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:02.327688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:02.328368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:02.335267 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:02.335715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:02.336496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:02.336930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:02.800016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:02.807449 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e745170b-eff8-4e85-8ff9-0db1184743f2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.483580 Feb 12 21:37:02.808021 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2871/5878] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:02 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:03.824340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:03.825076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:03.832520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:03.833069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:03.834040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:03.834562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:03.975796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:03.983402 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0c3306c1-c8b5-4cab-94e8-0444909529c7 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.163004 Feb 12 21:37:03.983988 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3008/5879] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:03 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:05.000824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:05.001345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:05.008989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:05.009478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:05.010268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:05.010704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:05.147999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:05.155525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51657fd1-d51c-4332-8147-d18d469e921d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.158444 Feb 12 21:37:05.156097 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2872/5880] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:04 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:06.174361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:06.174986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:06.182349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:06.182825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:06.183665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:06.184124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:06.330375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:06.338577 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d9e9d2c4-0f08-4701-9cf4-201555d924ae tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.167487 Feb 12 21:37:06.338577 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3009/5881] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:06 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:37:07.356850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:07.357517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:07.365090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:07.365582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:07.366376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:07.366817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:07.506185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:07.513629 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9d80851d-7992-4643-aa74-b0f56f85d541 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.160488 Feb 12 21:37:07.514206 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2873/5882] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:07 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:08.530540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:08.531170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:08.539485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:08.539959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:08.540765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:08.541230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:08.680857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:08.688439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88d844f5-f2f2-4ee8-8c0b-d29285bd3853 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.161629 Feb 12 21:37:08.689023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3010/5883] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:08 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:09.705692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:09.706301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:09.714103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:09.714555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:09.715384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:09.715823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:09.859808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:09.865981 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8da2fd50-1744-4726-885f-07a0455150ab tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.164002 Feb 12 21:37:09.866646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2874/5884] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:09 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:10.297222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:10.298318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:10.299071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-75ff48c3-50b3-4a95-b9e6-ea8c579752b3 req-3b11dd7b-e586-4653-81fe-863ab4ff9f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:10.300715 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:10.300715 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:37:10.306821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.307569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.308593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.308812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-75ff48c3-50b3-4a95-b9e6-ea8c579752b3 req-3b11dd7b-e586-4653-81fe-863ab4ff9f24 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.309224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-75ff48c3-50b3-4a95-b9e6-ea8c579752b3 req-3b11dd7b-e586-4653-81fe-863ab4ff9f24 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.309601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.323994 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-75ff48c3-50b3-4a95-b9e6-ea8c579752b3 req-3b11dd7b-e586-4653-81fe-863ab4ff9f24 service nova] Creating event network-changed:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:37:10.329470 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-75ff48c3-50b3-4a95-b9e6-ea8c579752b3 req-3b11dd7b-e586-4653-81fe-863ab4ff9f24 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034746 Feb 12 21:37:10.330479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2875/5885] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:37:10.359905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:37:10.675174 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ccb618c3-b424-411b-8430-47b108900ddb tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "DELETE /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 204 len: 0 microversion: 2.1 time: 0.381246 Feb 12 21:37:10.678113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3011/5886] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:37:10 2022] DELETE /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:37:10.685196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:10.686228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:10.693086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.693571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.694382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.694820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.884473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:10.885197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:10.891568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.892665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.893146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:10.893638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:10.941416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:10.961875 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-321c430d-8048-47f2-8f34-d03890bccb6c tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1582 microversion: 2.1 time: 0.280769 Feb 12 21:37:10.976374 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2876/5887] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:10 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1582 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:11.054957 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:11.062785 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a364e56-ce88-4cb5-a15b-7c16ff67fce5 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.183134 Feb 12 21:37:11.064158 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3012/5888] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:10 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:37:11.981816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:11.982338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:11.989062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:11.990159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:11.990958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:11.991393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:12.081505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:12.081505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:12.088171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:12.088864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:12.090043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:12.090584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:12.152621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:12.161488 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4eb923af-2cd3-4d86-a09f-bd3f01224c82 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1463 microversion: 2.1 time: 0.182797 Feb 12 21:37:12.162089 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2877/5889] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:11 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:12.249670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:12.258513 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f36a77b-1d5d-431a-be21-e2e210cd2563 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1691 microversion: 2.1 time: 0.182118 Feb 12 21:37:12.268179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3013/5890] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:12 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:12.825314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-fb96e022-55fd-43fd-90e6-7e4cfb93b973 req-d2e3d56f-0e0e-475c-9d93-74b6213ad479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb01e7f8-583c-4169-ac0e-1df6dc3a0b08", "name": "network-vif-deleted", "tag": "76381534-1480-4f0e-bbfa-edab76f98e64"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:12.831503 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:12.831503 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:37:12.841389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fb96e022-55fd-43fd-90e6-7e4cfb93b973 req-d2e3d56f-0e0e-475c-9d93-74b6213ad479 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:12.841857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fb96e022-55fd-43fd-90e6-7e4cfb93b973 req-d2e3d56f-0e0e-475c-9d93-74b6213ad479 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:12.854993 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-fb96e022-55fd-43fd-90e6-7e4cfb93b973 req-d2e3d56f-0e0e-475c-9d93-74b6213ad479 service nova] Creating event network-vif-deleted:76381534-1480-4f0e-bbfa-edab76f98e64 for instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 on nch2-master-1 Feb 12 21:37:12.863540 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-fb96e022-55fd-43fd-90e6-7e4cfb93b973 req-d2e3d56f-0e0e-475c-9d93-74b6213ad479 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041985 Feb 12 21:37:12.864764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2878/5891] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:37:13.180307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:13.180968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:13.188102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:13.188569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:13.189398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:13.189858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:13.278214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:13.279051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:13.286044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:13.286868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:13.287820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:13.288341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:13.376928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1a01a1f86a4f4ca3997db04ed1b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfcb9d238a52483a94553e900468a87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:13.384272 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a5ef55f-5c88-4e60-913b-52e288e97cf1 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 200 len: 1228 microversion: 2.1 time: 0.208574 Feb 12 21:37:13.384868 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3014/5892] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:13 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 1228 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:13.447794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:13.455412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54c35f92-f1a4-479c-b67c-c8cc1f8e6d64 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1697 microversion: 2.1 time: 0.183212 Feb 12 21:37:13.455986 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2879/5893] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:13 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:37:14.401713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:14.402340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] [instance: cb01e7f8-583c-4169-ac0e-1df6dc3a0b08] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:14.409485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:14.409959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:14.410776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:14.411329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:14.426941 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] HTTP exception thrown: Instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 could not be found. Feb 12 21:37:14.427559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Returning 404 to user: Instance cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:37:14.428405 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0388832d-0b71-49c4-a80c-e7fb540db3b2 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08" status: 404 len: 111 microversion: 2.1 time: 0.030442 Feb 12 21:37:14.428956 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3015/5894] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:14 2022] GET /compute/v2.1/servers/cb01e7f8-583c-4169-ac0e-1df6dc3a0b08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:37:14.478376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:14.479101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:14.485792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:14.486294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:14.487366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:14.487926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:14.671004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:14.686637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0c725715-bfb5-45a9-99ef-31440bf69256 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] Calling method '.version_select at 0x7fa8fd7835e0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:14.699286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb1a38e0-3e75-4c90-9fc7-5216034f2078 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1697 microversion: 2.1 time: 0.225682 Feb 12 21:37:14.700701 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2880/5895] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:14 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1697 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:14.715217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-71ccb90b-4d03-459c-be50-4589e8422318 req-8438ea3d-77f7-4c0a-be0e-ff600f1caa59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "name": "network-vif-unplugged", "status": "completed", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:14.717036 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:14.717036 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:37:14.724194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-71ccb90b-4d03-459c-be50-4589e8422318 req-8438ea3d-77f7-4c0a-be0e-ff600f1caa59 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:14.724740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-71ccb90b-4d03-459c-be50-4589e8422318 req-8438ea3d-77f7-4c0a-be0e-ff600f1caa59 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:14.736582 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-71ccb90b-4d03-459c-be50-4589e8422318 req-8438ea3d-77f7-4c0a-be0e-ff600f1caa59 service nova] Creating event network-vif-unplugged:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:37:14.742368 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-71ccb90b-4d03-459c-be50-4589e8422318 req-8438ea3d-77f7-4c0a-be0e-ff600f1caa59 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031032 Feb 12 21:37:14.742988 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2881/5896] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:37:14.776382 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0c725715-bfb5-45a9-99ef-31440bf69256 tempest-TestVolumeBackupRestore-1020972158 tempest-TestVolumeBackupRestore-1020972158-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1173202455" status: 202 len: 0 microversion: 2.1 time: 0.094647 Feb 12 21:37:14.777030 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3016/5897] 10.222.0.31 () {58 vars in 1268 bytes} [Sat Feb 12 21:37:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1173202455 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:37:15.718462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:15.719173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:15.725585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:15.726042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:15.726840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:15.727288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:15.867392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:15.874866 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-07ef133a-7263-4f5e-89d3-24b2ae886f63 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1682 microversion: 2.1 time: 0.161400 Feb 12 21:37:15.877949 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2882/5898] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:15 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:18.779294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-39231244-7e9a-4d11-b683-05727c084d98 req-5574c7ab-abb7-4548-99e0-16cf01b2e2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "name": "network-vif-plugged", "status": "completed", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:18.780874 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:18.780874 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:37:18.789472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-39231244-7e9a-4d11-b683-05727c084d98 req-5574c7ab-abb7-4548-99e0-16cf01b2e2cf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:18.789940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-39231244-7e9a-4d11-b683-05727c084d98 req-5574c7ab-abb7-4548-99e0-16cf01b2e2cf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:18.800466 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-39231244-7e9a-4d11-b683-05727c084d98 req-5574c7ab-abb7-4548-99e0-16cf01b2e2cf service nova] Creating event network-vif-plugged:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:37:18.805967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-39231244-7e9a-4d11-b683-05727c084d98 req-5574c7ab-abb7-4548-99e0-16cf01b2e2cf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Feb 12 21:37:18.806818 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3017/5899] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:37:39.043496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1187501107", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "45b23358-0e2e-4652-9d55-5e640b52bbda"}], "key_name": "tempest-TestSecurityGroupsBasicOps-357486827", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a2006c1c-0a08-4819-98d4-04c6365e67d8"]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:39.138269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] validate_networks() for [('45b23358-0e2e-4652-9d55-5e640b52bbda', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:37:39.903042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:37:39.903978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:37:39.906812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:37:39.907654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:37:39.908196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:37:39.920834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:39.921717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:39.922822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:39.923759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:39.951393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for project 14346d52af354b338f2253bc2f551829. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:37:39.960035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Getting quotas for user 51a6c5cb1c114c76a50eb68a2842c30d and project 14346d52af354b338f2253bc2f551829. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:37:39.974502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:37:39.977201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:37:40.189565 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-75085482-c21b-4982-b01e-534cd075dd14 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.150142 Feb 12 21:37:40.192526 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2883/5900] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:37:39 2022] POST /compute/v2.1/servers => generated 361 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:37:40.208049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d51e4c41-1d16-4b13-9ac1-f6701501047a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:40.208808 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d51e4c41-1d16-4b13-9ac1-f6701501047a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:40.341806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d51e4c41-1d16-4b13-9ac1-f6701501047a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:40.351517 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d51e4c41-1d16-4b13-9ac1-f6701501047a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1241 microversion: 2.1 time: 0.152929 Feb 12 21:37:40.367268 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3018/5901] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:40 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:41.373646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:41.374917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:41.383180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:41.384056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:41.385087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:41.385744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:41.473090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:41.484844 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cccbb735-3e24-4f71-9225-dcc75599a984 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1245 microversion: 2.1 time: 0.117346 Feb 12 21:37:41.485797 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2884/5902] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:41 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:42.078448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:42.080306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:42.088436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:42.088904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:42.090460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:42.090911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:42.158450 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce86a8a1-8b6f-477f-99d6-af41c334996d tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "POST /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c/action" status: 200 len: 24540 microversion: 2.1 time: 0.081950 Feb 12 21:37:42.159817 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3019/5903] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:37:42 2022] POST /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c/action => generated 24540 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:37:42.503380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:42.508595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:42.513789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:42.514739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:42.515992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:42.516666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:42.658066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:42.675512 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80d74b16-e24a-4a18-8ac7-6ede9ee25cb2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1293 microversion: 2.1 time: 0.176500 Feb 12 21:37:42.678203 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2885/5904] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:42 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1293 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:43.696603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:43.698063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:43.722796 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:43.723458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:43.724368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:43.727122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:43.867686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:43.877910 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-87a841b3-3205-4e57-9d41-2b02cd851242 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.185827 Feb 12 21:37:43.879121 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3020/5905] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:43 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:44.895930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:44.896540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:44.905258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:44.905738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:44.912993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:44.913742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:45.023575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:45.032161 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e436b327-df62-4c90-aaa6-fb4a4be32d6a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.139955 Feb 12 21:37:45.033008 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2886/5906] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:44 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:45.100854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7d6cd5f5-c6f6-4e49-a4a6-82149deafb28 req-94a8b02f-e6cf-4837-8189-44170e197682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a1b1a0-75e3-4a79-8969-d13ddf83631d", "tag": "217ebd50-2b7e-4502-aa60-71615cb92ddd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:45.104013 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:45.104013 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:37:45.115055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7d6cd5f5-c6f6-4e49-a4a6-82149deafb28 req-94a8b02f-e6cf-4837-8189-44170e197682 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:45.115841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7d6cd5f5-c6f6-4e49-a4a6-82149deafb28 req-94a8b02f-e6cf-4837-8189-44170e197682 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:45.154510 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7d6cd5f5-c6f6-4e49-a4a6-82149deafb28 req-94a8b02f-e6cf-4837-8189-44170e197682 service nova] Creating event network-changed:217ebd50-2b7e-4502-aa60-71615cb92ddd for instance 27a1b1a0-75e3-4a79-8969-d13ddf83631d on nch1-master-1 Feb 12 21:37:45.161420 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7d6cd5f5-c6f6-4e49-a4a6-82149deafb28 req-94a8b02f-e6cf-4837-8189-44170e197682 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064553 Feb 12 21:37:45.162594 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3021/5907] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:37:46.049272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:46.049911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:46.057042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:46.057556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:46.058400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:46.058838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:46.163833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:46.172775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90befe5b-39dc-4e8d-a595-f44fa6876d65 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.127189 Feb 12 21:37:46.173591 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2887/5908] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:46 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:47.190978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:47.191693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:47.199325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:47.200027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:47.200835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:47.201287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:47.291708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:47.299362 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bef5efd2-fd93-4e33-8e68-f3f27342f603 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.113059 Feb 12 21:37:47.299928 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3022/5909] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:47 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:48.316475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:48.316844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:48.323736 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:48.324413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:48.325218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:48.325685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:48.414328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:48.422559 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fff24031-61aa-4f6e-b445-fe4b5ec920b2 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.110427 Feb 12 21:37:48.423129 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2888/5910] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:48 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:49.440387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:49.441006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:49.447977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:49.452281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:49.452281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:49.452281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:49.542139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:49.550295 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93a63dba-6a5e-4d29-aa49-680114bac18a tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.113727 Feb 12 21:37:49.550874 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3023/5911] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:49 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:50.567822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:50.568410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:50.575386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:50.575842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:50.576645 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:50.577137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:50.670391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:50.678158 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-69ba5a1f-3952-425d-acf8-176ecd20efc5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.114261 Feb 12 21:37:50.678740 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2889/5912] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:50 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:50.990278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f5c81cb9-7492-41ed-adc3-e7fb1e090883 req-641184ce-4182-4811-ab4f-f6634f7682e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a1b1a0-75e3-4a79-8969-d13ddf83631d", "name": "network-vif-plugged", "status": "completed", "tag": "217ebd50-2b7e-4502-aa60-71615cb92ddd"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:50.991949 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:50.991949 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:37:51.000024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f5c81cb9-7492-41ed-adc3-e7fb1e090883 req-641184ce-4182-4811-ab4f-f6634f7682e0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:51.000484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f5c81cb9-7492-41ed-adc3-e7fb1e090883 req-641184ce-4182-4811-ab4f-f6634f7682e0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:51.012298 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f5c81cb9-7492-41ed-adc3-e7fb1e090883 req-641184ce-4182-4811-ab4f-f6634f7682e0 service nova] Creating event network-vif-plugged:217ebd50-2b7e-4502-aa60-71615cb92ddd for instance 27a1b1a0-75e3-4a79-8969-d13ddf83631d on nch1-master-1 Feb 12 21:37:51.017642 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f5c81cb9-7492-41ed-adc3-e7fb1e090883 req-641184ce-4182-4811-ab4f-f6634f7682e0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031003 Feb 12 21:37:51.018239 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3024/5913] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:37:51.694879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:51.695516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:51.702855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:51.703357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:51.704211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:51.704641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:51.794223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:51.801830 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e896418-b027-4e8f-98e2-8252a05a22fe tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1299 microversion: 2.1 time: 0.110624 Feb 12 21:37:51.802399 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2890/5914] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:51 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:52.820661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:52.821340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:52.828278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:52.828760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:52.829610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:52.830072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:52.921856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:52.929421 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a78b7f2-f543-4231-98d4-0a8f4f1f44d4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1471 microversion: 2.1 time: 0.113738 Feb 12 21:37:52.930010 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3025/5915] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:52 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:52.945819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:52.946465 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:52.954027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:52.954486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:52.955271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:52.955712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.042747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:53.050206 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c3f581d-8d47-4760-8bd0-5b5cf3f02536 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1471 microversion: 2.1 time: 0.108062 Feb 12 21:37:53.050777 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2891/5916] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:52 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1471 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:53.065823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:53.066453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:53.079131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.079131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.079131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.079131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.161322 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-382c8e90-d23c-4e15-a38e-69bd8fe47893 tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1622 microversion: 2.1 time: 0.099257 Feb 12 21:37:53.161921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3026/5917] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:53 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1622 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:53.178079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:53.178687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:53.185388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.185832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.186611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.187045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.449689 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7b21305a-1e16-4900-9001-cea491f641fb tempest-TestSecurityGroupsBasicOps-1031848137 tempest-TestSecurityGroupsBasicOps-1031848137-project-admin] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1913 microversion: 2.1 time: 0.274287 Feb 12 21:37:53.449920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2892/5918] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:53 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1913 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:53.514585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:53.515108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:53.521139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.521651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.522471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.522941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.549915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:37:53.858152 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-66dbdecf-cc1c-4422-9633-a6a2af6500b4 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "DELETE /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 204 len: 0 microversion: 2.1 time: 0.346911 Feb 12 21:37:53.858774 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3027/5919] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:37:53 2022] DELETE /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:37:53.866520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:53.867201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:53.873452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.873914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:53.874717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:53.875159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:54.024449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:54.033091 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c63af1cc-32ba-4478-8552-41292ee54b4f tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1477 microversion: 2.1 time: 0.169924 Feb 12 21:37:54.033708 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2893/5920] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:53 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1477 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:54.296887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:54.297530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:54.298731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-733e45c7-65b9-4580-8467-b6fbda1d3c09 req-628ff390-804d-4719-9b03-5d1b37194815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:54.300302 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:54.300302 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:37:54.303915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:54.304394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:54.305209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:54.305705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:54.307519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-733e45c7-65b9-4580-8467-b6fbda1d3c09 req-628ff390-804d-4719-9b03-5d1b37194815 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:54.308877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-733e45c7-65b9-4580-8467-b6fbda1d3c09 req-628ff390-804d-4719-9b03-5d1b37194815 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:54.320631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-733e45c7-65b9-4580-8467-b6fbda1d3c09 req-628ff390-804d-4719-9b03-5d1b37194815 service nova] Creating event network-changed:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:37:54.327104 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-733e45c7-65b9-4580-8467-b6fbda1d3c09 req-628ff390-804d-4719-9b03-5d1b37194815 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031996 Feb 12 21:37:54.328419 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2894/5921] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:37:54.333411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:37:54.681326 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-768194c4-36e8-45a6-b8c0-125b7244060a tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 204 len: 0 microversion: 2.1 time: 0.388283 Feb 12 21:37:54.682326 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3028/5922] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:37:54 2022] DELETE /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:37:54.697159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:54.699382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:54.706460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:54.707162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:54.707975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:54.708432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:54.935265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:54.943405 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-558e865d-9899-4a64-9df0-02c872a6db04 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1688 microversion: 2.1 time: 0.251506 Feb 12 21:37:54.943988 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2895/5923] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:54 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1688 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:55.050672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:55.051394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:55.058630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:55.060083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:55.060220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:55.060839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:55.164102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:55.172066 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f60fd044-177e-4938-a444-385493f3f063 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1477 microversion: 2.1 time: 0.125574 Feb 12 21:37:55.172688 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3029/5924] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:55 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1477 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:55.965016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:55.965832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:55.972472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:55.972921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:55.973876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:55.974305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:56.122908 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:56.131105 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6745de8f-169e-4474-9803-cd124873d201 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1569 microversion: 2.1 time: 0.171692 Feb 12 21:37:56.131926 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2896/5925] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:55 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:56.189624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:56.190869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:56.199083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:56.199714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:56.200522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:56.200975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:56.234704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:56.235262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:56.235735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lazy-loading 'fault' on Instance uuid 27a1b1a0-75e3-4a79-8969-d13ddf83631d {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:37:56.277513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:56.285323 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6168088c-97a6-4dd5-a897-71075d6437ab tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 200 len: 1331 microversion: 2.1 time: 0.099466 Feb 12 21:37:56.285954 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3030/5926] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:56 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:56.347231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5e4b4c32-b88e-4cda-8768-9d554c84af9b req-9a975914-e457-4846-b185-a60027af23bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a1b1a0-75e3-4a79-8969-d13ddf83631d", "name": "network-vif-deleted", "tag": "217ebd50-2b7e-4502-aa60-71615cb92ddd"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:56.348782 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:56.348782 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:37:56.355963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5e4b4c32-b88e-4cda-8768-9d554c84af9b req-9a975914-e457-4846-b185-a60027af23bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:56.356412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5e4b4c32-b88e-4cda-8768-9d554c84af9b req-9a975914-e457-4846-b185-a60027af23bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:56.367666 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5e4b4c32-b88e-4cda-8768-9d554c84af9b req-9a975914-e457-4846-b185-a60027af23bb service nova] Creating event network-vif-deleted:217ebd50-2b7e-4502-aa60-71615cb92ddd for instance 27a1b1a0-75e3-4a79-8969-d13ddf83631d on nch1-master-1 Feb 12 21:37:56.373320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5e4b4c32-b88e-4cda-8768-9d554c84af9b req-9a975914-e457-4846-b185-a60027af23bb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Feb 12 21:37:56.374144 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2897/5927] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:37:57.149061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:57.149863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:57.156292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:57.156761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:57.157868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:57.158317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:57.192733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:57.193483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:57.193704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lazy-loading 'fault' on Instance uuid dd4dc749-89b9-4c5b-98a4-0c73df37b75c {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:37:57.234690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e415b4aefbf4e50ba15c2119de39190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1c557f5d984523b9dbe9c385659448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:37:57.242158 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-72d8a494-ad37-4a8b-846c-ccef176a32df tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 200 len: 1355 microversion: 2.1 time: 0.096865 Feb 12 21:37:57.242731 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3031/5928] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:57 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 1355 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:37:57.305968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:57.306669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: 27a1b1a0-75e3-4a79-8969-d13ddf83631d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:57.314530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:57.314990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:57.315782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:57.316220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:57.331963 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] HTTP exception thrown: Instance 27a1b1a0-75e3-4a79-8969-d13ddf83631d could not be found. Feb 12 21:37:57.332562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Returning 404 to user: Instance 27a1b1a0-75e3-4a79-8969-d13ddf83631d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:37:57.333478 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77cb70c7-093d-4bb8-ba1f-e5edd8982513 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d" status: 404 len: 111 microversion: 2.1 time: 0.031652 Feb 12 21:37:57.334033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2898/5929] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:57 2022] GET /compute/v2.1/servers/27a1b1a0-75e3-4a79-8969-d13ddf83631d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:37:58.259819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:37:58.260369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] [instance: dd4dc749-89b9-4c5b-98a4-0c73df37b75c] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:37:58.267491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:58.267966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:58.268807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:58.269239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:58.283864 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] HTTP exception thrown: Instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c could not be found. Feb 12 21:37:58.284478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Returning 404 to user: Instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:37:58.285338 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-833badc9-5866-4b35-b0ff-f62728c481e2 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c" status: 404 len: 111 microversion: 2.1 time: 0.029503 Feb 12 21:37:58.285927 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3032/5930] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:37:58 2022] GET /compute/v2.1/servers/dd4dc749-89b9-4c5b-98a4-0c73df37b75c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:37:58.388686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6b2873e7-8c03-4caa-a55a-bc07d2430885 req-df4390aa-e217-4fb9-8eb3-de2350274d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4dc749-89b9-4c5b-98a4-0c73df37b75c", "name": "network-vif-deleted", "tag": "30a257b9-dbad-4674-89ed-68090744d886"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:37:58.390402 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:37:58.390402 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:37:58.398878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6b2873e7-8c03-4caa-a55a-bc07d2430885 req-df4390aa-e217-4fb9-8eb3-de2350274d45 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:37:58.399421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6b2873e7-8c03-4caa-a55a-bc07d2430885 req-df4390aa-e217-4fb9-8eb3-de2350274d45 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:37:58.411206 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6b2873e7-8c03-4caa-a55a-bc07d2430885 req-df4390aa-e217-4fb9-8eb3-de2350274d45 service nova] Creating event network-vif-deleted:30a257b9-dbad-4674-89ed-68090744d886 for instance dd4dc749-89b9-4c5b-98a4-0c73df37b75c on nch1-master-1 Feb 12 21:37:58.416080 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6b2873e7-8c03-4caa-a55a-bc07d2430885 req-df4390aa-e217-4fb9-8eb3-de2350274d45 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031144 Feb 12 21:37:58.416997 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2899/5931] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:03.442419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:03.443664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:03.461788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:03.464018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:03.466253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:03.466946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:03.468769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bdf7aae6-c5cc-41c2-9cd5-99f26ca5fadb req-d279afdd-87a9-42f1-b6bf-6bb6fd70acb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2006c1c-0a08-4819-98d4-04c6365e67d8", "tag": "1071f810-ea07-4bba-9529-5d21596a9119"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:03.470506 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:03.470506 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:03.485418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bdf7aae6-c5cc-41c2-9cd5-99f26ca5fadb req-d279afdd-87a9-42f1-b6bf-6bb6fd70acb8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:03.485872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bdf7aae6-c5cc-41c2-9cd5-99f26ca5fadb req-d279afdd-87a9-42f1-b6bf-6bb6fd70acb8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:03.498755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:38:03.502482 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bdf7aae6-c5cc-41c2-9cd5-99f26ca5fadb req-d279afdd-87a9-42f1-b6bf-6bb6fd70acb8 service nova] Creating event network-changed:1071f810-ea07-4bba-9529-5d21596a9119 for instance a2006c1c-0a08-4819-98d4-04c6365e67d8 on nch2-master-1 Feb 12 21:38:03.515126 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bdf7aae6-c5cc-41c2-9cd5-99f26ca5fadb req-d279afdd-87a9-42f1-b6bf-6bb6fd70acb8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046900 Feb 12 21:38:03.520425 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2900/5932] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:38:04.476560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a5aadce-46ae-4814-821b-9d0d377119a4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] Calling method '.version_select at 0x7fa8fd1819d0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:04.524925 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88c5a14e-d4de-43dd-90fd-fdb4b1f634d5 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 204 len: 0 microversion: 2.1 time: 1.088423 Feb 12 21:38:04.525676 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3033/5933] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:38:03 2022] DELETE /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:38:04.535529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:04.536245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:04.542500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:04.542971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:04.544084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:04.544550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:04.562060 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a5aadce-46ae-4814-821b-9d0d377119a4 tempest-TestNetworkAdvancedServerOps-500985914 tempest-TestNetworkAdvancedServerOps-500985914-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1397736795" status: 202 len: 0 microversion: 2.1 time: 0.090276 Feb 12 21:38:04.562876 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2901/5934] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 21:38:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1397736795 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:38:04.737289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:04.745950 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-02bcf27b-e041-4ef0-abce-f66d2191097b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1768 microversion: 2.1 time: 0.214555 Feb 12 21:38:04.746863 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3034/5935] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:04 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1768 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:38:05.764103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:05.765130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:05.772537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:05.772994 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:05.773815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:05.774252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:05.997054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:06.004929 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-15b26659-dafa-4ed4-a699-d735f76f34a6 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1649 microversion: 2.1 time: 0.244950 Feb 12 21:38:06.005646 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2902/5936] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:05 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1649 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:38:06.456670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-71d0b885-c416-4442-9c24-0efa756248d1 req-aab2250a-2435-414d-aa8c-5eb01bb2a7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2006c1c-0a08-4819-98d4-04c6365e67d8", "name": "network-vif-deleted", "tag": "1071f810-ea07-4bba-9529-5d21596a9119"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:06.458235 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:06.458235 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:06.466629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-71d0b885-c416-4442-9c24-0efa756248d1 req-aab2250a-2435-414d-aa8c-5eb01bb2a7e2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:06.467092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-71d0b885-c416-4442-9c24-0efa756248d1 req-aab2250a-2435-414d-aa8c-5eb01bb2a7e2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:06.477886 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-71d0b885-c416-4442-9c24-0efa756248d1 req-aab2250a-2435-414d-aa8c-5eb01bb2a7e2 service nova] Creating event network-vif-deleted:1071f810-ea07-4bba-9529-5d21596a9119 for instance a2006c1c-0a08-4819-98d4-04c6365e67d8 on nch2-master-1 Feb 12 21:38:06.483445 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-71d0b885-c416-4442-9c24-0efa756248d1 req-aab2250a-2435-414d-aa8c-5eb01bb2a7e2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 Feb 12 21:38:06.484035 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3035/5937] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:07.022408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:07.022988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:07.030328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:07.030787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:07.031578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:07.032011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:07.064708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:07.064837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:07.065223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lazy-loading 'fault' on Instance uuid a2006c1c-0a08-4819-98d4-04c6365e67d8 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:38:07.107413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a6c5cb1c114c76a50eb68a2842c30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14346d52af354b338f2253bc2f551829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:07.115134 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0fe3b1b-01b8-4539-83ea-c5004e7902d1 tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 200 len: 1384 microversion: 2.1 time: 0.096316 Feb 12 21:38:07.115719 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2903/5938] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:07 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 1384 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:08.134429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:08.135140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] [instance: a2006c1c-0a08-4819-98d4-04c6365e67d8] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:08.141930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:08.142395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:08.143238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:08.143697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:08.158809 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] HTTP exception thrown: Instance a2006c1c-0a08-4819-98d4-04c6365e67d8 could not be found. Feb 12 21:38:08.159428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Returning 404 to user: Instance a2006c1c-0a08-4819-98d4-04c6365e67d8 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:38:08.160285 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-efbd38a6-9029-4831-985b-d19f53f4431c tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8" status: 404 len: 111 microversion: 2.1 time: 0.031085 Feb 12 21:38:08.160881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3036/5939] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:08 2022] GET /compute/v2.1/servers/a2006c1c-0a08-4819-98d4-04c6365e67d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:38:13.461220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ef188bb-6471-4a0f-b3a9-9bd8dfd3253b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] Calling method '.version_select at 0x7fa8fd1748b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:13.596516 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ef188bb-6471-4a0f-b3a9-9bd8dfd3253b tempest-TestSecurityGroupsBasicOps-1885361674 tempest-TestSecurityGroupsBasicOps-1885361674-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-357486827" status: 202 len: 0 microversion: 2.1 time: 0.139144 Feb 12 21:38:13.597202 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2904/5940] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-357486827 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:38:17.019058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ef0f11cd-76fa-4ff7-854e-0941f5574acc tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'create', calling method: .version_select at 0x7fa8fc70eb80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-784952130"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:17.042262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ef0f11cd-76fa-4ff7-854e-0941f5574acc tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:38:17.048871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ef0f11cd-76fa-4ff7-854e-0941f5574acc tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:38:17.406387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ef0f11cd-76fa-4ff7-854e-0941f5574acc tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:38:17.412093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-ef0f11cd-76fa-4ff7-854e-0941f5574acc tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:38:17.428129 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ef0f11cd-76fa-4ff7-854e-0941f5574acc tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.413572 Feb 12 21:38:17.428739 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3037/5941] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:38:17 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:20.139684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-298458412", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "ca45ed60-a4d7-47da-a5f2-fdc37055e227"}], "key_name": "tempest-TestNetworkBasicOps-784952130", "security_groups": [{"name": "tempest-secgroup-smoke-714431652"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:20.265683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] validate_networks() for [('ca45ed60-a4d7-47da-a5f2-fdc37055e227', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:38:20.759919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:38:20.760456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:38:20.761011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:38:20.761534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:38:20.762035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:38:20.771228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:20.771926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:20.772941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:20.773403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:20.791565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:38:20.797846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:38:20.810290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:38:20.812552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:38:20.928590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9881ce48-6887-4184-b0c5-90e157c3a5f1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793461 Feb 12 21:38:20.929670 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2905/5942] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:38:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:38:20.940475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce650a30-e4fd-455e-a97d-d5418849f93f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:20.941976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce650a30-e4fd-455e-a97d-d5418849f93f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:21.011617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce650a30-e4fd-455e-a97d-d5418849f93f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:21.018560 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce650a30-e4fd-455e-a97d-d5418849f93f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1247 microversion: 2.1 time: 0.081847 Feb 12 21:38:21.019466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3038/5943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:20 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:22.037017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:22.037653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:22.044257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:22.045496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:22.046303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:22.046766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:22.123131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:22.130531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-42cc1fa2-1bcd-4c4c-92e7-c50d7aa951fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1251 microversion: 2.1 time: 0.098324 Feb 12 21:38:22.131115 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2906/5944] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:22 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1251 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:23.147321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:23.148061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:23.156704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:23.157327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:23.158488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:23.159017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:23.232768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:23.241817 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8cd132b0-3cbd-4e31-aad0-659e7fde8fac tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1307 microversion: 2.1 time: 0.098069 Feb 12 21:38:23.242666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3039/5945] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:23 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:24.258235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:24.259989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:24.268168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:24.268977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:24.270275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:24.270962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:24.375162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:24.384571 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4a34976b-046e-4252-a6f5-15e312b79a3b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1305 microversion: 2.1 time: 0.129593 Feb 12 21:38:24.385449 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2907/5946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:24 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:25.404141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:25.405444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:25.413095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:25.413570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:25.414393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:25.414849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:25.561659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:25.570484 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a0fa3f70-4c8d-4adb-8415-d4ad3fa25d0a tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.171216 Feb 12 21:38:25.571589 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3040/5947] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:25 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:26.589792 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:26.590408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:26.604889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:26.605681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:26.607090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:26.607485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:26.661683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-47666926-cd3e-4ff0-b9cb-e5f8d5146e0b req-a703a032-4785-4857-a531-bcf98ef3c2cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a399fb8-d3f5-4c7c-81f1-393611926402", "tag": "3c9b8e09-7259-474b-9ca1-4ae67f8df397"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:26.663542 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:26.663542 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:26.673163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-47666926-cd3e-4ff0-b9cb-e5f8d5146e0b req-a703a032-4785-4857-a531-bcf98ef3c2cc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:26.673987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-47666926-cd3e-4ff0-b9cb-e5f8d5146e0b req-a703a032-4785-4857-a531-bcf98ef3c2cc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:26.699550 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-47666926-cd3e-4ff0-b9cb-e5f8d5146e0b req-a703a032-4785-4857-a531-bcf98ef3c2cc service nova] Creating event network-changed:3c9b8e09-7259-474b-9ca1-4ae67f8df397 for instance 2a399fb8-d3f5-4c7c-81f1-393611926402 on nch1-master-1 Feb 12 21:38:26.712841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-47666926-cd3e-4ff0-b9cb-e5f8d5146e0b req-a703a032-4785-4857-a531-bcf98ef3c2cc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266890 Feb 12 21:38:26.714389 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2908/5948] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:26.809059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:26.821448 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7f49dd34-a18e-4490-901a-ece81fb1118f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.237055 Feb 12 21:38:26.822045 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3041/5949] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:26 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:38:27.840559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:27.841302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:27.849745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:27.850208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:27.851448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:27.851851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:28.244898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:28.253682 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81b797c6-ffd5-4315-bc33-bde19804e8cd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.417721 Feb 12 21:38:28.254827 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2909/5950] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:27 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:29.113471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:29.114037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:29.120548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:29.121060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:29.121915 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:29.122368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:29.151013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:38:29.272540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:29.273151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:29.280559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:29.281011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:29.281900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:29.282344 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:29.437833 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e8ad606-9ea8-44a0-beff-922e6b1dcfef tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 204 len: 0 microversion: 2.1 time: 0.512870 Feb 12 21:38:29.440224 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3042/5951] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:38:28 2022] DELETE /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:38:29.448092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:29.449148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:29.456687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:29.457658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:29.459524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:29.460205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:29.513416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:29.521616 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c50dea8e-fabe-4379-9108-85fcbaf167f7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.252723 Feb 12 21:38:29.530180 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2910/5952] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:29 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:38:29.647547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:29.656217 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3fe09a5a-22a1-429d-a889-2c2a19c70652 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1733 microversion: 2.1 time: 0.212915 Feb 12 21:38:29.656746 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3043/5953] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:29 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:38:30.554270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:30.554895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:30.567732 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:30.572742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:30.574378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:30.574835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:30.679323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:30.679789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:30.688154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:30.688641 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:30.689516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:30.690117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:30.806192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:30.822655 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55f19a3d-acc8-4356-be50-c6c38ca7451d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.279229 Feb 12 21:38:30.846686 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2911/5954] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:30 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:30.928187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:30.944602 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c67e5ddc-8bc4-4015-a5ac-9f9a15939bb6 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1733 microversion: 2.1 time: 0.267594 Feb 12 21:38:30.945588 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3044/5955] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:30 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1733 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:31.840148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:31.840770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:31.861440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:31.861911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:31.862739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:31.863220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:31.965488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:31.965488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:31.976933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:31.977481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:31.978273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:31.983656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:32.197563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:32.213210 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-49ab3202-7397-4f56-adf6-41a5142a79f8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.376600 Feb 12 21:38:32.216219 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2912/5956] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:31 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:32.227800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c6b659a8-bf18-4dec-ab2f-8ae941fe062d req-155f5dbb-e928-4005-a08f-69252b9f229b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb651ad-6909-4814-b97a-a1331757b728", "name": "network-vif-deleted", "tag": "f8d754d1-34dc-4a41-ac74-e83b17271343"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:32.229672 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:32.229672 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:32.237586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c6b659a8-bf18-4dec-ab2f-8ae941fe062d req-155f5dbb-e928-4005-a08f-69252b9f229b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:32.239263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c6b659a8-bf18-4dec-ab2f-8ae941fe062d req-155f5dbb-e928-4005-a08f-69252b9f229b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:32.256590 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c6b659a8-bf18-4dec-ab2f-8ae941fe062d req-155f5dbb-e928-4005-a08f-69252b9f229b service nova] Creating event network-vif-deleted:f8d754d1-34dc-4a41-ac74-e83b17271343 for instance 9eb651ad-6909-4814-b97a-a1331757b728 on nch2-master-1 Feb 12 21:38:32.300426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bfde3e7e2e4f689e48688765442489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ee0199776b422d91d8368c75898fd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:32.307639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c6b659a8-bf18-4dec-ab2f-8ae941fe062d req-155f5dbb-e928-4005-a08f-69252b9f229b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062535 Feb 12 21:38:32.308127 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-698731c9-e9f9-4bc6-b094-b23f3f8e85f2 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 200 len: 1665 microversion: 2.1 time: 0.350374 Feb 12 21:38:32.312918 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2913/5957] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:32.313372 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3045/5958] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:31 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 1665 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:33.235496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:33.236232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:33.248287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:33.249550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:33.250969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:33.251788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:33.327538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:33.328845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:33.340280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:33.342421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:33.343157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:33.343893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:33.368487 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] HTTP exception thrown: Instance 9eb651ad-6909-4814-b97a-a1331757b728 could not be found. Feb 12 21:38:33.369131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Returning 404 to user: Instance 9eb651ad-6909-4814-b97a-a1331757b728 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:38:33.374878 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c694c71f-4744-4021-aae4-16b3fbcc8320 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 404 len: 111 microversion: 2.1 time: 0.047759 Feb 12 21:38:33.374878 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3046/5959] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:33 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:38:33.433635 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-26cca96c-b518-4bbe-8bdd-365c43527f4c req-aeefde47-ded4-4fd1-8377-d990806b6d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a399fb8-d3f5-4c7c-81f1-393611926402", "name": "network-vif-plugged", "status": "completed", "tag": "3c9b8e09-7259-474b-9ca1-4ae67f8df397"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:33.435669 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:33.435669 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:33.446901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-26cca96c-b518-4bbe-8bdd-365c43527f4c req-aeefde47-ded4-4fd1-8377-d990806b6d57 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:33.447866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-26cca96c-b518-4bbe-8bdd-365c43527f4c req-aeefde47-ded4-4fd1-8377-d990806b6d57 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:33.462007 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-26cca96c-b518-4bbe-8bdd-365c43527f4c req-aeefde47-ded4-4fd1-8377-d990806b6d57 service nova] Creating event network-vif-plugged:3c9b8e09-7259-474b-9ca1-4ae67f8df397 for instance 2a399fb8-d3f5-4c7c-81f1-393611926402 on nch1-master-1 Feb 12 21:38:33.471350 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-26cca96c-b518-4bbe-8bdd-365c43527f4c req-aeefde47-ded4-4fd1-8377-d990806b6d57 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041880 Feb 12 21:38:33.475128 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3047/5960] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:38:33.690583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:33.704064 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-398b930a-0476-4b69-9189-658712c1bee7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.475491 Feb 12 21:38:33.704973 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2914/5961] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:33 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:34.276785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:34.277835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:34.287061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:34.288626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:34.289760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:34.290462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:34.318479 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] HTTP exception thrown: Instance 9eb651ad-6909-4814-b97a-a1331757b728 could not be found. Feb 12 21:38:34.319299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Returning 404 to user: Instance 9eb651ad-6909-4814-b97a-a1331757b728 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:38:34.320946 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6ddfa8ec-f4e1-48fd-a6fb-0aa08d0aacbc tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 404 len: 111 microversion: 2.1 time: 0.047781 Feb 12 21:38:34.321732 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3048/5962] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:38:34 2022] DELETE /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:38:34.335314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:34.335314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] [instance: 9eb651ad-6909-4814-b97a-a1331757b728] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:34.351581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:34.351960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:34.353693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:34.357805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:34.373455 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] HTTP exception thrown: Instance 9eb651ad-6909-4814-b97a-a1331757b728 could not be found. Feb 12 21:38:34.374071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Returning 404 to user: Instance 9eb651ad-6909-4814-b97a-a1331757b728 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:38:34.374946 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e3db702-2724-4690-8415-c347f9cc489c tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728" status: 404 len: 111 microversion: 2.1 time: 0.048239 Feb 12 21:38:34.380270 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2915/5963] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:34 2022] GET /compute/v2.1/servers/9eb651ad-6909-4814-b97a-a1331757b728 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:38:34.663865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8f55621f-fe00-4901-8c8e-0dde4c360893 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] Calling method '.version_select at 0x7fa8fc7049d0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:34.721154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:34.721804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:34.728009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:34.728681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:34.729722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:34.730255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:34.766228 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8f55621f-fe00-4901-8c8e-0dde4c360893 tempest-TestServerBasicOps-2129886097 tempest-TestServerBasicOps-2129886097-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1827759374" status: 202 len: 0 microversion: 2.1 time: 0.105125 Feb 12 21:38:34.768859 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3049/5964] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 21:38:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1827759374 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:38:34.907064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:34.923880 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-910bf9ef-bcc5-4c63-a4f3-d10b02bf1293 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1372 microversion: 2.1 time: 0.206309 Feb 12 21:38:34.930852 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2916/5965] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:34 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:38:35.952634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:35.953621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:35.960920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:35.961685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:35.962751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:35.963328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:36.377098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:36.386978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7108b150-fdf0-416c-9e6f-1bbef61de89b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1544 microversion: 2.1 time: 0.442982 Feb 12 21:38:36.389675 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3050/5966] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:35 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1544 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:36.411149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:36.412541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:36.425939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:36.431180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:36.432297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:36.432770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:36.655486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:36.665160 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d0c7cd8-5d93-4e29-9b9c-2ae820971e09 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1544 microversion: 2.1 time: 0.258432 Feb 12 21:38:36.678337 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2917/5967] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:36 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:37.492556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-982f44e1-05a6-4447-a609-9105fd90f33d tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-885974125", "availability_zone": "foo_zone"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:37.494289 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:37.494289 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:37.495726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.aggregate [None req-982f44e1-05a6-4447-a609-9105fd90f33d tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Generated uuid 891a8550-0d7e-4dd9-8e8b-6119b75f9967 for aggregate {{(pid=141727) create /opt/stack/nova/nova/objects/aggregate.py:298}} Feb 12 21:38:37.633893 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-982f44e1-05a6-4447-a609-9105fd90f33d tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.306333 Feb 12 21:38:37.633893 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3051/5968] 10.222.0.31 () {60 vars in 1163 bytes} [Sat Feb 12 21:38:37 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:37.640904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-96eafdb0-fbe3-4446-bc93-bdbca2a94ae3 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:37.643572 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:37.643572 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:37.777299 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-96eafdb0-fbe3-4446-bc93-bdbca2a94ae3 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.140644 Feb 12 21:38:37.783262 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2918/5969] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:38:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:37.800006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-819bbeb5-ac94-49e2-9661-1d3b42a1e16c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:37.803804 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:37.803804 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:37.805863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-819bbeb5-ac94-49e2-9661-1d3b42a1e16c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:37.807380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-819bbeb5-ac94-49e2-9661-1d3b42a1e16c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:37.810126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-819bbeb5-ac94-49e2-9661-1d3b42a1e16c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:37.812674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-819bbeb5-ac94-49e2-9661-1d3b42a1e16c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:37.839969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-819bbeb5-ac94-49e2-9661-1d3b42a1e16c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048372 Feb 12 21:38:37.840599 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3052/5970] 10.222.0.31 () {58 vars in 1175 bytes} [Sat Feb 12 21:38:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:37.852342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7f7b6ccb-2840-4b49-be4b-b16b6b5ea48e tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:37.853603 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:37.853603 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:37.865134 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7f7b6ccb-2840-4b49-be4b-b16b6b5ea48e tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.015981 Feb 12 21:38:37.866034 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2919/5971] 10.222.0.31 () {58 vars in 1142 bytes} [Sat Feb 12 21:38:37 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:37.876707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e7083d05-68b5-4490-a2c2-176ab7a2252c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:37.878003 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:37.878003 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:37.887671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7083d05-68b5-4490-a2c2-176ab7a2252c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:37.889458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7083d05-68b5-4490-a2c2-176ab7a2252c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:38.408971 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e7083d05-68b5-4490-a2c2-176ab7a2252c tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.536450 Feb 12 21:38:38.411160 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3053/5972] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:38:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:38.421424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-385905a2-0869-494c-b3b2-93f668640074 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:38.422212 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:38.422212 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:38.430394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-385905a2-0869-494c-b3b2-93f668640074 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013019 Feb 12 21:38:38.439397 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2920/5973] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:38:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:38.445775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d702ffe-a8dd-4dc0-a235-0ab748ece1cc tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1853335515", "availability_zone": "foo_zone"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:38.448808 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:38.448808 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:38.626816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d702ffe-a8dd-4dc0-a235-0ab748ece1cc tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.185401 Feb 12 21:38:38.632108 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3054/5974] 10.222.0.31 () {60 vars in 1172 bytes} [Sat Feb 12 21:38:38 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:38:38.643779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a74598f3-ee42-4bb5-bcac-11fd9cc64f9a tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:38.647153 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:38.647153 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:38.955603 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a74598f3-ee42-4bb5-bcac-11fd9cc64f9a tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.316586 Feb 12 21:38:38.956872 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2921/5975] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:38:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:38.970107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-348d5b79-3b66-4b8f-b111-36c052102318 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:38.971049 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:38.971049 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:38.989119 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-348d5b79-3b66-4b8f-b111-36c052102318 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.023522 Feb 12 21:38:38.991269 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3055/5976] 10.222.0.31 () {58 vars in 1151 bytes} [Sat Feb 12 21:38:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:39.004975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae8bdd6d-90f3-4057-b678-6c82f0a44f88 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:39.008508 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:39.008508 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:39.019972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae8bdd6d-90f3-4057-b678-6c82f0a44f88 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:39.020679 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae8bdd6d-90f3-4057-b678-6c82f0a44f88 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:39.418104 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae8bdd6d-90f3-4057-b678-6c82f0a44f88 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.417209 Feb 12 21:38:39.418104 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2922/5977] 10.222.0.31 () {60 vars in 1193 bytes} [Sat Feb 12 21:38:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:39.428956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-11418ec0-0d98-44d4-9405-de92b62af8b8 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:39.429922 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:39.429922 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:38:39.544816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-11418ec0-0d98-44d4-9405-de92b62af8b8 tempest-TestAggregatesBasicOps-232194282 tempest-TestAggregatesBasicOps-232194282-project-admin] 10.222.0.31 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.119608 Feb 12 21:38:39.552401 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3056/5978] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:38:39 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Feb 12 21:38:39.851099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a309bb08-38b9-4f22-ba21-3398923ef5c0 req-33afc920-81cd-44ce-b5fc-45b6066331e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a399fb8-d3f5-4c7c-81f1-393611926402", "tag": "3c9b8e09-7259-474b-9ca1-4ae67f8df397"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:39.852827 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:39.852827 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:39.877079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a309bb08-38b9-4f22-ba21-3398923ef5c0 req-33afc920-81cd-44ce-b5fc-45b6066331e9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:39.877566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a309bb08-38b9-4f22-ba21-3398923ef5c0 req-33afc920-81cd-44ce-b5fc-45b6066331e9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:39.898187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a309bb08-38b9-4f22-ba21-3398923ef5c0 req-33afc920-81cd-44ce-b5fc-45b6066331e9 service nova] Creating event network-changed:3c9b8e09-7259-474b-9ca1-4ae67f8df397 for instance 2a399fb8-d3f5-4c7c-81f1-393611926402 on nch1-master-1 Feb 12 21:38:39.915756 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a309bb08-38b9-4f22-ba21-3398923ef5c0 req-33afc920-81cd-44ce-b5fc-45b6066331e9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068569 Feb 12 21:38:39.916948 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2923/5979] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:38:55.112504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1873204700", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "75b562f6-05ba-4a28-8cd2-467a5247df21"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:55.164024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] validate_networks() for [('75b562f6-05ba-4a28-8cd2-467a5247df21', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:38:55.599333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:38:55.599811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:38:55.600301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:38:55.600725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:38:55.601148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:38:55.613338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:55.613837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:55.614758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:55.615212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:55.634709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Getting quotas for project 480baeced589484896034d4d1a4cb39c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:38:55.640536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Getting quotas for user 37c98650b3f2489392ce4a598ddd5958 and project 480baeced589484896034d4d1a4cb39c. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:38:55.652551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:38:55.655083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:38:55.764083 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2ce9c144-56f7-45b1-98dc-509348742fa0 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763658 Feb 12 21:38:55.764855 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3057/5980] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:38:55.775978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a5722582-0c16-4a2b-9800-4e5a829c29bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:55.776683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a5722582-0c16-4a2b-9800-4e5a829c29bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:55.835014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a5722582-0c16-4a2b-9800-4e5a829c29bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:55.841824 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a5722582-0c16-4a2b-9800-4e5a829c29bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1215 microversion: 2.1 time: 0.070716 Feb 12 21:38:55.842605 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2924/5981] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:55 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:56.860426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:56.861102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:56.867874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:56.868346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:56.869148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:56.869626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:56.931528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:56.939993 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cad98d5c-43d3-4549-aff1-d58908633151 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1219 microversion: 2.1 time: 0.084927 Feb 12 21:38:56.941898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3058/5982] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:56 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:57.955819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:57.956433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:57.964637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:57.965089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:57.966508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:57.966949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:58.049126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:58.056728 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-68ca9e68-a2a1-430b-862a-6d9dfb04385a tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1285 microversion: 2.1 time: 0.104613 Feb 12 21:38:58.057305 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2925/5983] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:57 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:59.074109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:38:59.074830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:38:59.081887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:59.082358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:59.083211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:59.083669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:59.224708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:38:59.232059 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-800f197e-6b18-4999-acbc-86245530f119 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.161670 Feb 12 21:38:59.232651 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3059/5984] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:38:59 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:38:59.741885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f4a37b93-6944-4455-84da-9c7713eaac20 req-020e7d9b-66e2-4f13-abac-4acfaeecce89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b80144-a363-4492-8b32-01a601680143", "tag": "b2627200-528c-4926-a54d-90a2def327ed"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:38:59.743445 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:38:59.743445 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:38:59.757936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f4a37b93-6944-4455-84da-9c7713eaac20 req-020e7d9b-66e2-4f13-abac-4acfaeecce89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:38:59.758408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f4a37b93-6944-4455-84da-9c7713eaac20 req-020e7d9b-66e2-4f13-abac-4acfaeecce89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:38:59.770556 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f4a37b93-6944-4455-84da-9c7713eaac20 req-020e7d9b-66e2-4f13-abac-4acfaeecce89 service nova] Creating event network-changed:b2627200-528c-4926-a54d-90a2def327ed for instance 42b80144-a363-4492-8b32-01a601680143 on nch2-master-1 Feb 12 21:38:59.775339 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f4a37b93-6944-4455-84da-9c7713eaac20 req-020e7d9b-66e2-4f13-abac-4acfaeecce89 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037017 Feb 12 21:38:59.775929 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2926/5985] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:39:00.248376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:00.249087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:00.256229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:00.256791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:00.257720 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:00.258173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:00.400773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:00.409458 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1148336-3271-4198-b6bb-9047b4502152 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.164571 Feb 12 21:39:00.410050 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3060/5986] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:00 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:01.427369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:01.428073 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:01.434341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:01.434797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:01.435717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:01.436154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:01.576974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:01.584629 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9fa138a-8919-4c68-add4-92b96208f14b tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.162196 Feb 12 21:39:01.585204 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2927/5987] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:01 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:01.601905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:01.602910 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:01.610133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:01.610597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:01.612076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:01.612534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:01.669274 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5b0af829-9e86-4a18-bf5d-c7ffe2f2d3b6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402/action" status: 200 len: 24561 microversion: 2.1 time: 0.070948 Feb 12 21:39:01.670113 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3061/5988] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:39:01 2022] POST /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402/action => generated 24561 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:39:02.602137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:02.602681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:02.610008 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:02.610475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:02.611244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:02.611709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:02.748313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:02.755843 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e9966765-a580-47f1-8c06-71c147f76065 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.157537 Feb 12 21:39:02.756439 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2928/5989] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:02 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:03.773847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:03.774692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:03.783046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:03.783614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:03.784778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:03.785246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:03.923837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:03.931341 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e93a4856-8140-4326-97b3-29c23da45d40 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.161746 Feb 12 21:39:03.931901 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3062/5990] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:03 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:04.948935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:04.949609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:04.956862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:04.957313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:04.958125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:04.958562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:05.105018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:05.113658 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b645d118-1fb1-4dd8-be66-6dbf3784f327 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.168280 Feb 12 21:39:05.114431 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2929/5991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:04 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:05.183031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c9058118-970d-4438-8840-8e8c60c69c5d req-b519d33d-46a0-4f1c-9352-4bc6d66db576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b80144-a363-4492-8b32-01a601680143", "name": "network-vif-plugged", "status": "completed", "tag": "b2627200-528c-4926-a54d-90a2def327ed"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:05.184570 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:39:05.184570 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:39:05.193674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c9058118-970d-4438-8840-8e8c60c69c5d req-b519d33d-46a0-4f1c-9352-4bc6d66db576 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:05.194172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c9058118-970d-4438-8840-8e8c60c69c5d req-b519d33d-46a0-4f1c-9352-4bc6d66db576 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:05.205144 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c9058118-970d-4438-8840-8e8c60c69c5d req-b519d33d-46a0-4f1c-9352-4bc6d66db576 service nova] Creating event network-vif-plugged:b2627200-528c-4926-a54d-90a2def327ed for instance 42b80144-a363-4492-8b32-01a601680143 on nch2-master-1 Feb 12 21:39:05.210154 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c9058118-970d-4438-8840-8e8c60c69c5d req-b519d33d-46a0-4f1c-9352-4bc6d66db576 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Feb 12 21:39:05.210740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3063/5992] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:39:06.129964 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:06.130590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:06.137825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:06.138288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:06.139151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:06.139601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:06.525288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:06.533722 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55de0fd6-f743-45a4-b625-a041f5aa57ef tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1315 microversion: 2.1 time: 0.407482 Feb 12 21:39:06.534800 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2930/5993] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:06 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:07.551815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:07.552526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:07.559472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:07.559937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:07.560834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:07.561430 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:07.694486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:07.702579 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-994ea13b-616e-498e-9a8a-abc295a21435 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1502 microversion: 2.1 time: 0.154612 Feb 12 21:39:07.703156 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3064/5994] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:07 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:07.719623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:07.720226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:07.727294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:07.727772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:07.728574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:07.729018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:07.866127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:07.874311 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ffe285ff-72ec-46f0-b1d1-3eebed72fed8 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1502 microversion: 2.1 time: 0.159178 Feb 12 21:39:07.874901 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2931/5995] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:07 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:07.891514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:07.892098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:07.898305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:07.898774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:07.899588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:07.900042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:07.923203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lazy-loading 'flavor' on Instance uuid 42b80144-a363-4492-8b32-01a601680143 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:39:08.153101 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b666abf2-6e21-43f6-9e78-bc6cb3a260af tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action" status: 202 len: 0 microversion: 2.1 time: 0.265708 Feb 12 21:39:08.153864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3065/5996] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:39:07 2022] POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:39:08.162620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:08.163231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:08.169215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:08.169728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:08.170685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:08.171147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:08.303005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:08.310306 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-062011c9-8365-47eb-86b2-ab7ec4ff7e48 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1510 microversion: 2.1 time: 0.151688 Feb 12 21:39:08.311420 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2932/5997] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:08 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:09.329244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:09.330064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:09.336205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:09.336672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:09.337528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:09.337951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:09.479342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:09.487794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce79dbd4-6489-443c-ba90-544ca00a8ce3 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1493 microversion: 2.1 time: 0.163557 Feb 12 21:39:09.488377 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3066/5998] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:09 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1493 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:09.504031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:09.504623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:09.511385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:09.511842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:09.512631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:09.513068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:09.849887 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b581c51f-9896-4fa1-9342-cb11240187c4 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action" status: 202 len: 0 microversion: 2.1 time: 0.349400 Feb 12 21:39:09.850718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2933/5999] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:39:09 2022] POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:39:09.858987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:09.859624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:09.865761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:09.866237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:09.867055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:09.867518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:10.007080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:10.015468 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-35d994e3-946e-479b-9065-4b849c5de646 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1499 microversion: 2.1 time: 0.160595 Feb 12 21:39:10.016086 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3067/6000] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:09 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:11.036584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:11.037205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:11.043493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:11.043947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:11.044735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:11.045690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:11.189142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:11.196639 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e7a011a6-cb2a-49ea-9785-d29fc4d33f91 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1499 microversion: 2.1 time: 0.165324 Feb 12 21:39:11.204113 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2934/6001] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:11 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:12.213815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:12.214452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:12.222056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:12.222538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:12.223369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:12.223984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:12.366857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:12.375248 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07fb03ae-fc1a-4e99-96ce-396f690190bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1502 microversion: 2.1 time: 0.165238 Feb 12 21:39:12.375863 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3068/6002] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:12 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:12.396116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:12.396669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:12.403350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:12.403800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:12.404705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:12.405194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:12.429659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lazy-loading 'flavor' on Instance uuid 42b80144-a363-4492-8b32-01a601680143 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:39:12.656960 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-38bcf22f-0b31-47c2-bc53-446f05994298 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action" status: 202 len: 0 microversion: 2.1 time: 0.264225 Feb 12 21:39:12.657701 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2935/6003] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:39:12 2022] POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:39:12.667354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:12.667995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:12.674709 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:12.675210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:12.676030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:12.676672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:12.821306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:12.829559 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4208376c-e42c-4bf1-9e8f-efc82f2c43df tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1510 microversion: 2.1 time: 0.166897 Feb 12 21:39:12.830165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3069/6004] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:12 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:13.848141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:13.848846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:13.855230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:13.857989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:13.857989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:13.857989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:13.994844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:14.002335 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0472a534-6838-4f21-9714-a55334eef917 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1493 microversion: 2.1 time: 0.159029 Feb 12 21:39:14.002824 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2936/6005] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:13 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1493 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:14.019342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:14.019872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:14.026695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:14.027159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:14.027953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:14.028406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:14.222968 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73ef2656-0a8a-431f-9a8d-6f1318dd8f6f tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action" status: 202 len: 0 microversion: 2.1 time: 0.207140 Feb 12 21:39:14.223611 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3070/6006] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:39:14 2022] POST /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:39:14.231426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:14.232032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:14.238520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:14.238967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:14.239749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:14.240185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:14.410570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:14.417962 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-28f102e5-b54d-48c9-8f45-931e3f67b66c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1499 microversion: 2.1 time: 0.190116 Feb 12 21:39:14.418604 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2937/6007] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:14 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1499 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:15.436098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:15.436933 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:15.443946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:15.446390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:15.446390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:15.446390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:15.589043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:15.597516 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5377d437-b178-4d9f-8a83-39541404c10d tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1499 microversion: 2.1 time: 0.165778 Feb 12 21:39:15.601498 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3071/6008] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:15 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:39:16.614524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:16.615133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:16.622464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:16.622983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:16.623771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:16.624209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:16.766954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:16.774414 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-35407ed6-655e-41f0-a7f9-4c0ee7a1783c tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1502 microversion: 2.1 time: 0.163663 Feb 12 21:39:16.774989 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2938/6009] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:16 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:16.790439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:16.790963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:16.798392 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:16.798865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:16.799725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:16.800179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:16.832453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:39:17.122488 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3a3472b6-cc9a-43ad-9b66-c9fc9d8f08bf tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "DELETE /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 204 len: 0 microversion: 2.1 time: 0.335412 Feb 12 21:39:17.127719 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3072/6010] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:39:16 2022] DELETE /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:39:17.132763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:17.133907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:17.140673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:17.141721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:17.143003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:17.143675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:17.282075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:17.289826 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-23f08943-f239-464f-a5ed-6d0ceb7c6191 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1508 microversion: 2.1 time: 0.160790 Feb 12 21:39:17.290402 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2939/6011] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:17 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:39:17.399614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b08fdb0-c136-495c-b390-60bec0c4a0ed tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'create', calling method: .version_select at 0x7fa8fdf29670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1539555058"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:17.415137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7b08fdb0-c136-495c-b390-60bec0c4a0ed tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:39:17.420489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7b08fdb0-c136-495c-b390-60bec0c4a0ed tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:39:17.618463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7b08fdb0-c136-495c-b390-60bec0c4a0ed tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:39:17.623459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-7b08fdb0-c136-495c-b390-60bec0c4a0ed tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:39:17.637943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b08fdb0-c136-495c-b390-60bec0c4a0ed tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.242378 Feb 12 21:39:17.644041 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3073/6012] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:39:17 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:39:18.306842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:18.307416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:18.315069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:18.315521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:18.316313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:18.316748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:18.480871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:18.488930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4ccd92fc-d7b5-469d-afff-f4a9a4c30226 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1508 microversion: 2.1 time: 0.185787 Feb 12 21:39:18.489534 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2940/6013] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:18 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:19.507711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:19.508485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:19.516131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:19.517134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:19.518229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:19.519086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:19.561991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-319fc462-1de3-4636-8208-bd7eead382fa req-54fb5461-f47b-4383-b239-f0c0e7cbc219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b80144-a363-4492-8b32-01a601680143", "name": "network-vif-deleted", "tag": "b2627200-528c-4926-a54d-90a2def327ed"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:19.564232 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:39:19.564232 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:39:19.571986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-319fc462-1de3-4636-8208-bd7eead382fa req-54fb5461-f47b-4383-b239-f0c0e7cbc219 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:19.572436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-319fc462-1de3-4636-8208-bd7eead382fa req-54fb5461-f47b-4383-b239-f0c0e7cbc219 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:19.584964 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-319fc462-1de3-4636-8208-bd7eead382fa req-54fb5461-f47b-4383-b239-f0c0e7cbc219 service nova] Creating event network-vif-deleted:b2627200-528c-4926-a54d-90a2def327ed for instance 42b80144-a363-4492-8b32-01a601680143 on nch2-master-1 Feb 12 21:39:19.590113 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-319fc462-1de3-4636-8208-bd7eead382fa req-54fb5461-f47b-4383-b239-f0c0e7cbc219 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033298 Feb 12 21:39:19.590855 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2941/6014] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:39:19.600437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c98650b3f2489392ce4a598ddd5958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480baeced589484896034d4d1a4cb39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:19.608587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f70879a-ac5b-40f6-84d9-5345896e98bd tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 200 len: 1466 microversion: 2.1 time: 0.104529 Feb 12 21:39:19.609031 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3074/6015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:19 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 1466 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:20.176678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-692337511", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "6b35dc6b-8cba-411d-b0b5-203e5716906f"}], "key_name": "tempest-TestNetworkBasicOps-1539555058", "security_groups": [{"name": "tempest-secgroup-smoke-1255278680"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:20.295895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] validate_networks() for [('6b35dc6b-8cba-411d-b0b5-203e5716906f', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:39:20.626999 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:20.627664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] [instance: 42b80144-a363-4492-8b32-01a601680143] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:20.634772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:20.635462 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:20.636271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:20.636852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:20.650979 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] HTTP exception thrown: Instance 42b80144-a363-4492-8b32-01a601680143 could not be found. Feb 12 21:39:20.651605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] Returning 404 to user: Instance 42b80144-a363-4492-8b32-01a601680143 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:39:20.652435 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de0df59c-471c-48ce-a0ed-253093f8de17 tempest-TestServerAdvancedOps-153777730 tempest-TestServerAdvancedOps-153777730-project] 10.222.0.31 "GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143" status: 404 len: 111 microversion: 2.1 time: 0.029916 Feb 12 21:39:20.652988 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3075/6016] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:20 2022] GET /compute/v2.1/servers/42b80144-a363-4492-8b32-01a601680143 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:39:20.691001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:39:20.691519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:39:20.691887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:39:20.692302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:39:20.692714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:39:20.706663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:20.707255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:20.708094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:20.708567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:20.726037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:39:20.731174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:39:20.744566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:39:20.752070 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:39:20.873206 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c44f6459-ede6-414b-94e3-5a1001d7fb8d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701823 Feb 12 21:39:20.873974 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2942/6017] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:39:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:39:20.884385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-131a5422-fad2-49f6-8140-b92e3400f5a1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:20.885181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-131a5422-fad2-49f6-8140-b92e3400f5a1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:20.942486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-131a5422-fad2-49f6-8140-b92e3400f5a1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:20.949270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-131a5422-fad2-49f6-8140-b92e3400f5a1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1248 microversion: 2.1 time: 0.068538 Feb 12 21:39:20.950063 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3076/6018] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:20 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:21.966898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:21.967596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:22.222032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:22.222478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:22.223491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:22.223938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:22.285589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:22.292901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3e67f1d5-d66e-4b96-bed0-27cf4ea731bd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1244 microversion: 2.1 time: 0.330562 Feb 12 21:39:22.293493 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2943/6019] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:21 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1244 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:23.315321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:23.315949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:23.323654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:23.324137 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:23.325141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:23.325601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:23.392704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:23.400221 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddd807ee-9a3a-4ea0-a8fe-c63ca7a15560 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1306 microversion: 2.1 time: 0.088753 Feb 12 21:39:23.400801 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3077/6020] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:23 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:24.423351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:24.425065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:24.434178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:24.435039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:24.435997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:24.436670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:24.653601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:24.661341 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eed72294-b5e6-48de-9a29-fb5eef8f9f88 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.246313 Feb 12 21:39:24.661924 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2944/6021] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:24 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:24.785521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-23f2d2c6-471a-47a1-8b43-d336d3d5adcb req-9143495a-82b8-4623-bd8b-db52cdebe6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f7327f-8b30-488e-9048-c297bf30ff10", "tag": "453848aa-83df-40ec-be34-bb93babb1697"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:24.787196 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:39:24.787196 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:39:24.795901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-23f2d2c6-471a-47a1-8b43-d336d3d5adcb req-9143495a-82b8-4623-bd8b-db52cdebe6ef service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:24.796625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-23f2d2c6-471a-47a1-8b43-d336d3d5adcb req-9143495a-82b8-4623-bd8b-db52cdebe6ef service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:24.815868 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-23f2d2c6-471a-47a1-8b43-d336d3d5adcb req-9143495a-82b8-4623-bd8b-db52cdebe6ef service nova] Creating event network-changed:453848aa-83df-40ec-be34-bb93babb1697 for instance 85f7327f-8b30-488e-9048-c297bf30ff10 on nch2-master-1 Feb 12 21:39:24.820834 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-23f2d2c6-471a-47a1-8b43-d336d3d5adcb req-9143495a-82b8-4623-bd8b-db52cdebe6ef service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042045 Feb 12 21:39:24.823309 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3078/6022] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:39:25.678535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:25.679152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:25.685633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:25.686093 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:25.686891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:25.687332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:25.821528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:25.829324 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa222ce0-3325-41e6-91b7-6b1f48c9124f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.154115 Feb 12 21:39:25.830000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2945/6023] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:25 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:26.847177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:26.847887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:26.854152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:26.854617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:26.855415 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:26.855866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:26.991003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:26.998463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d82a18bf-6fbe-4a97-8d24-2fc1c90d52fd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.156244 Feb 12 21:39:26.999043 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3079/6024] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:26 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:28.014648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:28.015268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:28.022122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:28.022580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:28.023430 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:28.023902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:28.163797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:28.171204 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-31932902-2f45-4b43-a33e-c205b0ce1c91 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.160215 Feb 12 21:39:28.171789 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2946/6025] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:28 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:29.188809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:29.189510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:29.196475 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:29.196946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:29.197970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:29.198426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:29.355903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:29.363948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fd36a1cf-0b3a-49d1-9514-427d604e591f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.179665 Feb 12 21:39:29.364945 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3080/6026] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:29 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:30.381866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:30.382546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:30.389455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:30.389912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:30.390701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:30.391752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:30.526895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:30.535151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-174047a0-8513-4782-ade9-373916f2795c tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.156759 Feb 12 21:39:30.535727 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2947/6027] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:30 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:31.276333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0195dd35-27d7-47a7-951d-52ccc9656d08 req-252643d8-0b0a-49aa-a2bc-89cc573e7236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f7327f-8b30-488e-9048-c297bf30ff10", "name": "network-vif-plugged", "status": "completed", "tag": "453848aa-83df-40ec-be34-bb93babb1697"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:39:31.277893 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:39:31.277893 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:39:31.286572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0195dd35-27d7-47a7-951d-52ccc9656d08 req-252643d8-0b0a-49aa-a2bc-89cc573e7236 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:31.287036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0195dd35-27d7-47a7-951d-52ccc9656d08 req-252643d8-0b0a-49aa-a2bc-89cc573e7236 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:31.298624 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0195dd35-27d7-47a7-951d-52ccc9656d08 req-252643d8-0b0a-49aa-a2bc-89cc573e7236 service nova] Creating event network-vif-plugged:453848aa-83df-40ec-be34-bb93babb1697 for instance 85f7327f-8b30-488e-9048-c297bf30ff10 on nch2-master-1 Feb 12 21:39:31.303510 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0195dd35-27d7-47a7-951d-52ccc9656d08 req-252643d8-0b0a-49aa-a2bc-89cc573e7236 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031098 Feb 12 21:39:31.304095 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3081/6028] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:39:31.552649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:31.553265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:31.565128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:31.565128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:31.565128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:31.565128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:31.702510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:31.709999 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa002480-ffbb-4170-a149-6297f68e3d67 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1374 microversion: 2.1 time: 0.161096 Feb 12 21:39:31.710612 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2948/6029] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:31 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:32.729554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:32.730333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:32.737169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:32.737670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:32.738471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:32.738926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:32.882380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:32.889904 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-54c852a2-582c-4099-ad43-056e48806584 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1547 microversion: 2.1 time: 0.165316 Feb 12 21:39:32.890795 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3082/6030] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:32 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:32.906255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:32.906912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:32.914123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:32.914574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:32.915379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:32.915836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:33.051211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:33.059011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e464afb-aac7-45f8-a1e6-9950ddd307aa tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1547 microversion: 2.1 time: 0.156587 Feb 12 21:39:33.059572 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2949/6031] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:32 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:39:59.293440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:59.293951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:59.300698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:59.301616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:59.302004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:59.302465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:59.327707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:39:59.613728 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47525c90-f51c-4b58-929c-88dfa4b411a7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "DELETE /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 204 len: 0 microversion: 2.1 time: 0.323822 Feb 12 21:39:59.614338 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3083/6032] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:39:59 2022] DELETE /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:39:59.623278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:39:59.624136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:39:59.630695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:59.631147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:59.631968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:39:59.632412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:39:59.780954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:39:59.789607 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-03d00b07-e9f4-4c50-97ea-656527b111c9 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1553 microversion: 2.1 time: 0.170545 Feb 12 21:39:59.791379 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2950/6033] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:39:59 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:00.807583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:00.808330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:00.815946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:00.816417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:00.817225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:00.817702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:00.960734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:00.968557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2573016-2fe6-413f-99e4-23ae4a311fba tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1553 microversion: 2.1 time: 0.165066 Feb 12 21:40:00.969139 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3084/6034] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:00 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:01.437432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7e15522e-1217-4d6a-986b-24ca7149e087 req-80176072-8a5d-48c4-9bfa-a7afbd10cf7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f7327f-8b30-488e-9048-c297bf30ff10", "name": "network-vif-deleted", "tag": "453848aa-83df-40ec-be34-bb93babb1697"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:01.439606 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:40:01.439606 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:40:01.448393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7e15522e-1217-4d6a-986b-24ca7149e087 req-80176072-8a5d-48c4-9bfa-a7afbd10cf7e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:01.448846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7e15522e-1217-4d6a-986b-24ca7149e087 req-80176072-8a5d-48c4-9bfa-a7afbd10cf7e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:01.460796 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7e15522e-1217-4d6a-986b-24ca7149e087 req-80176072-8a5d-48c4-9bfa-a7afbd10cf7e service nova] Creating event network-vif-deleted:453848aa-83df-40ec-be34-bb93babb1697 for instance 85f7327f-8b30-488e-9048-c297bf30ff10 on nch2-master-1 Feb 12 21:40:01.466713 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7e15522e-1217-4d6a-986b-24ca7149e087 req-80176072-8a5d-48c4-9bfa-a7afbd10cf7e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Feb 12 21:40:01.467314 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2951/6035] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:40:01.985445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:01.986043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:01.993198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:01.993701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:01.994512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:01.994968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:02.026479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:02.027581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:02.028063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lazy-loading 'fault' on Instance uuid 85f7327f-8b30-488e-9048-c297bf30ff10 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:40:02.068587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:02.076079 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5bbf770-0169-4e97-9ae8-21bc816e32c1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 200 len: 1338 microversion: 2.1 time: 0.094446 Feb 12 21:40:02.076649 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3085/6036] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:01 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 1338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:03.095185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:03.096060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 85f7327f-8b30-488e-9048-c297bf30ff10] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:03.102357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:03.102821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:03.103620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:03.104067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:03.117321 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] HTTP exception thrown: Instance 85f7327f-8b30-488e-9048-c297bf30ff10 could not be found. Feb 12 21:40:03.117939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Returning 404 to user: Instance 85f7327f-8b30-488e-9048-c297bf30ff10 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:40:03.118761 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-be2eaf0f-38ad-43f3-83cc-22f45413d0e8 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10" status: 404 len: 111 microversion: 2.1 time: 0.028602 Feb 12 21:40:03.119299 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2952/6037] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:03 2022] GET /compute/v2.1/servers/85f7327f-8b30-488e-9048-c297bf30ff10 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:40:03.366348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7866c69f-fad4-42a8-b182-0fa3a5bbe187 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '.version_select at 0x7fa8fdddd790>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:03.465453 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7866c69f-fad4-42a8-b182-0fa3a5bbe187 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1539555058" status: 202 len: 0 microversion: 2.1 time: 0.102826 Feb 12 21:40:03.466051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3086/6038] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 21:40:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1539555058 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:40:05.428508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:05.434797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2023b760-95fd-480d-b74e-94273cfc5084 req-b40d13a9-1872-4824-b521-accb98b3a8bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a399fb8-d3f5-4c7c-81f1-393611926402", "tag": "3c9b8e09-7259-474b-9ca1-4ae67f8df397"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:05.435333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:05.440516 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:40:05.440516 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:40:05.442751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:05.443222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:05.444039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:05.444489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:05.448726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2023b760-95fd-480d-b74e-94273cfc5084 req-b40d13a9-1872-4824-b521-accb98b3a8bd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:05.449182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2023b760-95fd-480d-b74e-94273cfc5084 req-b40d13a9-1872-4824-b521-accb98b3a8bd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:05.460725 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2023b760-95fd-480d-b74e-94273cfc5084 req-b40d13a9-1872-4824-b521-accb98b3a8bd service nova] Creating event network-changed:3c9b8e09-7259-474b-9ca1-4ae67f8df397 for instance 2a399fb8-d3f5-4c7c-81f1-393611926402 on nch1-master-1 Feb 12 21:40:05.465967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2023b760-95fd-480d-b74e-94273cfc5084 req-b40d13a9-1872-4824-b521-accb98b3a8bd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035573 Feb 12 21:40:05.466707 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3087/6039] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:40:05.471901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:40:05.756118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-037cf573-2577-4089-8d36-cbb1dded959b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 204 len: 0 microversion: 2.1 time: 0.331009 Feb 12 21:40:05.756996 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2953/6040] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:40:05 2022] DELETE /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:40:05.765782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:05.767670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:05.776034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:05.776505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:05.777327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:05.777820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:05.927826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:05.936108 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-20de7eab-ab4d-4b1d-9020-e105391abbf0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1668 microversion: 2.1 time: 0.174561 Feb 12 21:40:05.936708 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3088/6041] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:05 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:06.954265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:06.955567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:06.962343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:06.962808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:06.963612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:06.964065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:07.101333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:07.108870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3aba660-8fa7-47a6-ab77-5fbe66d14714 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1550 microversion: 2.1 time: 0.158739 Feb 12 21:40:07.112477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2954/6042] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:06 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:07.840629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1c886c64-932e-440a-bc85-2fcdec7b0015 req-60558535-525d-44a8-933a-621c0570f2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a399fb8-d3f5-4c7c-81f1-393611926402", "name": "network-vif-deleted", "tag": "3c9b8e09-7259-474b-9ca1-4ae67f8df397"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:07.842242 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:40:07.842242 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:40:07.850438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1c886c64-932e-440a-bc85-2fcdec7b0015 req-60558535-525d-44a8-933a-621c0570f2f6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:07.850914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1c886c64-932e-440a-bc85-2fcdec7b0015 req-60558535-525d-44a8-933a-621c0570f2f6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:07.862971 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1c886c64-932e-440a-bc85-2fcdec7b0015 req-60558535-525d-44a8-933a-621c0570f2f6 service nova] Creating event network-vif-deleted:3c9b8e09-7259-474b-9ca1-4ae67f8df397 for instance 2a399fb8-d3f5-4c7c-81f1-393611926402 on nch1-master-1 Feb 12 21:40:07.867951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1c886c64-932e-440a-bc85-2fcdec7b0015 req-60558535-525d-44a8-933a-621c0570f2f6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Feb 12 21:40:07.868558 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3089/6043] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:40:08.126444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:08.127721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:08.134861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:08.135382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:08.136194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:08.136632 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:08.172481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:08.172933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:08.174167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lazy-loading 'fault' on Instance uuid 2a399fb8-d3f5-4c7c-81f1-393611926402 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:40:08.216979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:08.225734 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f0ffd5ff-76b4-4d9d-a665-2ce5fd371699 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 200 len: 1337 microversion: 2.1 time: 0.102983 Feb 12 21:40:08.226342 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2955/6044] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:08 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 1337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:09.244590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:09.245296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 2a399fb8-d3f5-4c7c-81f1-393611926402] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:09.251675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:09.252157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:09.252950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:09.253423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:09.266386 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] HTTP exception thrown: Instance 2a399fb8-d3f5-4c7c-81f1-393611926402 could not be found. Feb 12 21:40:09.266988 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Returning 404 to user: Instance 2a399fb8-d3f5-4c7c-81f1-393611926402 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:40:09.267818 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07cd0ea7-6cd4-47f2-852b-12d804baa223 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402" status: 404 len: 111 microversion: 2.1 time: 0.028198 Feb 12 21:40:09.268348 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3090/6045] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:09 2022] GET /compute/v2.1/servers/2a399fb8-d3f5-4c7c-81f1-393611926402 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:40:09.543722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-57494a68-30c0-4faa-8d8b-ece39dcb151e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '.version_select at 0x7fa907e278b0>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:09.608185 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-57494a68-30c0-4faa-8d8b-ece39dcb151e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-784952130" status: 202 len: 0 microversion: 2.1 time: 0.068203 Feb 12 21:40:09.608774 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2956/6046] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 21:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-784952130 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:40:19.449336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1672b161-f790-4202-b2e0-01816ce0ea0b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'create', calling method: .version_select at 0x7fa8fe92de50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-461100961"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:19.480489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-1672b161-f790-4202-b2e0-01816ce0ea0b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:40:19.485787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-1672b161-f790-4202-b2e0-01816ce0ea0b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:40:19.808675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-1672b161-f790-4202-b2e0-01816ce0ea0b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:40:19.814359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-1672b161-f790-4202-b2e0-01816ce0ea0b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:40:19.832379 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1672b161-f790-4202-b2e0-01816ce0ea0b tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.388685 Feb 12 21:40:19.834033 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3091/6047] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:40:19 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:22.295800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-270637792", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "943990ac-262a-4149-8fa7-2654ea21ed46"}], "key_name": "tempest-TestNetworkBasicOps-461100961", "security_groups": [{"name": "tempest-secgroup-smoke-768018408"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:22.401750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] validate_networks() for [('943990ac-262a-4149-8fa7-2654ea21ed46', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:40:22.774411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:40:22.774834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:40:22.775307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:40:22.775716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:40:22.776122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:40:22.784807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:22.785255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:22.786371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:22.786811 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:22.803782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:40:22.808999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Getting quotas for user 42dfc567002847f0be33fe4452d52af5 and project f545a02bc7de43f8894c9fd6fe7c85f6. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:40:22.821899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:40:22.824196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:40:22.951949 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51e21c76-420b-4c82-857a-26ded90504dd tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.661014 Feb 12 21:40:22.952593 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2957/6048] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:40:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:40:22.962394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9239b673-989f-4ddc-aec6-6fb8083c3a5d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:22.963020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9239b673-989f-4ddc-aec6-6fb8083c3a5d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:23.018121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9239b673-989f-4ddc-aec6-6fb8083c3a5d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:23.024986 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9239b673-989f-4ddc-aec6-6fb8083c3a5d tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1247 microversion: 2.1 time: 0.066355 Feb 12 21:40:23.025919 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3092/6049] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:22 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:24.043337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:24.043940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:24.050750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:24.051204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:24.051993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:24.052434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:24.114966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:24.122981 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b774fa76-bc90-4e18-b671-a3c55b701655 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1251 microversion: 2.1 time: 0.084425 Feb 12 21:40:24.123537 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2958/6050] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:24 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1251 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:25.140435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:25.141078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:25.147804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:25.148283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:25.150096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:25.150566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:25.212959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:25.220626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd3768f2-1e9f-4fa6-aac2-4f7b865131d0 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1317 microversion: 2.1 time: 0.084280 Feb 12 21:40:25.221202 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3093/6051] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:25 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1317 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:26.244608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:26.245281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:26.252459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:26.252997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:26.254001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:26.254549 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:26.480358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:26.488154 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f5ec9c2a-a338-436c-afa2-7eb42f2a8675 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.248750 Feb 12 21:40:26.488666 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2959/6052] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:26 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:26.581558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-49a76aea-0bea-4a8a-9957-ca9d7c9c0713 req-cd28c8ca-d7b9-4fce-be7b-41d573da7593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fdcf586-9a90-476e-93f3-192b165418b9", "tag": "8fb18dbb-f07c-4272-84b4-9b47fd3f92fe"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:26.583742 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:40:26.583742 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:40:26.593321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-49a76aea-0bea-4a8a-9957-ca9d7c9c0713 req-cd28c8ca-d7b9-4fce-be7b-41d573da7593 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:26.593805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-49a76aea-0bea-4a8a-9957-ca9d7c9c0713 req-cd28c8ca-d7b9-4fce-be7b-41d573da7593 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:26.605628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-49a76aea-0bea-4a8a-9957-ca9d7c9c0713 req-cd28c8ca-d7b9-4fce-be7b-41d573da7593 service nova] Creating event network-changed:8fb18dbb-f07c-4272-84b4-9b47fd3f92fe for instance 9fdcf586-9a90-476e-93f3-192b165418b9 on nch1-master-1 Feb 12 21:40:26.612404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-49a76aea-0bea-4a8a-9957-ca9d7c9c0713 req-cd28c8ca-d7b9-4fce-be7b-41d573da7593 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034529 Feb 12 21:40:26.613123 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3094/6053] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:40:27.505180 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:27.505844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:27.513090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:27.513565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:27.514606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:27.515017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:27.741333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:27.749571 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7a00e8c-a793-49a5-bd0d-c486e4c117ff tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.248083 Feb 12 21:40:27.750150 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2960/6054] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:27 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:28.768223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:28.768948 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:28.775487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:28.775959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:28.776758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:28.777211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:28.918002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:28.925325 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c2438658-fec3-41a3-a84e-ef86cb4d4cee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.162112 Feb 12 21:40:28.925921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3095/6055] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:28 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:29.942886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:29.943496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:29.952756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:29.952756 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:29.953166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:29.953582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:30.100616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:30.109012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0233983a-7761-45ac-b4a7-cf7f96c05c85 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.170025 Feb 12 21:40:30.109587 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2961/6056] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:29 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:31.125731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:31.126365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:31.133683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:31.134735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:31.135011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:31.135466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:31.268628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:31.276381 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31402c66-5cdc-4e97-9311-ee2d3e234b07 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.154560 Feb 12 21:40:31.276956 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3096/6057] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:31 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:32.292565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:32.293192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:32.300130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:32.300604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:32.301417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:32.301866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:32.437431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:32.445011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78e53e2e-25b6-4547-baf3-af4b7a34a07e tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.156184 Feb 12 21:40:32.445682 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2962/6058] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:32 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:33.462583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:33.463207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:33.469945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:33.470410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:33.471202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:33.476876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:33.609338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:33.620801 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b780f4cf-3172-4729-9f74-db2670c101cf tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.162512 Feb 12 21:40:33.621455 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3097/6059] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:33 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:40:33.834472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-42d92c70-cbd1-4ad1-9ae7-68b07e82b854 req-c45a5597-1877-442a-b0fb-d9bae41d0a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdcf586-9a90-476e-93f3-192b165418b9", "name": "network-vif-plugged", "status": "completed", "tag": "8fb18dbb-f07c-4272-84b4-9b47fd3f92fe"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:33.836047 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:40:33.836047 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:40:33.844025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-42d92c70-cbd1-4ad1-9ae7-68b07e82b854 req-c45a5597-1877-442a-b0fb-d9bae41d0a27 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:33.844966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-42d92c70-cbd1-4ad1-9ae7-68b07e82b854 req-c45a5597-1877-442a-b0fb-d9bae41d0a27 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:33.855842 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-42d92c70-cbd1-4ad1-9ae7-68b07e82b854 req-c45a5597-1877-442a-b0fb-d9bae41d0a27 service nova] Creating event network-vif-plugged:8fb18dbb-f07c-4272-84b4-9b47fd3f92fe for instance 9fdcf586-9a90-476e-93f3-192b165418b9 on nch1-master-1 Feb 12 21:40:33.860777 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-42d92c70-cbd1-4ad1-9ae7-68b07e82b854 req-c45a5597-1877-442a-b0fb-d9bae41d0a27 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030087 Feb 12 21:40:33.861518 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2963/6060] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:40:34.637728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:34.638388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:34.645323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:34.645824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:34.646625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:34.647080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:34.788020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:34.795715 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-30230a72-597c-4156-b16e-16190ab98429 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1372 microversion: 2.1 time: 0.161704 Feb 12 21:40:34.796279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3098/6061] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:34 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:35.813399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:35.814119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:35.820333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:35.820842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:35.821602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:35.822048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:35.960445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:35.968495 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-779c2755-e847-4e0a-a2bf-63a07f61cf72 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1543 microversion: 2.1 time: 0.160111 Feb 12 21:40:35.969088 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2964/6062] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:35 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1543 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:35.985000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:40:35.985662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:40:35.992565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:35.993035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:35.993872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:35.994328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:36.133932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:40:36.141938 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3623b1d-add0-4c16-b530-d7a344a44797 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1543 microversion: 2.1 time: 0.160660 Feb 12 21:40:36.142531 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3099/6063] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:40:35 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1543 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:40:38.141761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-aa8fc86d-c83c-4e43-b9b7-c9655ee2ac15 req-f97be9ac-5b12-4fcb-9398-3f1fd56b9cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fdcf586-9a90-476e-93f3-192b165418b9", "tag": "8fb18dbb-f07c-4272-84b4-9b47fd3f92fe"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:40:38.142349 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:40:38.142349 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:40:38.150647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-aa8fc86d-c83c-4e43-b9b7-c9655ee2ac15 req-f97be9ac-5b12-4fcb-9398-3f1fd56b9cab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:40:38.151763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-aa8fc86d-c83c-4e43-b9b7-c9655ee2ac15 req-f97be9ac-5b12-4fcb-9398-3f1fd56b9cab service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:40:38.162949 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-aa8fc86d-c83c-4e43-b9b7-c9655ee2ac15 req-f97be9ac-5b12-4fcb-9398-3f1fd56b9cab service nova] Creating event network-changed:8fb18dbb-f07c-4272-84b4-9b47fd3f92fe for instance 9fdcf586-9a90-476e-93f3-192b165418b9 on nch1-master-1 Feb 12 21:40:38.169082 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-aa8fc86d-c83c-4e43-b9b7-c9655ee2ac15 req-f97be9ac-5b12-4fcb-9398-3f1fd56b9cab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032388 Feb 12 21:40:38.170407 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2965/6064] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:02.445124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:02.446165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:02.453034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:02.453565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:02.454368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:02.454820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:02.505403 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f26db57c-13f3-4dcf-8cf9-91d2e54a1eb1 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9/action" status: 200 len: 24557 microversion: 2.1 time: 0.066729 Feb 12 21:41:02.506259 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3100/6065] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:41:02 2022] POST /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9/action => generated 24557 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:41:13.631401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:13.632650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:13.638787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:13.639247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:13.640035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:13.640741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:13.691709 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed78050a-1ebc-444b-b2b2-94a20f91586f tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "POST /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9/action" status: 200 len: 32629 microversion: 2.1 time: 0.065242 Feb 12 21:41:13.692350 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2966/6066] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:41:13 2022] POST /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9/action => generated 32629 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:41:14.793484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:14.794081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:14.795906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-58c672b3-3d53-44a0-96dd-e33d058fd881 req-038d4a17-94e9-4d66-b60f-06e4895ff2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fdcf586-9a90-476e-93f3-192b165418b9", "tag": "8fb18dbb-f07c-4272-84b4-9b47fd3f92fe"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:14.798381 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:14.798381 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:41:14.803753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:14.803753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:14.804569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:14.805199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:14.808107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-58c672b3-3d53-44a0-96dd-e33d058fd881 req-038d4a17-94e9-4d66-b60f-06e4895ff2fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:14.808651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-58c672b3-3d53-44a0-96dd-e33d058fd881 req-038d4a17-94e9-4d66-b60f-06e4895ff2fe service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:14.820822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-58c672b3-3d53-44a0-96dd-e33d058fd881 req-038d4a17-94e9-4d66-b60f-06e4895ff2fe service nova] Creating event network-changed:8fb18dbb-f07c-4272-84b4-9b47fd3f92fe for instance 9fdcf586-9a90-476e-93f3-192b165418b9 on nch1-master-1 Feb 12 21:41:14.826011 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-58c672b3-3d53-44a0-96dd-e33d058fd881 req-038d4a17-94e9-4d66-b60f-06e4895ff2fe service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034446 Feb 12 21:41:14.826934 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2967/6067] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:41:14.836425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:41:15.108967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fae7a3cc-9654-4330-8b6c-3a2d848cc017 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 204 len: 0 microversion: 2.1 time: 0.319824 Feb 12 21:41:15.110223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3101/6068] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:41:14 2022] DELETE /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:41:15.119866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:15.120910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:15.129786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:15.133622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:15.133622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:15.133622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:15.409005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:15.416970 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-97b40547-0381-4cf7-a69d-085d12f238ef tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1666 microversion: 2.1 time: 0.301817 Feb 12 21:41:15.418099 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2968/6069] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:15 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1666 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:16.435100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:16.435876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:16.444313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:16.444789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:16.445627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:16.446087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:16.586645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:16.595270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-889b5a25-e5e3-48ef-8658-f26adf4884ee tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1549 microversion: 2.1 time: 0.164037 Feb 12 21:41:16.595860 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3102/6070] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:16 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:17.145920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-8c58e70a-1cc0-4f58-ae2a-3726b460c2df req-6e7c356f-0665-4ea5-9cb6-597381038f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fdcf586-9a90-476e-93f3-192b165418b9", "name": "network-vif-deleted", "tag": "8fb18dbb-f07c-4272-84b4-9b47fd3f92fe"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:17.147442 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:17.147442 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:41:17.155913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8c58e70a-1cc0-4f58-ae2a-3726b460c2df req-6e7c356f-0665-4ea5-9cb6-597381038f24 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:17.156366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-8c58e70a-1cc0-4f58-ae2a-3726b460c2df req-6e7c356f-0665-4ea5-9cb6-597381038f24 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:17.167197 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-8c58e70a-1cc0-4f58-ae2a-3726b460c2df req-6e7c356f-0665-4ea5-9cb6-597381038f24 service nova] Creating event network-vif-deleted:8fb18dbb-f07c-4272-84b4-9b47fd3f92fe for instance 9fdcf586-9a90-476e-93f3-192b165418b9 on nch1-master-1 Feb 12 21:41:17.172790 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-8c58e70a-1cc0-4f58-ae2a-3726b460c2df req-6e7c356f-0665-4ea5-9cb6-597381038f24 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029752 Feb 12 21:41:17.173432 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2969/6071] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:17.612803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:17.613453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:17.620249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:17.620713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:17.621536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:17.621986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:17.652553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:17.653011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:17.653498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lazy-loading 'fault' on Instance uuid 9fdcf586-9a90-476e-93f3-192b165418b9 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:41:17.694357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42dfc567002847f0be33fe4452d52af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f545a02bc7de43f8894c9fd6fe7c85f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:17.704860 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-13cae65b-5cf7-40e6-8793-04a841a9fca6 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 200 len: 1337 microversion: 2.1 time: 0.096485 Feb 12 21:41:17.705664 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3103/6072] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:17 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 1337 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:18.724119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:18.724840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] [instance: 9fdcf586-9a90-476e-93f3-192b165418b9] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:18.731202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:18.731673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:18.732468 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:18.732919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:18.746093 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] HTTP exception thrown: Instance 9fdcf586-9a90-476e-93f3-192b165418b9 could not be found. Feb 12 21:41:18.746695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Returning 404 to user: Instance 9fdcf586-9a90-476e-93f3-192b165418b9 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:41:18.747558 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc0f7c78-6a94-4871-9a7b-6324cc9d2954 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9" status: 404 len: 111 microversion: 2.1 time: 0.029158 Feb 12 21:41:18.748105 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2970/6073] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:18 2022] GET /compute/v2.1/servers/9fdcf586-9a90-476e-93f3-192b165418b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:41:19.273907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb95ed9c-2248-4565-860b-5448b2b4e1c7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] Calling method '.version_select at 0x7fa8fded9d30>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:19.345304 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb95ed9c-2248-4565-860b-5448b2b4e1c7 tempest-TestNetworkBasicOps-2106163206 tempest-TestNetworkBasicOps-2106163206-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-461100961" status: 202 len: 0 microversion: 2.1 time: 0.075082 Feb 12 21:41:19.346061 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3104/6074] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 21:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-461100961 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:41:35.979376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1451645248", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:36.028933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] validate_networks() for None {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:41:36.300158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:41:36.300788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:41:36.301276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:41:36.304033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:41:36.304033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:41:36.311225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:36.311683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:36.313201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:36.313676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:36.330845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Getting quotas for project a7e2582d91da44ff8fd061ac7ad59fac. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:41:36.335965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Getting quotas for user 5300877c222a4c61aa42927a45a9010f and project a7e2582d91da44ff8fd061ac7ad59fac. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:41:36.347836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:41:36.350172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:41:36.447085 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-287e367e-6c31-4014-bab9-cbff049fdce3 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589551 Feb 12 21:41:36.447749 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2971/6075] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:41:36.459202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5c1e78b-cc74-4eec-bce9-56aecf64b173 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:36.459859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5c1e78b-cc74-4eec-bce9-56aecf64b173 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:36.516514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5c1e78b-cc74-4eec-bce9-56aecf64b173 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:36.523242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5c1e78b-cc74-4eec-bce9-56aecf64b173 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1222 microversion: 2.1 time: 0.068860 Feb 12 21:41:36.523855 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3105/6076] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:36 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:41:37.542315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:37.543034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:37.549723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:37.550183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:37.550975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:37.551422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:37.612623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:37.619903 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fc460e8c-83c5-436a-88f0-7810a9dfb312 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1226 microversion: 2.1 time: 0.082580 Feb 12 21:41:37.620476 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2972/6077] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:37 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:38.637026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:38.637687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:38.644582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:38.645332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:38.645887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:38.646369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:38.716583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:38.724544 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5a528584-791b-4ecf-bb72-60dc675f3cbd tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1292 microversion: 2.1 time: 0.091416 Feb 12 21:41:38.725390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3106/6078] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:38 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:39.746159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:39.746766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:39.754248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:39.754702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:39.755498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:39.755934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:40.318377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:40.325723 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7543c49-2be8-4351-a08e-2da59e33bd20 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.583549 Feb 12 21:41:40.326299 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2973/6079] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:39 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:41:40.485083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5c7385c1-b560-455b-91ee-654239cbdf22 req-4f0af14a-2585-4018-ab3d-07939c881834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9576da-3193-4974-97d9-1bca983fe50f", "tag": "4496ff8d-2f4e-4f43-9cf4-b92c52253e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:40.488751 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:40.488751 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:41:40.498298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5c7385c1-b560-455b-91ee-654239cbdf22 req-4f0af14a-2585-4018-ab3d-07939c881834 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:40.504390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5c7385c1-b560-455b-91ee-654239cbdf22 req-4f0af14a-2585-4018-ab3d-07939c881834 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:40.511952 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5c7385c1-b560-455b-91ee-654239cbdf22 req-4f0af14a-2585-4018-ab3d-07939c881834 service nova] Creating event network-changed:4496ff8d-2f4e-4f43-9cf4-b92c52253e9a for instance 7a9576da-3193-4974-97d9-1bca983fe50f on nch1-master-1 Feb 12 21:41:40.517408 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5c7385c1-b560-455b-91ee-654239cbdf22 req-4f0af14a-2585-4018-ab3d-07939c881834 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036453 Feb 12 21:41:40.518708 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3107/6080] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:41.342155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:41.342774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:41.349555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:41.350013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:41.350808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:41.351250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:41.483984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:41.491383 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e003bb7-7e14-4578-9b08-68c7cb1ef8b6 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.152959 Feb 12 21:41:41.492599 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2974/6081] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:41 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:41:42.510174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:42.510912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:42.517177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:42.517689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:42.518467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:42.518918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:42.650157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:42.657419 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-22e1aab3-7ec2-498d-a45e-6be6596ee27b tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.152215 Feb 12 21:41:42.658071 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3108/6082] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:42 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:43.675039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:43.675725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:43.682653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:43.683118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:43.683922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:43.684367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:43.822872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:43.830165 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b78fdadf-aabb-486e-8f5a-6a90b9ad6027 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.159557 Feb 12 21:41:43.831293 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2975/6083] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:43 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:44.847869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:44.848495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:44.855425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:44.855896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:44.856695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:44.857146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:44.992892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:45.000258 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-15f34707-01db-4093-a691-90cd88998c13 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.156376 Feb 12 21:41:45.000895 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3109/6084] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:44 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:46.018937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:46.019583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:46.026446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:46.029207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:46.029207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:46.029207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:46.166251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:46.173828 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-726578e0-12ba-43cc-9a7b-a9fe5bb1d72e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.159276 Feb 12 21:41:46.175251 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2976/6085] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:46 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:46.228321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a7c16e81-25a6-4607-a383-7826e2ad1248 req-27db7679-d581-4cea-8096-d6540b44d290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9576da-3193-4974-97d9-1bca983fe50f", "name": "network-vif-plugged", "status": "completed", "tag": "4496ff8d-2f4e-4f43-9cf4-b92c52253e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:46.232316 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:46.232316 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:41:46.237730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a7c16e81-25a6-4607-a383-7826e2ad1248 req-27db7679-d581-4cea-8096-d6540b44d290 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:46.238282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a7c16e81-25a6-4607-a383-7826e2ad1248 req-27db7679-d581-4cea-8096-d6540b44d290 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:46.249276 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a7c16e81-25a6-4607-a383-7826e2ad1248 req-27db7679-d581-4cea-8096-d6540b44d290 service nova] Creating event network-vif-plugged:4496ff8d-2f4e-4f43-9cf4-b92c52253e9a for instance 7a9576da-3193-4974-97d9-1bca983fe50f on nch1-master-1 Feb 12 21:41:46.254969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a7c16e81-25a6-4607-a383-7826e2ad1248 req-27db7679-d581-4cea-8096-d6540b44d290 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103440 Feb 12 21:41:46.256812 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3110/6086] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:47.191037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:47.191688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:47.198405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:47.198858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:47.199647 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:47.200084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:47.331879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:47.339287 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d413dd3-531e-4110-9d9d-49b382d3fc7e tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1322 microversion: 2.1 time: 0.152446 Feb 12 21:41:47.339860 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2977/6087] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:47 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:48.356336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:48.357052 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:48.364188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:48.364696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:48.365488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:48.365949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:48.497594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:48.505802 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e33fec42-928f-4c8a-8821-640e2c605870 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1472 microversion: 2.1 time: 0.154326 Feb 12 21:41:48.506387 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3111/6088] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:48 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:48.572136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e4a02d0-517d-4419-b50c-e487eee0e16c tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Calling method '.version_select at 0x7fa8fd152d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:48.636462 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e4a02d0-517d-4419-b50c-e487eee0e16c tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/5e84d994fcf84d8ba1a97576ab86d737" status: 200 len: 371 microversion: 2.1 time: 0.116245 Feb 12 21:41:48.637025 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2978/6089] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:41:48 2022] GET /compute/v2.1/os-quota-sets/5e84d994fcf84d8ba1a97576ab86d737 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:48.647634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0d9177df-d8ba-43c8-a494-96669d529642 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-120084480", "id": 1627906255, "os-flavor-access:is_public": "True"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:48.649229 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:48.649229 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:41:48.748753 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0d9177df-d8ba-43c8-a494-96669d529642 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.104711 Feb 12 21:41:48.749561 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3112/6090] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:41:48 2022] POST /compute/v2.1/flavors => generated 437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:48.760413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1627906255"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:48.761433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:48.767584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:48.769034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:48.769034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:48.769448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:48.855240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3f8957ebed2343e7a32d28abff1c6803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e84d994fcf84d8ba1a97576ab86d737', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:48.862931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-120084480 {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:41:48.863903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:48.864362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:48.865193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:48.865676 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:48.886023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Getting quotas for project a7e2582d91da44ff8fd061ac7ad59fac. Resources: {'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:41:48.890918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Getting quotas for user 5300877c222a4c61aa42927a45a9010f and project a7e2582d91da44ff8fd061ac7ad59fac. Resources: {'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:41:48.903178 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.compute.api [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] ram quota exceeded for 5e84d994fcf84d8ba1a97576ab86d737, tried to resize instance. Feb 12 21:41:48.903733 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Feb 12 21:41:48.904355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:41:48.905187 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54a0e0cd-9245-4e34-86d5-4e6a6ec583b1 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f/action" status: 403 len: 118 microversion: 2.1 time: 0.148798 Feb 12 21:41:48.905794 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2979/6091] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:41:48 2022] POST /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f/action => generated 118 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:41:48.915071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-12cd591f-2e4b-4ee7-a876-962ad0d0ecf4 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:48.915836 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:48.915836 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:41:48.982698 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-12cd591f-2e4b-4ee7-a876-962ad0d0ecf4 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/1627906255" status: 202 len: 0 microversion: 2.1 time: 0.071552 Feb 12 21:41:48.983271 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3113/6092] 10.222.0.31 () {58 vars in 1160 bytes} [Sat Feb 12 21:41:48 2022] DELETE /compute/v2.1/flavors/1627906255 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:41:48.991928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7878139-a16e-417a-8964-ab3dbeff352b tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:49.010222 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7878139-a16e-417a-8964-ab3dbeff352b tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021923 Feb 12 21:41:49.011713 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2980/6093] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:41:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:49.026879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e562c869-0e27-4488-807b-f16dc617d09c tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Calling method '.version_select at 0x7fa8fdf0eca0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:49.094757 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e562c869-0e27-4488-807b-f16dc617d09c tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "GET /compute/v2.1/os-quota-sets/5e84d994fcf84d8ba1a97576ab86d737" status: 200 len: 371 microversion: 2.1 time: 0.071552 Feb 12 21:41:49.095334 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3114/6094] 10.222.0.31 () {58 vars in 1241 bytes} [Sat Feb 12 21:41:49 2022] GET /compute/v2.1/os-quota-sets/5e84d994fcf84d8ba1a97576ab86d737 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:49.105945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81704634-6c79-4db3-a88d-04f47cdb6e4e tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1499971755", "id": 68181995, "os-flavor-access:is_public": "True"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:49.107516 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:49.107516 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:41:49.160139 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81704634-6c79-4db3-a88d-04f47cdb6e4e tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.057827 Feb 12 21:41:49.160728 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2981/6095] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:41:49 2022] POST /compute/v2.1/flavors => generated 431 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:49.171888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "68181995"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:49.172981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:49.179202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.179703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.180503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.180958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.269931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3f8957ebed2343e7a32d28abff1c6803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e84d994fcf84d8ba1a97576ab86d737', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:49.276183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1499971755 {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:41:49.277267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.277756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.278604 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.279054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.300254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Getting quotas for project a7e2582d91da44ff8fd061ac7ad59fac. Resources: {'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:41:49.305114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Getting quotas for user 5300877c222a4c61aa42927a45a9010f and project a7e2582d91da44ff8fd061ac7ad59fac. Resources: {'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:41:49.317471 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] cores quota exceeded for 5e84d994fcf84d8ba1a97576ab86d737, tried to resize instance. Feb 12 21:41:49.318024 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Feb 12 21:41:49.318628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:41:49.319478 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-337f3e3f-cf03-447f-9f58-152cc4f0c3e9 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "POST /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f/action" status: 403 len: 113 microversion: 2.1 time: 0.151536 Feb 12 21:41:49.320060 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3115/6096] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:41:49 2022] POST /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f/action => generated 113 bytes in 153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:41:49.328187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a7e458c-e21e-4106-9a9d-2ffcdc81b302 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:49.328981 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:49.328981 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:41:49.405813 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a7e458c-e21e-4106-9a9d-2ffcdc81b302 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "DELETE /compute/v2.1/flavors/68181995" status: 202 len: 0 microversion: 2.1 time: 0.081243 Feb 12 21:41:49.406381 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2982/6097] 10.222.0.31 () {58 vars in 1154 bytes} [Sat Feb 12 21:41:49 2022] DELETE /compute/v2.1/flavors/68181995 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:41:49.414556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f66ea13c-eb11-45c7-8e82-93f86a3a0799 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:49.434583 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f66ea13c-eb11-45c7-8e82-93f86a3a0799 tempest-ServersAdminNegativeTestJSON-341308634 tempest-ServersAdminNegativeTestJSON-341308634-project-admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023851 Feb 12 21:41:49.435153 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3116/6098] 10.222.0.31 () {58 vars in 1145 bytes} [Sat Feb 12 21:41:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:49.456436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:49.456937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:49.463089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.463542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.464323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.464764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.490181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:41:49.732000 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3557affa-98e1-487f-bb26-a501a73208c7 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "DELETE /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 204 len: 0 microversion: 2.1 time: 0.279056 Feb 12 21:41:49.732631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2983/6099] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:41:49 2022] DELETE /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:41:49.741172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:49.742682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:49.748269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.748746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.749584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:49.750040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:49.888349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:49.896529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-66dd7078-bad4-480e-8299-dcc6c0f0ab7d tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1478 microversion: 2.1 time: 0.159684 Feb 12 21:41:49.897094 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3117/6100] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:49 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:50.915042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:50.915746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:50.923242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:50.923693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:50.924488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:50.924926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:51.059233 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:51.067513 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a8d0ab0-7e9a-4431-9bad-d198b5d8ff23 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1478 microversion: 2.1 time: 0.156849 Feb 12 21:41:51.068087 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2984/6101] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:50 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:51.582020 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:41:51.582591 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 21:41:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:41:51.694342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2ff2bee5-7adb-4417-8fd3-3cab8d138a3c req-86f5a001-ddc2-4452-bce5-4c653bdbc9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9576da-3193-4974-97d9-1bca983fe50f", "name": "network-vif-deleted", "tag": "4496ff8d-2f4e-4f43-9cf4-b92c52253e9a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:51.696138 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:41:51.696138 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:41:51.704822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2ff2bee5-7adb-4417-8fd3-3cab8d138a3c req-86f5a001-ddc2-4452-bce5-4c653bdbc9bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:51.714820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2ff2bee5-7adb-4417-8fd3-3cab8d138a3c req-86f5a001-ddc2-4452-bce5-4c653bdbc9bb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:51.722932 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2ff2bee5-7adb-4417-8fd3-3cab8d138a3c req-86f5a001-ddc2-4452-bce5-4c653bdbc9bb service nova] Creating event network-vif-deleted:4496ff8d-2f4e-4f43-9cf4-b92c52253e9a for instance 7a9576da-3193-4974-97d9-1bca983fe50f on nch1-master-1 Feb 12 21:41:51.728064 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2ff2bee5-7adb-4417-8fd3-3cab8d138a3c req-86f5a001-ddc2-4452-bce5-4c653bdbc9bb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038998 Feb 12 21:41:51.728673 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3118/6102] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:41:52.083730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:52.084318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:52.091360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:52.091810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:52.092592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:52.093032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:52.124706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:52.125174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:52.125673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lazy-loading 'fault' on Instance uuid 7a9576da-3193-4974-97d9-1bca983fe50f {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:41:52.166713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5300877c222a4c61aa42927a45a9010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e2582d91da44ff8fd061ac7ad59fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:52.174656 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dbbf42ba-87ac-4cb1-b456-10b51998916a tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 200 len: 1312 microversion: 2.1 time: 0.094210 Feb 12 21:41:52.175218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2985/6103] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:52 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:53.193078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:53.193897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] [instance: 7a9576da-3193-4974-97d9-1bca983fe50f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:53.200293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:53.200773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:53.201614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:53.202079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:53.216850 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] HTTP exception thrown: Instance 7a9576da-3193-4974-97d9-1bca983fe50f could not be found. Feb 12 21:41:53.217701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] Returning 404 to user: Instance 7a9576da-3193-4974-97d9-1bca983fe50f could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:41:53.218666 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-051c7c9d-317a-47d9-9c9a-a625c569ab81 tempest-ServersAdminNegativeTestJSON-1044495522 tempest-ServersAdminNegativeTestJSON-1044495522-project] 10.222.0.31 "GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f" status: 404 len: 111 microversion: 2.1 time: 0.031236 Feb 12 21:41:53.219358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3119/6104] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:53 2022] GET /compute/v2.1/servers/7a9576da-3193-4974-97d9-1bca983fe50f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:41:57.369077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-869913565", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "a4e217e8-4eaa-4286-aa39-7bd26aa4358d"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:41:57.544914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] validate_networks() for [('a4e217e8-4eaa-4286-aa39-7bd26aa4358d', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:41:57.890987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:41:57.891420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:41:57.891903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:41:57.892320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:41:57.892831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:41:57.901672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:57.902134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:57.902996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:57.903435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:57.922578 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Getting quotas for project d2b54f558c2c445b99be2f5aed7559a7. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:41:57.928172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Getting quotas for user 96c5d7d3c23f477abe0e45a825f43c3c and project d2b54f558c2c445b99be2f5aed7559a7. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:41:57.940451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:41:57.942828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:41:58.058987 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-12532eb1-8885-41fa-ae6b-8ebcab6ad9aa tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804675 Feb 12 21:41:58.063639 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2986/6105] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:41:58.069958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26768997-b0d2-4f06-83a2-6d9f00b8a630 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:58.070589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-26768997-b0d2-4f06-83a2-6d9f00b8a630 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:58.130070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-26768997-b0d2-4f06-83a2-6d9f00b8a630 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:58.137022 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-26768997-b0d2-4f06-83a2-6d9f00b8a630 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1214 microversion: 2.1 time: 0.070911 Feb 12 21:41:58.137660 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3120/6106] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:58 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:41:59.155753 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:41:59.156367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:41:59.166427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:59.166879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:59.167664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:41:59.168101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:41:59.232546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:41:59.241065 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-297fcd7c-cc49-4067-a098-a31d6a0e36db tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1218 microversion: 2.1 time: 0.089995 Feb 12 21:41:59.241690 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2987/6107] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:41:59 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:00.258718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:00.259387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:00.267602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:00.268079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:00.268897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:00.270197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:00.332626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:00.339130 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-43d64fa2-9c0b-4a59-a4da-bea476260dc7 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1284 microversion: 2.1 time: 0.084980 Feb 12 21:42:00.339708 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3121/6108] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:00 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:01.357044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:01.357814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:01.364759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:01.365288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:01.366204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:01.366719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:01.576309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:01.583791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c47701ec-922c-4331-bff9-8f4d6490915d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.230546 Feb 12 21:42:01.584296 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2988/6109] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:01 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:01.683343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6a49c67f-564a-4ada-8e2f-d2323807016a req-109ac49d-4c79-48db-8466-56a8c5b44713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa6fadb-9f44-4d5e-905d-df5733a298c4", "tag": "0b716239-d15e-4a58-bba7-701ee08e7396"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:01.684961 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:01.684961 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:42:01.693384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6a49c67f-564a-4ada-8e2f-d2323807016a req-109ac49d-4c79-48db-8466-56a8c5b44713 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:01.697220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6a49c67f-564a-4ada-8e2f-d2323807016a req-109ac49d-4c79-48db-8466-56a8c5b44713 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:01.714244 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6a49c67f-564a-4ada-8e2f-d2323807016a req-109ac49d-4c79-48db-8466-56a8c5b44713 service nova] Creating event network-changed:0b716239-d15e-4a58-bba7-701ee08e7396 for instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 on nch1-master-1 Feb 12 21:42:01.719439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6a49c67f-564a-4ada-8e2f-d2323807016a req-109ac49d-4c79-48db-8466-56a8c5b44713 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039938 Feb 12 21:42:01.720071 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3122/6110] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:02.600961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:02.601602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:02.608377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:02.608833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:02.609653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:02.610099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:02.743592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:02.751082 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d7844eff-a1fe-4c9f-844b-7eb79bd7ef3b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.154166 Feb 12 21:42:02.751657 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2989/6111] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:02 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:03.769817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:03.770555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:03.776799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:03.777269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:03.778097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:03.778543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:03.913470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:03.920987 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e39978e-f31b-47f8-8a85-4229618fb0f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.156485 Feb 12 21:42:03.921598 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3123/6112] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:03 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:04.938596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:04.939214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:04.946903 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:04.947336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:04.948124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:04.948564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:05.087131 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:05.094922 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5130de9e-aac7-4aae-8aab-d02fa39cfd61 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.159917 Feb 12 21:42:05.095502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2990/6113] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:04 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:06.112507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:06.113190 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:06.120291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:06.120698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:06.121541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:06.122111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:06.263213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:06.272399 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6ab8057d-c4a1-4bdc-89d5-59f7a8ca6324 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.163640 Feb 12 21:42:06.280280 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3124/6114] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:06 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:07.290663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:07.291283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:07.298256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:07.298719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:07.299506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:07.299950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:07.431425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:07.438931 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc9a6b58-7c5a-45e7-9413-3c53b9b25346 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.152312 Feb 12 21:42:07.439501 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2991/6115] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:07 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:08.258937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-de39081a-5475-4e80-93d3-146a61d5c59b req-f934d6b8-d8ed-4d1f-b171-87a6075a494f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa6fadb-9f44-4d5e-905d-df5733a298c4", "name": "network-vif-plugged", "status": "completed", "tag": "0b716239-d15e-4a58-bba7-701ee08e7396"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:08.260446 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:08.260446 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:42:08.268348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-de39081a-5475-4e80-93d3-146a61d5c59b req-f934d6b8-d8ed-4d1f-b171-87a6075a494f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:08.268801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-de39081a-5475-4e80-93d3-146a61d5c59b req-f934d6b8-d8ed-4d1f-b171-87a6075a494f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:08.280258 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-de39081a-5475-4e80-93d3-146a61d5c59b req-f934d6b8-d8ed-4d1f-b171-87a6075a494f service nova] Creating event network-vif-plugged:0b716239-d15e-4a58-bba7-701ee08e7396 for instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 on nch1-master-1 Feb 12 21:42:08.285027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-de39081a-5475-4e80-93d3-146a61d5c59b req-f934d6b8-d8ed-4d1f-b171-87a6075a494f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029836 Feb 12 21:42:08.285650 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3125/6116] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:08.456094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:08.457268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:08.464286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:08.464758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:08.465583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:08.466034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:08.599272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:08.606543 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ba709d1-557c-4964-ba2d-2b3b1d5a9bca tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1314 microversion: 2.1 time: 0.154435 Feb 12 21:42:08.607099 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2992/6117] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:08 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:09.625481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:09.626197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:09.633455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:09.633924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:09.634725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:09.635710 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:09.771696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:09.779290 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2f8e617b-3746-4bc8-a459-64f27c8af331 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1500 microversion: 2.1 time: 0.158899 Feb 12 21:42:09.779856 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3126/6118] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:09 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:09.796247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:09.797312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:09.804926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:09.805417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:09.806213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:09.806655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:09.883968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:09.890273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Old instance type m1.heat2, new instance type m1.heat {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:42:09.896412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:42:09.896843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:42:09.897326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:42:09.897768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:42:09.898185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:42:10.123744 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4c238978-9598-4bce-a861-ecd7f99f6efc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "POST /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4/action" status: 202 len: 0 microversion: 2.1 time: 0.331250 Feb 12 21:42:10.124362 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2993/6119] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:42:09 2022] POST /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:42:10.132812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:10.133492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:10.139450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:10.139916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:10.140721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:10.141180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:10.279030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:10.287288 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5800169c-eb48-48a0-81fe-45d8768c1fd4 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1509 microversion: 2.1 time: 0.158538 Feb 12 21:42:10.288126 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3127/6120] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:10 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:11.306077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:11.306624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:11.313510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:11.313965 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:11.314755 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:11.315193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:11.454768 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:11.462293 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1e44dbc6-546e-42f0-8a36-4a68b01b6257 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1509 microversion: 2.1 time: 0.160862 Feb 12 21:42:11.462864 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2994/6121] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:11 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:12.479419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:12.480046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:12.487013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:12.487532 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:12.488344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:12.488801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:12.624587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:12.633251 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3428c8af-13c4-41a9-bb64-f9deb25816b5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1509 microversion: 2.1 time: 0.157599 Feb 12 21:42:12.633884 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3128/6122] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:12 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:13.651047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:13.651668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:13.658702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:13.659255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:13.660061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:13.660508 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:13.805817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:13.813338 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-791e7b93-36de-4889-914c-e5a33ed132f5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.166988 Feb 12 21:42:13.813940 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2995/6123] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:13 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:14.831095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:14.831711 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:14.838995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:14.844126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:14.844126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:14.844126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:15.054290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:15.062087 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6f382c79-4ec5-44b9-9573-d1a95f35d86b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.234759 Feb 12 21:42:15.062674 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3129/6124] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:14 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:16.078966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:16.079512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:16.087457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:16.091720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:16.091720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:16.091720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:16.223809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:16.232106 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0bdc5662-41d6-4046-93db-7ca0f26127a2 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.156951 Feb 12 21:42:16.232707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2996/6125] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:16 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:17.249760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:17.250395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:17.258076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:17.258542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:17.259376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:17.259832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:17.412493 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:17.420686 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cce1030-e422-481a-a68c-aa430da155dd tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.174738 Feb 12 21:42:17.421269 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3130/6126] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:17 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:18.438494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:18.439102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:18.446577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:18.447027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:18.447816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:18.448252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:18.583033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:18.591232 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-38938db1-b920-4ee1-986a-d028723e1d43 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.156456 Feb 12 21:42:18.591808 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2997/6127] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:18 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:19.607880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:19.608505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:19.615454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:19.615938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:19.616741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:19.617197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:19.762391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:19.765281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d4aacf03-471b-4942-9f5b-efefc105d548 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.161149 Feb 12 21:42:19.765892 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3131/6128] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:19 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:20.783019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:20.783640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:20.791015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:20.791478 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:20.792437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:20.792888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:20.929920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:20.937523 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b0c7d918-a692-4853-bca0-6ca2ed21c57d tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.158138 Feb 12 21:42:20.938106 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2998/6129] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:20 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:21.955037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:21.955669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:21.962599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:21.963077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:21.963883 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:21.964341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:22.097977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:22.106398 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-43205909-62b7-4377-b0c7-a2e5ff121fbf tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.155160 Feb 12 21:42:22.108163 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3132/6130] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:21 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:23.123955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:23.124592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:23.132313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:23.132770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:23.133606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:23.134053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:23.270900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:23.278707 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-84647aa8-845a-43f8-b802-7a60093c1fbc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.158570 Feb 12 21:42:23.279287 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 2999/6131] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:23 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:24.295859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:24.296492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:24.303813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:24.304287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:24.305097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:24.305583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:24.436278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:24.444189 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9be7b57c-5c5f-4588-9111-a579a20f9021 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.151510 Feb 12 21:42:24.444868 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3133/6132] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:24 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:25.462331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:25.462932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:25.469325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:25.469810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:25.470602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:25.471044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:25.608083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:25.615889 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-912c757c-519b-4117-998f-bba09de06c57 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.158347 Feb 12 21:42:25.616504 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3000/6133] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:25 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:26.633973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:26.634717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:26.641568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:26.642034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:26.642824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:26.643270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:26.780388 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:26.788163 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a49ed7d4-0a3b-472f-b3a7-822581aa7ff8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.158285 Feb 12 21:42:26.788735 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3134/6134] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:26 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:27.805960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:27.806575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:27.813373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:27.813831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:27.814979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:27.815422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:27.951281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:27.958625 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2800bad9-c45b-4243-b837-2760efd9b0c1 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.157333 Feb 12 21:42:27.959284 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3001/6135] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:27 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:28.975117 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:28.975795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:28.982617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:28.983086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:28.983887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:28.984344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:29.116757 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:29.124481 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4091a6b4-7743-4b90-988c-79bb9cc28c5f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.153215 Feb 12 21:42:29.125886 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3135/6136] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:28 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:30.141740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:30.142356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:30.149451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:30.149918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:30.150707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:30.151151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:30.289894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:30.297267 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-99d2e635-b303-45f2-9151-a50a81038361 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.159319 Feb 12 21:42:30.297867 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3002/6137] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:30 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:31.314130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:31.314755 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:31.322267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:31.322733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:31.323553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:31.324003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:31.460464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:31.468286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-44569804-4851-4a04-8f6b-637f43a21f28 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.157930 Feb 12 21:42:31.468864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3136/6138] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:31 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:32.485469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:32.486012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:32.493678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:32.494132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:32.494971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:32.495409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:32.629332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:32.636815 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e4c45f8-f386-4f2c-8b59-7b23fe25dcb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.155180 Feb 12 21:42:32.637403 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3003/6139] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:32 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:33.653765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:33.654387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:33.661339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:33.661837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:33.662638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:33.663440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:33.805156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:33.812863 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c49bb374-8f8b-4a2f-ae16-4e5adde1164a tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.162875 Feb 12 21:42:33.813454 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3137/6140] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:33 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:34.829898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:34.830531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:34.837697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:34.838163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:34.838962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:34.839408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:34.975149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:34.983219 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-10b401cd-4441-44b7-85b3-7ccf31b202c8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.157017 Feb 12 21:42:34.983800 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3004/6141] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:34 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:36.000926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:36.001501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:36.008543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:36.009005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:36.009826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:36.010307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:36.146981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:36.155607 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d35f2624-3e90-4697-a1c2-9b72305e6eb3 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.158517 Feb 12 21:42:36.158763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3138/6142] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:35 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:37.174057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:37.174845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:37.182457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:37.182917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:37.183918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:37.184357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:37.322138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:37.329696 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2a3011df-ff31-4b86-8bd6-2302deab16c9 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.159298 Feb 12 21:42:37.330306 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3005/6143] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:37 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:38.346578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:38.347210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:38.354833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:38.355303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:38.356102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:38.356555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:38.488675 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:38.496320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8582a5ec-e48a-4ec3-9b6c-3e0e9a0d2b17 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.153476 Feb 12 21:42:38.496898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3139/6144] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:38 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:39.513312 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:39.513934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:39.523973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:39.524464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:39.525265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:39.525749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:39.659308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:39.667822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e20baca8-dc59-4996-8cd1-c34423a535be tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1514 microversion: 2.1 time: 0.158311 Feb 12 21:42:39.668398 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3006/6145] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:39 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:40.684860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:40.685660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:40.692450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:40.692920 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:40.693750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:40.694208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:40.834578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:40.842320 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3c003683-dafc-4cdf-bcd0-d7da852ce0cb tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1513 microversion: 2.1 time: 0.161250 Feb 12 21:42:40.843096 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3140/6146] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:40 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:41.381137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b25f418b-2860-47c8-b12b-16199958eaa6 req-8e1d7bd8-4f8c-494e-a967-8c1db3fb1103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa6fadb-9f44-4d5e-905d-df5733a298c4", "name": "network-vif-unplugged", "status": "completed", "tag": "0b716239-d15e-4a58-bba7-701ee08e7396"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:41.383126 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:41.383126 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:42:41.391332 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b25f418b-2860-47c8-b12b-16199958eaa6 req-8e1d7bd8-4f8c-494e-a967-8c1db3fb1103 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:41.391810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b25f418b-2860-47c8-b12b-16199958eaa6 req-8e1d7bd8-4f8c-494e-a967-8c1db3fb1103 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:41.406691 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b25f418b-2860-47c8-b12b-16199958eaa6 req-8e1d7bd8-4f8c-494e-a967-8c1db3fb1103 service nova] Creating event network-vif-unplugged:0b716239-d15e-4a58-bba7-701ee08e7396 for instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 on nch2-master-1 Feb 12 21:42:41.412116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-b25f418b-2860-47c8-b12b-16199958eaa6 req-8e1d7bd8-4f8c-494e-a967-8c1db3fb1103 service nova] Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:42:41.424316 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b25f418b-2860-47c8-b12b-16199958eaa6 req-8e1d7bd8-4f8c-494e-a967-8c1db3fb1103 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046898 Feb 12 21:42:41.424902 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3007/6147] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:41.861406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:41.862007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:41.870098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:41.870568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:41.871588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:41.872425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:42.020459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:42.028232 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-70d9d4d5-9e50-4f97-8eac-ceada9f224dc tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1513 microversion: 2.1 time: 0.170721 Feb 12 21:42:42.028819 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3141/6148] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:41 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:42:43.046123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:43.046766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:43.053900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:43.054387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:43.055192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:43.055631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:43.189906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:43.198702 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e062efaa-f51b-4383-b476-31978e287d97 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1511 microversion: 2.1 time: 0.156751 Feb 12 21:42:43.199379 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3008/6149] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:43 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:43.438847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5c8ff51d-b0cd-4be3-852d-3cbf2240e992 req-e09e0dd2-5fd1-4a6d-9fc1-b0e4a18ec3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa6fadb-9f44-4d5e-905d-df5733a298c4", "tag": "0b716239-d15e-4a58-bba7-701ee08e7396"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:43.440403 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:43.440403 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:42:43.448888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5c8ff51d-b0cd-4be3-852d-3cbf2240e992 req-e09e0dd2-5fd1-4a6d-9fc1-b0e4a18ec3db service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:43.449379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5c8ff51d-b0cd-4be3-852d-3cbf2240e992 req-e09e0dd2-5fd1-4a6d-9fc1-b0e4a18ec3db service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:43.460905 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5c8ff51d-b0cd-4be3-852d-3cbf2240e992 req-e09e0dd2-5fd1-4a6d-9fc1-b0e4a18ec3db service nova] Creating event network-changed:0b716239-d15e-4a58-bba7-701ee08e7396 for instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 on nch2-master-1 Feb 12 21:42:43.466688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-5c8ff51d-b0cd-4be3-852d-3cbf2240e992 req-e09e0dd2-5fd1-4a6d-9fc1-b0e4a18ec3db service nova] Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:42:43.477989 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5c8ff51d-b0cd-4be3-852d-3cbf2240e992 req-e09e0dd2-5fd1-4a6d-9fc1-b0e4a18ec3db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043072 Feb 12 21:42:43.478590 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3142/6150] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:44.216793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:44.217521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:44.224643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:44.225095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:44.225927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:44.226438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:44.692742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:44.701319 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e500d578-4297-4d31-b8a2-07c0dbeb6fb8 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1508 microversion: 2.1 time: 0.488279 Feb 12 21:42:44.702529 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3009/6151] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:44 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:42:44.720144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:44.720923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:44.727702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:44.728217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:44.729069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:44.729620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:44.756302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:42:44.872880 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.compute.api [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Found an unconfirmed migration during delete, id: 16, status: finished Feb 12 21:42:46.828765 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-32acdea3-9967-4a4a-9537-2343bddbb4e5 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "DELETE /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 204 len: 0 microversion: 2.1 time: 2.113362 Feb 12 21:42:46.829486 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3143/6152] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:42:44 2022] DELETE /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 0 bytes in 2115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:42:46.837604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:46.838215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:46.844932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:46.845416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:46.846219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:46.846663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:46.979030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:46.986403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b123418-8357-45fc-bcc8-37182fbc5157 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1500 microversion: 2.1 time: 0.152735 Feb 12 21:42:46.986974 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3010/6153] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:46 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:48.004726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:48.005375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:48.013889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:48.014365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:48.015213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:48.015676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:48.154525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c5d7d3c23f477abe0e45a825f43c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b54f558c2c445b99be2f5aed7559a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:48.162692 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-34e93223-a077-4e24-96f7-d08329950c7f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 200 len: 1500 microversion: 2.1 time: 0.162144 Feb 12 21:42:48.163687 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3144/6154] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:47 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 1500 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:48.175991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f4ed4d52-541a-4c91-8dae-8ba139ab7d1e req-b026ff32-72d6-4997-bcc5-216ace30c35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa6fadb-9f44-4d5e-905d-df5733a298c4", "name": "network-vif-plugged", "status": "completed", "tag": "0b716239-d15e-4a58-bba7-701ee08e7396"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:48.181673 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:48.181673 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:42:48.187761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f4ed4d52-541a-4c91-8dae-8ba139ab7d1e req-b026ff32-72d6-4997-bcc5-216ace30c35d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:48.188517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f4ed4d52-541a-4c91-8dae-8ba139ab7d1e req-b026ff32-72d6-4997-bcc5-216ace30c35d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:48.202901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f4ed4d52-541a-4c91-8dae-8ba139ab7d1e req-b026ff32-72d6-4997-bcc5-216ace30c35d service nova] Creating event network-vif-plugged:0b716239-d15e-4a58-bba7-701ee08e7396 for instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 on nch2-master-1 Feb 12 21:42:48.210825 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f4ed4d52-541a-4c91-8dae-8ba139ab7d1e req-b026ff32-72d6-4997-bcc5-216ace30c35d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036782 Feb 12 21:42:48.210825 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3011/6155] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:48.691650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fe0362e3-7624-4040-bc68-80a222ed65de req-8ad8918a-ef45-4299-b0bc-abb6ac9c017e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa6fadb-9f44-4d5e-905d-df5733a298c4", "name": "network-vif-deleted", "tag": "0b716239-d15e-4a58-bba7-701ee08e7396"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:48.693165 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:48.693165 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:42:48.702004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fe0362e3-7624-4040-bc68-80a222ed65de req-8ad8918a-ef45-4299-b0bc-abb6ac9c017e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:48.702469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fe0362e3-7624-4040-bc68-80a222ed65de req-8ad8918a-ef45-4299-b0bc-abb6ac9c017e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:48.714159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fe0362e3-7624-4040-bc68-80a222ed65de req-8ad8918a-ef45-4299-b0bc-abb6ac9c017e service nova] Creating event network-vif-deleted:0b716239-d15e-4a58-bba7-701ee08e7396 for instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 on nch2-master-1 Feb 12 21:42:48.719351 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fe0362e3-7624-4040-bc68-80a222ed65de req-8ad8918a-ef45-4299-b0bc-abb6ac9c017e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031580 Feb 12 21:42:48.719957 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3145/6156] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:49.180654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:49.181241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:49.188982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:49.189720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:49.190510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:49.190951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:49.204437 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] HTTP exception thrown: Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 could not be found. Feb 12 21:42:49.205030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Returning 404 to user: Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:42:49.205936 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-557adc7a-36d0-4410-8b8c-0783ea44fc13 tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 404 len: 111 microversion: 2.1 time: 0.029678 Feb 12 21:42:49.206476 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3012/6157] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:49 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:42:49.225061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:49.225803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:49.232811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:49.233280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:49.234120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:49.234574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:49.248951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] HTTP exception thrown: Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 could not be found. Feb 12 21:42:49.249606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Returning 404 to user: Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:42:49.250462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-933a6b50-976f-433c-a663-f1a75d0f880f tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "DELETE /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 404 len: 111 microversion: 2.1 time: 0.030569 Feb 12 21:42:49.251011 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3146/6158] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:42:49 2022] DELETE /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:42:49.259139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:49.259754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] [instance: dfa6fadb-9f44-4d5e-905d-df5733a298c4] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:49.266099 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:49.277635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:49.277635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:49.277635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:49.281444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] HTTP exception thrown: Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 could not be found. Feb 12 21:42:49.282038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] Returning 404 to user: Instance dfa6fadb-9f44-4d5e-905d-df5733a298c4 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:42:49.282888 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebf43dc8-eb73-4df8-a428-d79d10c1277b tempest-DeleteServersTestJSON-1981623613 tempest-DeleteServersTestJSON-1981623613-project] 10.222.0.31 "GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4" status: 404 len: 111 microversion: 2.1 time: 0.027640 Feb 12 21:42:49.283418 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3013/6159] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:49 2022] GET /compute/v2.1/servers/dfa6fadb-9f44-4d5e-905d-df5733a298c4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:42:52.994658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1864267242", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "e1142866-22f6-42c4-aac4-2e6b0a456e75"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:53.046454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] validate_networks() for [('e1142866-22f6-42c4-aac4-2e6b0a456e75', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:42:53.708708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:42:53.709491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:42:53.710274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:42:53.711129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:42:53.711559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:42:53.721273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:53.721706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:53.722536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:53.723073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:53.739642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Getting quotas for project b1eed01e32a84bbdb1193155f2d33d97. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:42:53.744769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Getting quotas for user 663f4293c78a4df983eea4b0da58225e and project b1eed01e32a84bbdb1193155f2d33d97. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:42:53.757506 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:42:53.759880 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:42:53.875261 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d322ed5c-c8ab-47f8-a58d-50ecf70dd3af tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996833 Feb 12 21:42:53.876477 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3147/6160] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:42:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:42:53.887782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8c8fef76-78d6-4e87-ab44-533da8bfaf27 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:53.888395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8c8fef76-78d6-4e87-ab44-533da8bfaf27 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:53.945139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8c8fef76-78d6-4e87-ab44-533da8bfaf27 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:53.953525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8c8fef76-78d6-4e87-ab44-533da8bfaf27 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1218 microversion: 2.1 time: 0.069967 Feb 12 21:42:53.954090 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3014/6161] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:53 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:54.970621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:54.971234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:54.978963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:54.979435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:54.980354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:54.980861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:55.045025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:55.052513 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-17885490-88c1-4a72-b00e-8c34e1a598d7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1222 microversion: 2.1 time: 0.085716 Feb 12 21:42:55.053090 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3148/6162] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:54 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:56.070684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:56.071339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:56.078780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:56.079563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:56.080274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:56.080720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:56.146666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:56.155741 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cbb05992-b286-4f77-82cc-ccfa424d93c2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1288 microversion: 2.1 time: 0.089135 Feb 12 21:42:56.156341 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3015/6163] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:56 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:57.174250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:57.174888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:57.182946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:57.183373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:57.184202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:57.184662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:57.325824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:57.333260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4a10700e-d311-4be6-a299-c99aec5b57d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.162936 Feb 12 21:42:57.333858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3149/6164] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:57 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:57.437122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-494aac22-355e-4172-8334-4dbaab6b5811 req-42749be7-2ef7-4e3d-88e0-b9dc54f44f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a61450-43e0-4f30-a45a-3d404ec73e6f", "tag": "b3ac580a-7355-4f52-812b-01d6744e0bc2"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:42:57.439066 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:42:57.439066 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:42:57.447072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-494aac22-355e-4172-8334-4dbaab6b5811 req-42749be7-2ef7-4e3d-88e0-b9dc54f44f3b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:57.448326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-494aac22-355e-4172-8334-4dbaab6b5811 req-42749be7-2ef7-4e3d-88e0-b9dc54f44f3b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:57.458515 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-494aac22-355e-4172-8334-4dbaab6b5811 req-42749be7-2ef7-4e3d-88e0-b9dc54f44f3b service nova] Creating event network-changed:b3ac580a-7355-4f52-812b-01d6744e0bc2 for instance 29a61450-43e0-4f30-a45a-3d404ec73e6f on nch2-master-1 Feb 12 21:42:57.463161 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-494aac22-355e-4172-8334-4dbaab6b5811 req-42749be7-2ef7-4e3d-88e0-b9dc54f44f3b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029839 Feb 12 21:42:57.463875 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3016/6165] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:42:58.354192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:58.354818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:58.361773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:58.362239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:58.363032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:58.363484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:58.499262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:58.506794 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe6a9685-667a-495d-909a-3f6cf8ecda2f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.156639 Feb 12 21:42:58.507385 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3150/6166] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:58 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:42:59.526804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:42:59.527514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:42:59.533716 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:59.534484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:59.534996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:42:59.535439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:42:59.673528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:42:59.680946 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8666fba4-9cf9-414f-913c-280ca7f4d237 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.159831 Feb 12 21:42:59.683668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3017/6167] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:42:59 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:00.698691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:00.699323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:00.706427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:00.706899 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:00.707735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:00.708191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:00.847971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:00.856091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e35d993-7246-43a9-8535-dbffc2817e0e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.161183 Feb 12 21:43:00.860734 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3151/6168] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:00 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:01.873920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:01.874541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:01.881433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:01.882037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:01.882821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:01.883258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:02.021455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:02.029655 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6973fb0b-7f4b-49fa-9486-f61f63443869 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.160301 Feb 12 21:43:02.030240 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3018/6169] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:01 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:03.047319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:03.047872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:03.054803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:03.055278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:03.056087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:03.056548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:03.194135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:03.202954 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-274cd955-7f33-4c9b-ba9c-6159122be958 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.159484 Feb 12 21:43:03.203542 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3152/6170] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:03 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:04.219598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:04.220221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:04.227218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:04.227670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:04.228470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:04.229621 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:04.256063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-bdc5a5ad-64d6-40b2-9df4-7e578f0b05a6 req-fda49f0c-e71e-466e-b6e2-717893a59745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a61450-43e0-4f30-a45a-3d404ec73e6f", "name": "network-vif-plugged", "status": "completed", "tag": "b3ac580a-7355-4f52-812b-01d6744e0bc2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:04.257863 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:04.257863 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:43:04.266188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bdc5a5ad-64d6-40b2-9df4-7e578f0b05a6 req-fda49f0c-e71e-466e-b6e2-717893a59745 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:04.271024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-bdc5a5ad-64d6-40b2-9df4-7e578f0b05a6 req-fda49f0c-e71e-466e-b6e2-717893a59745 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:04.283159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-bdc5a5ad-64d6-40b2-9df4-7e578f0b05a6 req-fda49f0c-e71e-466e-b6e2-717893a59745 service nova] Creating event network-vif-plugged:b3ac580a-7355-4f52-812b-01d6744e0bc2 for instance 29a61450-43e0-4f30-a45a-3d404ec73e6f on nch2-master-1 Feb 12 21:43:04.289245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-bdc5a5ad-64d6-40b2-9df4-7e578f0b05a6 req-fda49f0c-e71e-466e-b6e2-717893a59745 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036614 Feb 12 21:43:04.290262 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3153/6171] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:43:04.373302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:04.391822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14f4011d-cb96-4f87-af94-cf7f0cef2829 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.175810 Feb 12 21:43:04.393189 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3019/6172] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:04 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:05.410821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:05.411547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:05.418977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:05.419453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:05.420264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:05.420723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:05.562887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:05.570718 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f97c9726-020a-4cfa-b3c2-967bd2f7a03e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1318 microversion: 2.1 time: 0.164984 Feb 12 21:43:05.571314 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3154/6173] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:05 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:06.588331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:06.589133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:06.596202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:06.596659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:06.597477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:06.597936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:06.730858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:06.738418 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14a62747-3af4-4e08-848a-d73b9c46541e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1508 microversion: 2.1 time: 0.154005 Feb 12 21:43:06.739000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3020/6174] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:06 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:06.756817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:06.757515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:06.765069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:06.765574 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:06.766370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:06.766821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:06.901647 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:06.909055 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-259616c7-5810-41fc-a9f0-e3f9e77c95dc tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1508 microversion: 2.1 time: 0.155989 Feb 12 21:43:06.909664 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3155/6175] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:06 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:06.926011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:06.927135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:06.933916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:06.934377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:06.935167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:06.935612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.061292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f98b3414-325f-48f4-8f6f-4b7716fdfca8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "PUT /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1080 microversion: 2.1 time: 0.138977 Feb 12 21:43:07.061952 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3021/6176] 10.222.0.31 () {60 vars in 1255 bytes} [Sat Feb 12 21:43:06 2022] PUT /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1080 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:07.076176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:07.076799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:07.083891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.084355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.085147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.085624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.219728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:07.227404 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16d6fc07-b57a-4f0f-910f-a2ceb0139d91 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1506 microversion: 2.1 time: 0.155110 Feb 12 21:43:07.227973 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3156/6177] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:07 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:07.243569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:07.244241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:07.251363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.251824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.252809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.253253 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.390499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:07.397982 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-33e81e8f-96ab-4016-b316-b1a412a6a0ab tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1506 microversion: 2.1 time: 0.158198 Feb 12 21:43:07.398553 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3022/6178] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:07 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:07.414856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:07.415926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:07.422643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.423053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.423852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.424309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.454579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:07.460334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Old instance type m1.heat2, new instance type m1.heat {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:43:07.466946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:43:07.467385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:43:07.468009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:43:07.468441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:43:07.468881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:43:07.641866 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-493ded4e-fa0b-44d9-bdeb-2d7786cfde09 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "POST /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f/action" status: 202 len: 0 microversion: 2.1 time: 0.230900 Feb 12 21:43:07.642486 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3157/6179] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:43:07 2022] POST /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:43:07.650262 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:07.651559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:07.658489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.658943 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.659740 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:07.660198 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:07.795646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:07.803344 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c4f91346-1602-460d-8c24-622f831601fe tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1517 microversion: 2.1 time: 0.156739 Feb 12 21:43:07.803928 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3023/6180] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:07 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:08.821349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:08.822091 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:08.828524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:08.828986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:08.829801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:08.830250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:08.970621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:08.978112 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db3ab76f-f0e9-45ed-ae16-fdcd7ea966f8 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1517 microversion: 2.1 time: 0.161351 Feb 12 21:43:08.978686 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3158/6181] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:08 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:09.995687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:09.996303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:10.002895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:10.003297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:10.004087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:10.004550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:10.224828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:10.232275 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-871e3cc4-a97f-4ab4-a828-f88880e105d5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1517 microversion: 2.1 time: 0.240852 Feb 12 21:43:10.232867 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3024/6182] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:09 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1517 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:43:11.249632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:11.250266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:11.257437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:11.257858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:11.258667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:11.259126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:11.397487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:11.407305 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-832e1c33-05df-41ed-a7f2-6ea6b3271818 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.161413 Feb 12 21:43:11.407895 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3159/6183] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:11 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:12.424934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:12.425613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:12.433090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:12.433574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:12.434362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:12.434803 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:12.573782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:12.581033 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6a697693-9988-47ce-b447-649d5e9902f3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.159808 Feb 12 21:43:12.581633 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3025/6184] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:12 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:13.598539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:13.599160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:13.606068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:13.606531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:13.607327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:13.607772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:13.743010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:13.751669 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f7854a3-f88d-4631-b4ef-3d51ca4a9402 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.156653 Feb 12 21:43:13.752067 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3160/6185] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:13 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:14.768151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:14.768767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:14.776258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:14.777118 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:14.778199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:14.778692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:14.910782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:14.918615 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4b9e206-d5cd-48e2-bfa9-49b87d1059cd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.154310 Feb 12 21:43:14.919194 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3026/6186] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:14 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:15.935690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:15.936320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:15.943124 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:15.943589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:15.944381 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:15.944830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:16.082056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:16.090603 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a043ea1e-3f97-469b-92bb-b276eecf052e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.158789 Feb 12 21:43:16.097612 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3161/6187] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:15 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:17.108304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:17.108857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:17.115596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:17.116050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:17.116828 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:17.117307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:17.255764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:17.263622 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9e840d42-4552-4435-9924-70c42a456288 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.159865 Feb 12 21:43:17.264202 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3027/6188] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:17 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:18.279922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:18.280544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:18.287321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:18.287787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:18.288585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:18.289291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:18.427084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:18.435273 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91ec297f-4bff-474e-83d6-e053ba0856f5 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.159104 Feb 12 21:43:18.436042 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3162/6189] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:18 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:19.452552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:19.453169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:19.460203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:19.460666 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:19.461486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:19.461932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:19.600125 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:19.609503 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ec08620-5773-4c50-bf4f-41809e8a0d08 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.160600 Feb 12 21:43:19.610086 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3028/6190] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:19 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:20.626807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:20.627363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:20.634485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:20.635553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:20.636448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:20.636900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:20.772529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:20.781182 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b0743b96-670f-4117-b0c0-51f62e3f8628 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.158328 Feb 12 21:43:20.781789 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3163/6191] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:20 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:21.798490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:21.799108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:21.806458 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:21.806911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:21.807915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:21.808357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:21.946971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:21.955117 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee351005-c5ae-431c-ac85-9b583ee5e006 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.160403 Feb 12 21:43:21.955725 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3029/6192] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:21 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:43:22.973260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:22.973990 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:22.980783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:22.981252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:22.982081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:22.982535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:23.125114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:23.132722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e170808-5b7a-4dba-8273-9f400fa9013b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.163193 Feb 12 21:43:23.133300 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3164/6193] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:22 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:24.151266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:24.152038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:24.158817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:24.159279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:24.160074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:24.160521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:24.297788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:24.305086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a9f98aca-c755-4005-9d58-732da772f9c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.158328 Feb 12 21:43:24.305689 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3030/6194] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:24 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:25.321369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:25.322032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:25.329074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:25.329585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:25.330406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:25.330852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:25.463679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:25.471777 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7c8f6bf3-b4be-416b-8a3e-1b49ccb0cf7c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.154274 Feb 12 21:43:25.472395 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3165/6195] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:25 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:26.488610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:26.489226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:26.496646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:26.497106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:26.497925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:26.498364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:26.633697 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:26.641226 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34568cd8-5560-43eb-88a2-b3ffee3cee7f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.156372 Feb 12 21:43:26.641829 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3031/6196] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:26 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:27.658185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:27.663399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:27.665897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:27.666362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:27.667383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:27.667836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:27.809220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:27.816788 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c092edbe-aac3-468d-bd39-ced4ba49fddd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1522 microversion: 2.1 time: 0.162538 Feb 12 21:43:27.817347 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3166/6197] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:27 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:28.645026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-73c90534-a1a0-4c7d-afb7-04b4932d3054 req-bbf84749-c8b7-4cb2-909b-bfc816051d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a61450-43e0-4f30-a45a-3d404ec73e6f", "name": "network-vif-unplugged", "status": "completed", "tag": "b3ac580a-7355-4f52-812b-01d6744e0bc2"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:28.646677 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:28.646677 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:43:28.653767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-73c90534-a1a0-4c7d-afb7-04b4932d3054 req-bbf84749-c8b7-4cb2-909b-bfc816051d14 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:28.654209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-73c90534-a1a0-4c7d-afb7-04b4932d3054 req-bbf84749-c8b7-4cb2-909b-bfc816051d14 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:28.666088 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-73c90534-a1a0-4c7d-afb7-04b4932d3054 req-bbf84749-c8b7-4cb2-909b-bfc816051d14 service nova] Creating event network-vif-unplugged:b3ac580a-7355-4f52-812b-01d6744e0bc2 for instance 29a61450-43e0-4f30-a45a-3d404ec73e6f on nch1-master-1 Feb 12 21:43:28.672610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-73c90534-a1a0-4c7d-afb7-04b4932d3054 req-bbf84749-c8b7-4cb2-909b-bfc816051d14 service nova] Instance 29a61450-43e0-4f30-a45a-3d404ec73e6f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:43:28.684304 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-73c90534-a1a0-4c7d-afb7-04b4932d3054 req-bbf84749-c8b7-4cb2-909b-bfc816051d14 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118220 Feb 12 21:43:28.685194 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3032/6198] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:43:28.834636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:28.835105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:28.842872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:28.843352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:28.844140 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:28.844589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:28.984839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:28.992630 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3509f4ca-e624-43ec-8230-fa65ecd61c99 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1521 microversion: 2.1 time: 0.161886 Feb 12 21:43:28.993301 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3167/6199] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:28 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:30.012356 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:30.013054 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:30.019627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:30.027942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:30.027942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:30.027942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:30.157939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:30.165803 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-00f87f16-3feb-4e17-834e-ff653f5f3ddb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1521 microversion: 2.1 time: 0.159367 Feb 12 21:43:30.166382 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3033/6200] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:30 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:30.700411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-55b9e832-2ca8-479e-99d2-59b0d3740348 req-46d0aa7d-45ea-43c5-9438-ac14ba8d60e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a61450-43e0-4f30-a45a-3d404ec73e6f", "tag": "b3ac580a-7355-4f52-812b-01d6744e0bc2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:30.702085 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:30.702085 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:43:30.709930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-55b9e832-2ca8-479e-99d2-59b0d3740348 req-46d0aa7d-45ea-43c5-9438-ac14ba8d60e9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:30.710395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-55b9e832-2ca8-479e-99d2-59b0d3740348 req-46d0aa7d-45ea-43c5-9438-ac14ba8d60e9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:30.723865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-55b9e832-2ca8-479e-99d2-59b0d3740348 req-46d0aa7d-45ea-43c5-9438-ac14ba8d60e9 service nova] Creating event network-changed:b3ac580a-7355-4f52-812b-01d6744e0bc2 for instance 29a61450-43e0-4f30-a45a-3d404ec73e6f on nch1-master-1 Feb 12 21:43:30.729191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-55b9e832-2ca8-479e-99d2-59b0d3740348 req-46d0aa7d-45ea-43c5-9438-ac14ba8d60e9 service nova] Instance 29a61450-43e0-4f30-a45a-3d404ec73e6f is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:43:30.739978 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-55b9e832-2ca8-479e-99d2-59b0d3740348 req-46d0aa7d-45ea-43c5-9438-ac14ba8d60e9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043865 Feb 12 21:43:30.740572 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3168/6201] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:43:31.184228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:31.184880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:31.193183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:31.193771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:31.194627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:31.195080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:31.588232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:31.596417 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-61e5c5e0-b910-4059-ae1f-dbbe5a2c8a98 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1519 microversion: 2.1 time: 0.416538 Feb 12 21:43:31.597006 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3034/6202] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:31 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:32.615982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:32.616702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:32.623712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:32.624184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:32.624984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:32.625466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:32.779464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:32.787008 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bf9a4ab2-36c4-4eba-a66a-a2dd798ea5b6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1516 microversion: 2.1 time: 0.176053 Feb 12 21:43:32.787621 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3169/6203] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:32 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:32.803440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:32.803989 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:32.811528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:32.811983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:32.812772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:32.813212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:32.992525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6cb7152-34a6-4ce0-888f-72f1430451ed tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "POST /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f/action" status: 204 len: 0 microversion: 2.1 time: 0.192456 Feb 12 21:43:32.993122 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3035/6204] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:43:32 2022] POST /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f/action => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:43:33.002524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:33.003156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:33.009260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:33.009765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:33.011159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:33.011825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:33.163738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:33.173722 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bd5ce92b-c8d2-4b67-b33d-b6f53a5350f9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1516 microversion: 2.1 time: 0.174881 Feb 12 21:43:33.175368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3170/6205] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:32 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:34.193444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:34.194188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:34.200929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:34.201404 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:34.202592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:34.203039 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:34.352473 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:34.364870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1efc83b4-6237-4699-b731-cd9783b8e588 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1516 microversion: 2.1 time: 0.176091 Feb 12 21:43:34.368667 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3036/6206] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:34 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:34.664824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2d4ef94d-616a-4d8a-8158-7c84a6670e44 req-fc25b484-1b06-458b-921f-ad3d7809508d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a61450-43e0-4f30-a45a-3d404ec73e6f", "name": "network-vif-plugged", "status": "completed", "tag": "b3ac580a-7355-4f52-812b-01d6744e0bc2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:34.666476 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:34.666476 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:43:34.674679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2d4ef94d-616a-4d8a-8158-7c84a6670e44 req-fc25b484-1b06-458b-921f-ad3d7809508d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:34.675146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2d4ef94d-616a-4d8a-8158-7c84a6670e44 req-fc25b484-1b06-458b-921f-ad3d7809508d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:34.687096 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2d4ef94d-616a-4d8a-8158-7c84a6670e44 req-fc25b484-1b06-458b-921f-ad3d7809508d service nova] Creating event network-vif-plugged:b3ac580a-7355-4f52-812b-01d6744e0bc2 for instance 29a61450-43e0-4f30-a45a-3d404ec73e6f on nch1-master-1 Feb 12 21:43:34.693333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2d4ef94d-616a-4d8a-8158-7c84a6670e44 req-fc25b484-1b06-458b-921f-ad3d7809508d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 Feb 12 21:43:34.694032 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3171/6207] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:43:35.383812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:35.384427 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:35.391910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.392363 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.393143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.393609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.530261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:35.537623 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f91760a-31d5-4066-8241-6d3b11b1ab36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1508 microversion: 2.1 time: 0.157450 Feb 12 21:43:35.538197 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3037/6208] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:35 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:35.554821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:35.555540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:35.562594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.563054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.563847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.564295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.696858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:35.704702 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f19ecadb-3224-4ada-8c5e-73a738154259 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1508 microversion: 2.1 time: 0.153883 Feb 12 21:43:35.705288 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3172/6209] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:35 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:35.720290 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:35.720902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:35.726835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.727279 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.728057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.728492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.863981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:35.871386 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8862fa35-7979-46e5-b79d-bc3d4996e28f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 200 len: 1508 microversion: 2.1 time: 0.154751 Feb 12 21:43:35.871955 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3038/6210] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:35 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:35.887142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:35.887655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:35.894045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.894582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.900775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:35.900775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:35.922394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:43:36.192558 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fd881881-2827-45c6-bd8c-9eb59576845d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "DELETE /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 204 len: 0 microversion: 2.1 time: 0.308795 Feb 12 21:43:36.193075 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3173/6211] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:43:35 2022] DELETE /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:43:36.248076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-512898066", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "e1142866-22f6-42c4-aac4-2e6b0a456e75"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:36.298052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] validate_networks() for [('e1142866-22f6-42c4-aac4-2e6b0a456e75', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:43:36.718281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:43:36.718870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:43:36.719165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:43:36.719570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:43:36.719979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:43:36.728733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:36.729182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:36.730143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:36.730581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:36.747737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Getting quotas for project b1eed01e32a84bbdb1193155f2d33d97. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:43:36.753124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Getting quotas for user 663f4293c78a4df983eea4b0da58225e and project b1eed01e32a84bbdb1193155f2d33d97. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:43:36.766545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:43:36.768905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:43:36.903983 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c8238e7-1385-4164-a382-1edb3a8e910e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659525 Feb 12 21:43:36.904639 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3039/6212] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:43:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:43:36.915195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f9a5537-b5f7-46ff-9505-781d58e3e41d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:36.915911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f9a5537-b5f7-46ff-9505-781d58e3e41d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:36.974380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f9a5537-b5f7-46ff-9505-781d58e3e41d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:36.982915 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f9a5537-b5f7-46ff-9505-781d58e3e41d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1217 microversion: 2.1 time: 0.071951 Feb 12 21:43:36.983427 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3174/6213] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:36 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:43:38.001182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:38.001759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:38.008035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:38.008721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:38.009758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:38.011026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:38.081708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:38.090285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fcdcc3b0-cc70-46d7-96e6-4cf7c30ca1ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1221 microversion: 2.1 time: 0.094230 Feb 12 21:43:38.090923 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3040/6214] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:37 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:38.266671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-053d8053-7934-4dcc-ae25-a41881d0c205 req-8ab499ba-4e14-4bc5-8945-6bfd6e4027fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a61450-43e0-4f30-a45a-3d404ec73e6f", "name": "network-vif-deleted", "tag": "b3ac580a-7355-4f52-812b-01d6744e0bc2"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:38.268217 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:38.268217 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:43:38.276397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-053d8053-7934-4dcc-ae25-a41881d0c205 req-8ab499ba-4e14-4bc5-8945-6bfd6e4027fb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:38.276901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-053d8053-7934-4dcc-ae25-a41881d0c205 req-8ab499ba-4e14-4bc5-8945-6bfd6e4027fb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:38.288421 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-053d8053-7934-4dcc-ae25-a41881d0c205 req-8ab499ba-4e14-4bc5-8945-6bfd6e4027fb service nova] Creating event network-vif-deleted:b3ac580a-7355-4f52-812b-01d6744e0bc2 for instance 29a61450-43e0-4f30-a45a-3d404ec73e6f on nch1-master-1 Feb 12 21:43:38.293874 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-053d8053-7934-4dcc-ae25-a41881d0c205 req-8ab499ba-4e14-4bc5-8945-6bfd6e4027fb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031108 Feb 12 21:43:38.294486 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3175/6215] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:43:39.108238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:39.108895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:39.115482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:39.115945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:39.116752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:39.117201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:39.183809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:39.191764 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2cf2a89-f35d-483e-9c56-39f46533768c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1277 microversion: 2.1 time: 0.088128 Feb 12 21:43:39.192548 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3041/6216] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:39 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:40.210963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:40.211685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:40.218913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:40.219387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:40.220198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:40.220657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:40.360565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:40.368387 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-de90d805-646e-47bc-aa71-df1250c223b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.162654 Feb 12 21:43:40.368972 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3176/6217] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:40 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:40.550422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f0f1c0c1-bf4e-4596-9f60-215c3fea70fb req-d191d1da-009d-4b06-9014-e8c310089cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecc291c-cd70-4811-83b0-210043a891a5", "tag": "f8c1f6b6-bc2f-4ba0-9504-67340b11446b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:40.552011 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:40.552011 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:43:40.560835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f0f1c0c1-bf4e-4596-9f60-215c3fea70fb req-d191d1da-009d-4b06-9014-e8c310089cc8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:40.561294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f0f1c0c1-bf4e-4596-9f60-215c3fea70fb req-d191d1da-009d-4b06-9014-e8c310089cc8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:40.575299 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f0f1c0c1-bf4e-4596-9f60-215c3fea70fb req-d191d1da-009d-4b06-9014-e8c310089cc8 service nova] Creating event network-changed:f8c1f6b6-bc2f-4ba0-9504-67340b11446b for instance 8ecc291c-cd70-4811-83b0-210043a891a5 on nch1-master-1 Feb 12 21:43:40.580177 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f0f1c0c1-bf4e-4596-9f60-215c3fea70fb req-d191d1da-009d-4b06-9014-e8c310089cc8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033685 Feb 12 21:43:40.580780 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3042/6218] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:43:41.384916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:41.386178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:41.393178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:41.393687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:41.394490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:41.394943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:41.530753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:41.538216 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-acd39d92-0ea3-4c5e-bed9-e99b24c010bd tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.157045 Feb 12 21:43:41.538808 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3177/6219] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:41 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:42.557120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:42.557889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:42.564672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:42.565129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:42.565972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:42.566418 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:42.702582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:42.709910 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-20e96018-e69a-4d7a-a88b-3461def2bccf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.157732 Feb 12 21:43:42.710502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3043/6220] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:42 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:43.726644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:43.727277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:43.734750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:43.735212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:43.736162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:43.736613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:43.878954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:43.886333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c3581cbe-c7c5-4083-902c-6e67dc0a3d65 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.163543 Feb 12 21:43:43.886905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3178/6221] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:43 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:44.903241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:44.903862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:44.910743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:44.911195 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:44.911983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:44.912426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:45.047330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:45.054772 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b118a4c4-0c4d-4ffc-9ccb-1caea4d5141d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.155791 Feb 12 21:43:45.055351 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3044/6222] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:44 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:46.071961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:46.072483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:46.079958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:46.080424 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:46.081219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:46.081716 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:46.218482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:46.226117 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7e9e7680-3f72-4917-a36e-7e88682cc15e tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.158092 Feb 12 21:43:46.226706 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3179/6223] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:46 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:46.706066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-f9fb1c50-bd8e-4d49-b2ac-142f7c029e40 req-3e39d922-31ca-49fc-b35a-79d64873651e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecc291c-cd70-4811-83b0-210043a891a5", "name": "network-vif-plugged", "status": "completed", "tag": "f8c1f6b6-bc2f-4ba0-9504-67340b11446b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:46.710666 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:43:46.710666 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:43:46.716086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f9fb1c50-bd8e-4d49-b2ac-142f7c029e40 req-3e39d922-31ca-49fc-b35a-79d64873651e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:46.716534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-f9fb1c50-bd8e-4d49-b2ac-142f7c029e40 req-3e39d922-31ca-49fc-b35a-79d64873651e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:46.727549 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-f9fb1c50-bd8e-4d49-b2ac-142f7c029e40 req-3e39d922-31ca-49fc-b35a-79d64873651e service nova] Creating event network-vif-plugged:f8c1f6b6-bc2f-4ba0-9504-67340b11446b for instance 8ecc291c-cd70-4811-83b0-210043a891a5 on nch1-master-1 Feb 12 21:43:46.733246 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-f9fb1c50-bd8e-4d49-b2ac-142f7c029e40 req-3e39d922-31ca-49fc-b35a-79d64873651e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030949 Feb 12 21:43:46.733907 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3045/6224] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:43:47.243027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:47.243655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:47.251095 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:47.251563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:47.252363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:47.252877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:47.391777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:47.399218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9a5bb803-07a2-4c3e-a8d4-fdb940844934 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1317 microversion: 2.1 time: 0.160147 Feb 12 21:43:47.399797 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3180/6225] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:47 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:48.418094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:48.418807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:48.425162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:48.427575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:48.427575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:48.427575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:48.564457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:48.571914 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa901df9-3077-4b89-a89e-2b1d47af7a55 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1506 microversion: 2.1 time: 0.159273 Feb 12 21:43:48.572493 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3046/6226] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:48 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:48.588468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:48.589097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:48.596224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:48.596859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:48.597525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:48.597980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:48.730511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:48.738209 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c1be7ed-10b8-46e4-afdc-e8b1655ec4bb tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1506 microversion: 2.1 time: 0.153481 Feb 12 21:43:48.738815 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3181/6227] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:48 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:48.754792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:43:48.755774 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:48.762614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:48.763071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:48.763893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:48.764335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:48.791581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:48.797387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Old instance type m1.heat2, new instance type m1.heat {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:43:48.803385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:43:48.803810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:43:48.804288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:43:48.804705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:43:48.805122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:43:49.000588 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2060e70-ece5-4fb2-a2fd-ffc2f3e8a434 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "POST /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5/action" status: 202 len: 0 microversion: 2.1 time: 0.249407 Feb 12 21:43:49.001127 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3047/6228] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:43:48 2022] POST /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:43:49.013543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:49.014527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:49.020782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:49.021324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:49.022219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:49.022699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:49.161243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:49.169569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-98a767b9-619a-45f3-a092-bab0b2ac8ef0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1513 microversion: 2.1 time: 0.160355 Feb 12 21:43:49.172893 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3182/6229] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:49 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:43:50.188341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:50.189627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:50.195613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:50.196065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:50.196848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:50.197281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:50.336104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:50.340681 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e2ba631b-c70c-4857-b1ec-c86c484a3568 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1513 microversion: 2.1 time: 0.157714 Feb 12 21:43:50.341255 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3048/6230] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:50 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:51.357772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:51.358405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:51.364963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:51.365469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:51.366303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:51.366765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:51.510898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:51.519639 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ba3d258a-fe01-4a1b-9d3a-b56d9b5b06c3 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1513 microversion: 2.1 time: 0.166003 Feb 12 21:43:51.520248 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3183/6231] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:51 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:43:52.536893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:52.537536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:52.545380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:52.545821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:52.546600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:52.547036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:52.681725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:52.689229 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bb6018a7-d3be-457b-a633-31940334a93d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.156041 Feb 12 21:43:52.689840 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3049/6232] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:52 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:53.706363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:53.707013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:53.713627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:53.714094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:53.714886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:53.715337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:53.873864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:53.881336 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6e86a179-0d96-4912-ba3a-c9cab93e7d50 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.178823 Feb 12 21:43:53.881937 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3184/6233] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:53 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:54.898377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:54.899257 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:54.908007 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:54.908456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:54.909229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:54.909705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:55.042177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:55.050185 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6357eac3-99c9-43e5-b002-d22b29b5610b tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.155927 Feb 12 21:43:55.050767 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3050/6234] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:54 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:56.067130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:56.067679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:56.074518 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:56.074986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:56.076557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:56.077004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:56.214907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:56.222507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-783e3961-b26a-4b5a-8de4-ac5e4834ece1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.159205 Feb 12 21:43:56.223078 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3185/6235] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:56 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:57.239599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:57.240222 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:57.247886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:57.248338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:57.249167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:57.249640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:57.385135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:57.392594 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dfbc2db4-2ffc-44fa-88b4-78a239977ef9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.156898 Feb 12 21:43:57.393193 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3051/6236] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:57 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:58.409693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:58.410327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:58.417514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:58.417994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:58.418820 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:58.419293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:58.564405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:58.571836 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8780b7a0-7f46-4949-a123-7fe82973ed82 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.165894 Feb 12 21:43:58.572401 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3186/6237] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:58 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:43:59.589284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:43:59.589928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:43:59.597474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:59.597934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:59.598728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:43:59.599168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:43:59.736919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:43:59.745055 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-04639bb5-6e03-40bd-8837-9996d916a1b7 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.159214 Feb 12 21:43:59.745668 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3052/6238] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:43:59 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:00.763526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:00.764152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:00.771084 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:00.771559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:00.772386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:00.772847 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:00.909265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:00.917041 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4938e8dc-e0e5-414b-a12c-cb6bdf1f0582 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.157965 Feb 12 21:44:00.917656 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3187/6239] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:00 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:01.934927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:01.935545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:01.942531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:01.942990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:01.943819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:01.944261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:02.078835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:02.086315 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6f6ff67-5eaf-4106-b715-58a948bccddf tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.155304 Feb 12 21:44:02.086902 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3053/6240] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:01 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:03.103201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:03.103734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:03.111321 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:03.111795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:03.112603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:03.113063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:03.246254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:03.254058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4c3c210a-a443-47b5-9fb8-c65126e504a2 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.154848 Feb 12 21:44:03.254639 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3188/6241] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:03 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:04.271530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:04.272152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:04.279526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:04.279982 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:04.280771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:04.281212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:04.421531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:04.429081 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1a378bf9-49a5-4035-ad11-1ac4c54bf968 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.161322 Feb 12 21:44:04.429687 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3054/6242] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:04 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:44:05.446816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:05.447443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:05.454822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:05.455300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:05.456107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:05.456556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:05.598000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:05.605484 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b5753800-cef4-4c14-9b55-2795a00642e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.162444 Feb 12 21:44:05.606056 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3189/6243] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:05 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:06.624186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:06.624702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:06.631615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:06.632061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:06.632838 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:06.633273 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:06.769540 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:06.776930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5cd7f8e-8e20-463d-b5f1-6f234a2dcca9 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.157472 Feb 12 21:44:06.777528 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3055/6244] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:06 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:07.795564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:07.796246 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:07.803212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:07.803685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:07.804490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:07.804947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:07.944156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:07.952507 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4775815c-4d9e-4699-b751-53f245a178b0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.160901 Feb 12 21:44:07.953096 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3190/6245] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:07 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:08.969656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:08.970278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:08.976829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:08.977284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:08.978113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:08.978555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:09.110555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:09.118076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9526586c-b37b-4685-9104-3273c9f5eaaa tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.152130 Feb 12 21:44:09.118742 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3056/6246] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:08 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:10.135666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:10.136425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:10.143964 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:10.144428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:10.145290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:10.145770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:10.286764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:10.294422 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a169db91-1b0f-4d70-bc7a-8195704dde8c tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.162507 Feb 12 21:44:10.295005 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3191/6247] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:10 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:11.312168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:11.312694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:11.319432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:11.319880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:11.320657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:11.321089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:11.459611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:11.467170 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d73e2232-0709-4109-91f1-74f552115c11 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.158964 Feb 12 21:44:11.468616 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3057/6248] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:11 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:12.485573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:12.486201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:12.493044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:12.493571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:12.494409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:12.494867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:12.627925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:12.635577 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8e27de00-d7e5-4a89-82d5-6696d44050d6 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.154426 Feb 12 21:44:12.636157 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3192/6249] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:12 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:13.652746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:13.653370 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:13.660199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:13.660649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:13.661454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:13.661892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:13.801498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:13.808923 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-69a90cd3-8e6c-4a6b-af43-cfd52b5f3731 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.159937 Feb 12 21:44:13.809511 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3058/6250] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:13 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:14.827492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:14.828203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:14.835047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:14.835514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:14.836304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:14.836754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:14.972962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:14.980420 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3d08412e-46af-4fa4-befd-e4a86628809d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.157310 Feb 12 21:44:14.981112 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3193/6251] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:14 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:15.997347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:15.997988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:16.004875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:16.005268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:16.006068 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:16.006513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:16.143209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:16.150648 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eec2dbe4-f18a-4df8-ab46-a81f171fd7ac tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.156967 Feb 12 21:44:16.151213 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3059/6252] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:15 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:17.168347 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:17.169079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:17.177026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:17.177525 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:17.178393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:17.178842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:17.314043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:17.321848 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb75ebff-da02-4e3a-a3ef-c04965e9dff4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.157488 Feb 12 21:44:17.322419 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3194/6253] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:17 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:18.338987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:18.339607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:18.347204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:18.347661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:18.348447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:18.348887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:18.485528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:18.492889 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-72a302b6-2405-4062-acce-85d07cd0f6d0 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.157656 Feb 12 21:44:18.493479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3060/6254] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:18 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:19.510455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:19.511075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:19.518397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:19.524455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:19.524455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:19.524455 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:19.660634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:19.669068 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb57cb6b-e9a3-4745-807a-ee4fa0346b8d tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1518 microversion: 2.1 time: 0.162306 Feb 12 21:44:19.669695 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3195/6255] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:19 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:20.547599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a4df26ec-39f7-4e28-8507-25220a13acea req-0d374438-1108-4aa3-ab8b-3b53158bee40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecc291c-cd70-4811-83b0-210043a891a5", "name": "network-vif-unplugged", "status": "completed", "tag": "f8c1f6b6-bc2f-4ba0-9504-67340b11446b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:20.549110 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:20.549110 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:44:20.557229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a4df26ec-39f7-4e28-8507-25220a13acea req-0d374438-1108-4aa3-ab8b-3b53158bee40 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:20.557691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a4df26ec-39f7-4e28-8507-25220a13acea req-0d374438-1108-4aa3-ab8b-3b53158bee40 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:20.572298 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a4df26ec-39f7-4e28-8507-25220a13acea req-0d374438-1108-4aa3-ab8b-3b53158bee40 service nova] Creating event network-vif-unplugged:f8c1f6b6-bc2f-4ba0-9504-67340b11446b for instance 8ecc291c-cd70-4811-83b0-210043a891a5 on nch2-master-1 Feb 12 21:44:20.578822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-a4df26ec-39f7-4e28-8507-25220a13acea req-0d374438-1108-4aa3-ab8b-3b53158bee40 service nova] Instance 8ecc291c-cd70-4811-83b0-210043a891a5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:44:20.590097 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a4df26ec-39f7-4e28-8507-25220a13acea req-0d374438-1108-4aa3-ab8b-3b53158bee40 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046768 Feb 12 21:44:20.590718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3061/6256] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:20.686694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:20.687650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:20.694596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:20.695065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:20.695879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:20.696328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:20.879660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:20.888655 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2167021c-78c0-4f5c-b619-0fbca90abe6f tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1517 microversion: 2.1 time: 0.206348 Feb 12 21:44:20.889268 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3196/6257] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:20 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:21.908900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:21.909652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:21.916148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:21.916635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:21.917467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:21.917911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:22.060419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:22.068426 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-089cdfe7-ce97-4cfa-9ae0-0a83995d2852 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1517 microversion: 2.1 time: 0.165518 Feb 12 21:44:22.069048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3062/6258] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:21 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:22.605412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-44f1dfe7-790c-4e7c-9706-afb0db9396e7 req-b8af9fde-248d-406a-9d11-93dd3d275355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecc291c-cd70-4811-83b0-210043a891a5", "tag": "f8c1f6b6-bc2f-4ba0-9504-67340b11446b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:22.606926 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:22.606926 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:44:22.614542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-44f1dfe7-790c-4e7c-9706-afb0db9396e7 req-b8af9fde-248d-406a-9d11-93dd3d275355 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:22.615000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-44f1dfe7-790c-4e7c-9706-afb0db9396e7 req-b8af9fde-248d-406a-9d11-93dd3d275355 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:22.626423 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-44f1dfe7-790c-4e7c-9706-afb0db9396e7 req-b8af9fde-248d-406a-9d11-93dd3d275355 service nova] Creating event network-changed:f8c1f6b6-bc2f-4ba0-9504-67340b11446b for instance 8ecc291c-cd70-4811-83b0-210043a891a5 on nch2-master-1 Feb 12 21:44:22.631580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-44f1dfe7-790c-4e7c-9706-afb0db9396e7 req-b8af9fde-248d-406a-9d11-93dd3d275355 service nova] Instance 8ecc291c-cd70-4811-83b0-210043a891a5 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:44:22.643339 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-44f1dfe7-790c-4e7c-9706-afb0db9396e7 req-b8af9fde-248d-406a-9d11-93dd3d275355 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041625 Feb 12 21:44:22.643922 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3197/6259] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:23.086197 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:23.087056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:23.094875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:23.096357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:23.096357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:23.096584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:23.472015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:23.479722 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1a13a1e-ddef-444b-8875-1453a4dca9ca tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1515 microversion: 2.1 time: 0.397273 Feb 12 21:44:23.480398 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3063/6260] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:23 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:24.498205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:24.499407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:24.506637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:24.507097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:24.507903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:24.508350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:24.646598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:24.656281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-044ec895-b564-496e-8c81-5673ce2ab5e4 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1512 microversion: 2.1 time: 0.162194 Feb 12 21:44:24.665984 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3198/6261] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:24 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:24.674307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:24.674941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:24.681747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:24.682274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:24.683174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:24.683681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:24.879687 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-51e5b473-715d-4b8d-ac1e-46b9ecc627db tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "POST /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5/action" status: 204 len: 0 microversion: 2.1 time: 0.209290 Feb 12 21:44:24.880358 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3064/6262] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:44:24 2022] POST /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5/action => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:44:24.888422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:24.889062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:24.895530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:24.895938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:24.896752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:24.897236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:25.042599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:25.051089 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7b41710e-b8ef-4fd5-ba86-3fa99fe07b37 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1512 microversion: 2.1 time: 0.166397 Feb 12 21:44:25.051768 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3199/6263] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:24 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:26.069897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:26.070601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:26.076974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:26.077451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:26.078242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:26.078682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:26.226016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:26.234140 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-037180a3-88d0-434c-92c7-de6883bb0a36 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1512 microversion: 2.1 time: 0.169152 Feb 12 21:44:26.240739 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3065/6264] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:26 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:26.662079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7dd43612-b190-49ff-a6fb-f440db81bf39 req-b70e25c2-bf6f-497e-ad06-d1d590b7942b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecc291c-cd70-4811-83b0-210043a891a5", "name": "network-vif-plugged", "status": "completed", "tag": "f8c1f6b6-bc2f-4ba0-9504-67340b11446b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:26.663783 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:26.663783 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:44:26.672500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7dd43612-b190-49ff-a6fb-f440db81bf39 req-b70e25c2-bf6f-497e-ad06-d1d590b7942b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:26.675421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7dd43612-b190-49ff-a6fb-f440db81bf39 req-b70e25c2-bf6f-497e-ad06-d1d590b7942b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:26.684569 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7dd43612-b190-49ff-a6fb-f440db81bf39 req-b70e25c2-bf6f-497e-ad06-d1d590b7942b service nova] Creating event network-vif-plugged:f8c1f6b6-bc2f-4ba0-9504-67340b11446b for instance 8ecc291c-cd70-4811-83b0-210043a891a5 on nch2-master-1 Feb 12 21:44:26.690134 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7dd43612-b190-49ff-a6fb-f440db81bf39 req-b70e25c2-bf6f-497e-ad06-d1d590b7942b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Feb 12 21:44:26.690747 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3200/6265] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:27.251652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:27.252330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:27.259593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.259718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.260582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.261025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.395505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:27.402924 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-471f8747-aaf3-4234-b88c-95eac3afd819 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1504 microversion: 2.1 time: 0.155007 Feb 12 21:44:27.403501 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3066/6266] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:27 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:27.420044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:27.420805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:27.427378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.427853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.428663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.429119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.564639 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:27.572091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb9f955d-8999-4482-b363-b36094e51320 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1504 microversion: 2.1 time: 0.156096 Feb 12 21:44:27.572671 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3201/6267] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:27 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:27.589558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:27.590178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:27.596695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.597154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.597990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.598435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.737466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:27.744836 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c2da3ae6-1dbe-46a1-ae5c-b9ce066d8d32 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1504 microversion: 2.1 time: 0.158879 Feb 12 21:44:27.745634 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3067/6268] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:27 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:27.761377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:27.766562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:27.768973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.769508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.770349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:27.770802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:27.797387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:44:28.057114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7509fee8-b578-4487-a47f-8fc4372be6d1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 204 len: 0 microversion: 2.1 time: 0.298988 Feb 12 21:44:28.057720 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3202/6269] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:44:27 2022] DELETE /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:44:28.075816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:28.076317 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:28.082806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:28.083265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:28.084048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:28.084487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:28.109623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:44:28.153979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.compute.api [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Instance is already in deleting state, ignoring this request Feb 12 21:44:28.155448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-391f9aba-d729-403d-8e24-32a73f3b5548 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "DELETE /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 204 len: 0 microversion: 2.1 time: 0.082733 Feb 12 21:44:28.156188 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3068/6270] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:44:28 2022] DELETE /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:44:28.164602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:28.165606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:28.171815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:28.172283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:28.173081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:28.173565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:28.312909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:28.320327 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5d18fa47-250b-4eca-b5d8-17500746f0ea tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1510 microversion: 2.1 time: 0.159811 Feb 12 21:44:28.324260 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3203/6271] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:28 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:29.337792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:29.338444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:29.345576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:29.346030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:29.346821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:29.347278 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:29.554721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f4293c78a4df983eea4b0da58225e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1eed01e32a84bbdb1193155f2d33d97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:29.563287 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ed22d41-f420-479c-9b8b-dbf50402fef1 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 200 len: 1510 microversion: 2.1 time: 0.229182 Feb 12 21:44:29.563883 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3069/6272] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:29 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:29.953585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f7d3e795-97c3-4b83-8316-d00c239ced93 req-b6f8442f-bd9c-4e72-903f-ad461eb80619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecc291c-cd70-4811-83b0-210043a891a5", "name": "network-vif-deleted", "tag": "f8c1f6b6-bc2f-4ba0-9504-67340b11446b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:29.955742 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:29.955742 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:44:29.964172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f7d3e795-97c3-4b83-8316-d00c239ced93 req-b6f8442f-bd9c-4e72-903f-ad461eb80619 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:29.966686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f7d3e795-97c3-4b83-8316-d00c239ced93 req-b6f8442f-bd9c-4e72-903f-ad461eb80619 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:29.978392 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f7d3e795-97c3-4b83-8316-d00c239ced93 req-b6f8442f-bd9c-4e72-903f-ad461eb80619 service nova] Creating event network-vif-deleted:f8c1f6b6-bc2f-4ba0-9504-67340b11446b for instance 8ecc291c-cd70-4811-83b0-210043a891a5 on nch2-master-1 Feb 12 21:44:29.984349 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f7d3e795-97c3-4b83-8316-d00c239ced93 req-b6f8442f-bd9c-4e72-903f-ad461eb80619 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034427 Feb 12 21:44:29.985087 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3204/6273] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:30.580406 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:30.580954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 8ecc291c-cd70-4811-83b0-210043a891a5] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:30.587555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:30.588026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:30.588787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:30.589227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:30.602578 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] HTTP exception thrown: Instance 8ecc291c-cd70-4811-83b0-210043a891a5 could not be found. Feb 12 21:44:30.603168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Returning 404 to user: Instance 8ecc291c-cd70-4811-83b0-210043a891a5 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:44:30.603981 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09d04146-2ec9-4a26-9963-bd806d746307 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5" status: 404 len: 111 microversion: 2.1 time: 0.028123 Feb 12 21:44:30.604512 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3070/6274] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:30 2022] GET /compute/v2.1/servers/8ecc291c-cd70-4811-83b0-210043a891a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:44:30.613416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:30.614051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:30.620298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:30.620764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:30.621586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:30.622039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:30.635973 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] HTTP exception thrown: Instance 29a61450-43e0-4f30-a45a-3d404ec73e6f could not be found. Feb 12 21:44:30.636572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Returning 404 to user: Instance 29a61450-43e0-4f30-a45a-3d404ec73e6f could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:44:30.637426 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ebb75916-a37a-44a5-8ef8-91e82f0ead94 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "DELETE /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 404 len: 111 microversion: 2.1 time: 0.028167 Feb 12 21:44:30.637959 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3205/6275] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:44:30 2022] DELETE /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:44:30.646341 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:30.646950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] [instance: 29a61450-43e0-4f30-a45a-3d404ec73e6f] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:30.653128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:30.653605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:30.654385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:30.655011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:30.668349 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] HTTP exception thrown: Instance 29a61450-43e0-4f30-a45a-3d404ec73e6f could not be found. Feb 12 21:44:30.668924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] Returning 404 to user: Instance 29a61450-43e0-4f30-a45a-3d404ec73e6f could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:44:30.669766 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e91f48c8-b6d4-4e0d-8c8f-5a9a4f29f450 tempest-ServerDiskConfigTestJSON-949550525 tempest-ServerDiskConfigTestJSON-949550525-project] 10.222.0.31 "GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f" status: 404 len: 111 microversion: 2.1 time: 0.027110 Feb 12 21:44:30.670477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3071/6276] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:30 2022] GET /compute/v2.1/servers/29a61450-43e0-4f30-a45a-3d404ec73e6f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:44:38.578367 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0fd48be9-698b-4c75-a357-a6c33f4a7615 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'create', calling method: .version_select at 0x7fa8feaefb80>, body: {"keypair": {"name": "tempest-keypair-482931291"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:38.594293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0fd48be9-698b-4c75-a357-a6c33f4a7615 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:44:38.599997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0fd48be9-698b-4c75-a357-a6c33f4a7615 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:44:38.823156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0fd48be9-698b-4c75-a357-a6c33f4a7615 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:44:38.828448 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-0fd48be9-698b-4c75-a357-a6c33f4a7615 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:44:38.844779 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0fd48be9-698b-4c75-a357-a6c33f4a7615 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.412287 Feb 12 21:44:38.845453 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3206/6277] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:44:38 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:44:41.019793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-619712686", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34fb4bd0-7538-4c5d-aca6-00f04cac631c"}], "security_groups": [{"name": "tempest-securitygroup--1424401669"}], "key_name": "tempest-keypair-482931291", "user_data": "}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:41.128787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] validate_networks() for [('34fb4bd0-7538-4c5d-aca6-00f04cac631c', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:44:41.551338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:44:41.556055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:44:41.556055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:44:41.556055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:44:41.556055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:44:41.563194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:41.563706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:41.564827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:41.565258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:41.582491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:44:41.587963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:44:41.601834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:44:41.604301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:44:41.733885 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e8a7673a-51f4-4076-9e0f-d8b69c2710bd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.717778 Feb 12 21:44:41.734744 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3072/6278] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:44:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:44:41.745764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3466a8b8-40d1-4797-aed4-8aaab5f5dbe3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:41.746402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3466a8b8-40d1-4797-aed4-8aaab5f5dbe3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:41.807682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3466a8b8-40d1-4797-aed4-8aaab5f5dbe3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:41.816116 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3466a8b8-40d1-4797-aed4-8aaab5f5dbe3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1237 microversion: 2.1 time: 0.075235 Feb 12 21:44:41.825544 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3207/6279] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:41 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:42.834758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:42.835379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:42.842956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:42.843608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:42.844492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:42.844938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:42.905854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:42.915438 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2eeedbdc-a6e5-4344-b82a-3c06c62b13dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1241 microversion: 2.1 time: 0.083962 Feb 12 21:44:42.915438 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3073/6280] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:42 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:43.932065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:43.932738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:43.940334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:43.940800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:43.941627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:43.942079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:44.005006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:44.012997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9f508fee-cd8d-4f15-8216-63d7ef5618d3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1297 microversion: 2.1 time: 0.084729 Feb 12 21:44:44.013706 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3208/6281] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:43 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:45.037685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:45.038287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:45.045925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:45.046378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:45.047186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:45.047625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:45.392439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:45.401433 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-94679732-188d-40e5-bb1e-72a4e6da7c56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.367438 Feb 12 21:44:45.402261 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3074/6282] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:45 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:45.911119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7f220e9e-d569-4629-8cb3-44000d1c6765 req-c84fc449-4ab1-4b3e-b76a-8cffca303851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:45.913301 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:45.913301 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:44:45.921432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7f220e9e-d569-4629-8cb3-44000d1c6765 req-c84fc449-4ab1-4b3e-b76a-8cffca303851 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:45.921952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7f220e9e-d569-4629-8cb3-44000d1c6765 req-c84fc449-4ab1-4b3e-b76a-8cffca303851 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:45.935373 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7f220e9e-d569-4629-8cb3-44000d1c6765 req-c84fc449-4ab1-4b3e-b76a-8cffca303851 service nova] Creating event network-changed:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch2-master-1 Feb 12 21:44:45.941388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7f220e9e-d569-4629-8cb3-44000d1c6765 req-c84fc449-4ab1-4b3e-b76a-8cffca303851 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034570 Feb 12 21:44:45.942188 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3209/6283] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:46.420055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:46.421300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:46.428462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:46.428921 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:46.429752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:46.430192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:46.680928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:46.689265 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb7600b6-3072-4fd0-ace6-4755d02d5b3b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.272989 Feb 12 21:44:46.689889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3075/6284] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:46 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:47.706875 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:47.707676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:47.715157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:47.715634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:47.716445 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:47.716907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:47.856813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:47.864809 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9c26071a-39ac-49c2-a6c6-d002880e3f6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.162363 Feb 12 21:44:47.865403 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3210/6285] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:47 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:48.882436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:48.883045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:48.889984 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:48.890547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:48.891336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:48.891775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:49.029107 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:49.036971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4f38bd0f-1a47-4e10-9956-adcfb830154c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.158298 Feb 12 21:44:49.037565 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3076/6286] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:48 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:50.054205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:50.054735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:50.061806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:50.062268 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:50.063064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:50.063515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:50.196937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:50.205299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1fe0aa8b-950e-4277-bf67-a140cd576a02 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.154899 Feb 12 21:44:50.205913 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3211/6287] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:50 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:51.222819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:51.223377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:51.230335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:51.230792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:51.231580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:51.232025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:51.366443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:51.373975 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5e89f648-af5c-489f-a753-c2bab396bf87 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.154953 Feb 12 21:44:51.374758 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3077/6288] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:51 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:52.391488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:52.392240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:52.398903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:52.399407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:52.400215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:52.400668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:52.539266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:52.547709 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c42b05ed-879b-4732-b904-f437d4495d12 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.160707 Feb 12 21:44:52.548301 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3212/6289] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:52 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:52.756153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d633f51a-1bf8-435a-b80a-b22f6dc0e9f6 req-14708305-115c-4378-986a-9fd107cfa872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "name": "network-vif-plugged", "status": "completed", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:52.757786 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:52.757786 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:44:52.766075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d633f51a-1bf8-435a-b80a-b22f6dc0e9f6 req-14708305-115c-4378-986a-9fd107cfa872 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:52.766528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d633f51a-1bf8-435a-b80a-b22f6dc0e9f6 req-14708305-115c-4378-986a-9fd107cfa872 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:52.777288 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d633f51a-1bf8-435a-b80a-b22f6dc0e9f6 req-14708305-115c-4378-986a-9fd107cfa872 service nova] Creating event network-vif-plugged:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch2-master-1 Feb 12 21:44:52.782412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d633f51a-1bf8-435a-b80a-b22f6dc0e9f6 req-14708305-115c-4378-986a-9fd107cfa872 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030160 Feb 12 21:44:52.782995 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3078/6290] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:44:53.565128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:53.565784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:53.572670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:53.573144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:53.573981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:53.574442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:53.711333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:53.719246 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c8348a3e-47c8-4e3c-bbb2-45461f6a02e6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1363 microversion: 2.1 time: 0.158590 Feb 12 21:44:53.719851 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3213/6291] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:53 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:54.737977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:54.738609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:54.744817 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:54.745270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:54.746240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:54.746687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:54.884238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:54.891717 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-af8bea65-9082-4947-ad38-dc3818d117ea tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1550 microversion: 2.1 time: 0.159419 Feb 12 21:44:54.892299 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3079/6292] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:54 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:54.908338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:54.908824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:54.915865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:54.916334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:54.917129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:54.917605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:54.999581 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d5c1cf7-df9b-4d12-9304-b48635ea687f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095577 Feb 12 21:44:55.000205 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3214/6293] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:44:54 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:56.020410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:56.021176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:56.028765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:56.029218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:56.030873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:56.033283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:56.087676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1ad27866-e2bd-4bd6-b94e-04e6e5794302 req-a1e257c9-e3d8-49b3-b554-10a8e163d3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:56.089396 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:44:56.089396 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:44:56.098126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1ad27866-e2bd-4bd6-b94e-04e6e5794302 req-a1e257c9-e3d8-49b3-b554-10a8e163d3d9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:56.111127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1ad27866-e2bd-4bd6-b94e-04e6e5794302 req-a1e257c9-e3d8-49b3-b554-10a8e163d3d9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:56.111127 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1ad27866-e2bd-4bd6-b94e-04e6e5794302 req-a1e257c9-e3d8-49b3-b554-10a8e163d3d9 service nova] Creating event network-changed:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch2-master-1 Feb 12 21:44:56.116282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1ad27866-e2bd-4bd6-b94e-04e6e5794302 req-a1e257c9-e3d8-49b3-b554-10a8e163d3d9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098654 Feb 12 21:44:56.118150 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3215/6294] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:44:56.207900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:56.215337 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee76e17d-a7a9-415d-a1b1-8d7f53d8c646 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1550 microversion: 2.1 time: 0.198622 Feb 12 21:44:56.216111 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3080/6295] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:56 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1550 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:56.232396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:56.233609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:56.240090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:56.240771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:56.241804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:56.242432 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:56.392512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:56.402856 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16310806-271e-46db-8bc1-d7ec024b8612 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1550 microversion: 2.1 time: 0.174533 Feb 12 21:44:56.408419 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3216/6296] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:56 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:57.420052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:57.421200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:57.427972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:57.428420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:57.429211 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:57.429678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:57.568042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:57.575508 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d43bcfb1-1b1f-42f4-8f03-f6d564fe9e5b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1668 microversion: 2.1 time: 0.159190 Feb 12 21:44:57.576083 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3081/6297] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:57 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:57.591564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:57.592189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:57.599077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:57.599543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:57.600337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:57.600786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:57.734623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:57.742506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-734184c2-9948-4c8b-92f0-3feaa80ea855 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1668 microversion: 2.1 time: 0.154711 Feb 12 21:44:57.743083 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3217/6298] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:57 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:44:57.761485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:44:57.762485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:57.770329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:57.770897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:57.771673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:57.772106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:57.802614 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:57.808412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Old instance type m1.heat2, new instance type m1.heat {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:44:57.814950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:44:57.815378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:44:57.815907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:44:57.816272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:44:57.816691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:44:58.014386 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c3758742-56e0-4e0f-bee9-ef9682edb708 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee/action" status: 202 len: 0 microversion: 2.1 time: 0.258320 Feb 12 21:44:58.015107 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3082/6299] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:44:57 2022] POST /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:44:58.023069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:58.023787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:58.030845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:58.031313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:58.032156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:58.032620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:58.165971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:58.174474 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2a41c43-fe97-4c09-8229-701f0f8568e9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1677 microversion: 2.1 time: 0.155172 Feb 12 21:44:58.175054 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3218/6300] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:58 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:44:59.193345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:44:59.194027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:44:59.200343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:59.200797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:59.202261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:44:59.202790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:44:59.341373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:44:59.348788 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7f02cb76-4d01-4750-b973-77f4eeba01c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1677 microversion: 2.1 time: 0.160144 Feb 12 21:44:59.349373 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3083/6301] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:44:59 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:00.366174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:00.366795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:00.373701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:00.374169 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:00.375986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:00.375986 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:00.517637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:00.525639 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-92623cbe-2ef1-415f-a4c9-b6a694dd3b8b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1677 microversion: 2.1 time: 0.163149 Feb 12 21:45:00.526221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3219/6302] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:00 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:01.543383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:01.544002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:01.551586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:01.552046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:01.552837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:01.553284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:01.691532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:01.699376 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09dcb86e-886d-4629-88ce-c3cbab30b54c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.160161 Feb 12 21:45:01.700019 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3084/6303] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:01 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:02.717038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:02.717702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:02.724668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:02.725138 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:02.726032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:02.726511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:03.169850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:03.178162 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07a9caff-0e70-4dc7-abde-42f4bcd91d05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.464906 Feb 12 21:45:03.178744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3220/6304] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:02 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:04.195463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:04.196109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:04.204002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:04.204476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:04.205269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:04.205737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:04.346311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:04.353930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-81762c93-b00c-401c-bf12-1cce15552e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.162199 Feb 12 21:45:04.354527 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3085/6305] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:04 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:05.371369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:05.372024 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:05.379040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:05.379507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:05.380304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:05.380781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:05.514925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:05.522627 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c9b93cf-6853-4a3d-84cf-244e1dd4c994 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.155004 Feb 12 21:45:05.529520 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3221/6306] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:05 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:06.540266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:06.541032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:06.548382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:06.548830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:06.549633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:06.550067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:06.681108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:06.689388 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c1a27ce9-fe36-4b2f-8989-03cf02c79ce1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.152852 Feb 12 21:45:06.689958 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3086/6307] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:06 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:07.706855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:07.707509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:07.714353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:07.714827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:07.715630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:07.716085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:07.853465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:07.863264 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a2de0178-5b3e-4088-b468-c3624c853f1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.160210 Feb 12 21:45:07.864078 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3222/6308] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:07 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:08.879966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:08.880585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:08.887141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:08.887597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:08.888384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:08.888823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:09.027608 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:09.035271 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7e2f32fe-2344-44c9-97ee-e662f9590419 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.159143 Feb 12 21:45:09.035851 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3087/6309] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:08 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:10.052601 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:10.053154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:10.060120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:10.060597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:10.061438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:10.061904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:10.196027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:10.204329 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e10378d-f25a-42b6-98c0-a129abe45732 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.155617 Feb 12 21:45:10.204913 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3223/6310] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:10 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:11.222127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:11.222738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:11.229515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:11.229966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:11.230749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:11.231183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:11.362318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:11.369635 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-14628431-ad97-45df-bbe7-67859276f835 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.151894 Feb 12 21:45:11.370201 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3088/6311] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:11 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:11.768021 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:45:11.768197 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 21:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:45:12.387225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:12.387863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:12.395750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:12.396353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:12.397168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:12.397652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:12.533531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:12.541168 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93c05d1c-e8ae-483b-a8bb-67b800b13159 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.157463 Feb 12 21:45:12.541774 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3224/6312] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:12 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:13.558400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:13.559014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:13.565819 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:13.566275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:13.567053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:13.567488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:13.699752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:13.707562 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60a39f15-8eed-4e67-86bc-d06d18928d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.152904 Feb 12 21:45:13.708162 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3089/6313] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:13 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:14.725189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:14.725756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:14.732951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:14.737258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:14.737258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:14.737258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:14.877754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:14.885280 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f7803dfa-cd0c-45e1-8436-fb0cb1f78d59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.164343 Feb 12 21:45:14.885884 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3225/6314] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:14 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:15.902905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:15.903526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:15.910587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:15.911053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:15.911864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:15.912303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:16.052555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:16.060071 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-566880a5-5772-482c-bcfe-8860cdb2ea2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.160964 Feb 12 21:45:16.060637 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3090/6315] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:15 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:17.078753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:17.079509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:17.086648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:17.087122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:17.087943 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:17.088399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:17.223344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:17.230849 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3812f9f-1609-4003-a213-3240fa65f7c2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1682 microversion: 2.1 time: 0.156725 Feb 12 21:45:17.231422 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3226/6316] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:17 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:18.248547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:18.249168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:18.256560 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:18.257019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:18.257886 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:18.258316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:18.535775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:18.543568 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e0756e4d-2d8c-43ad-be39-1bf09e2c7a6d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1681 microversion: 2.1 time: 0.299095 Feb 12 21:45:18.544149 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3091/6317] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:18 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:18.614527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6cd18101-f475-4faa-9587-c9494a9bf86a req-0b858a5e-5ef9-47fb-836d-c55d184b0f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "name": "network-vif-unplugged", "status": "completed", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:18.616116 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:18.616116 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:45:18.623941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6cd18101-f475-4faa-9587-c9494a9bf86a req-0b858a5e-5ef9-47fb-836d-c55d184b0f17 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:18.624409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6cd18101-f475-4faa-9587-c9494a9bf86a req-0b858a5e-5ef9-47fb-836d-c55d184b0f17 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:18.638553 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6cd18101-f475-4faa-9587-c9494a9bf86a req-0b858a5e-5ef9-47fb-836d-c55d184b0f17 service nova] Creating event network-vif-unplugged:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch1-master-1 Feb 12 21:45:18.649587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-6cd18101-f475-4faa-9587-c9494a9bf86a req-0b858a5e-5ef9-47fb-836d-c55d184b0f17 service nova] Instance 82087afc-7369-4c73-9e70-f1ce64b475ee is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:45:18.655535 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6cd18101-f475-4faa-9587-c9494a9bf86a req-0b858a5e-5ef9-47fb-836d-c55d184b0f17 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044748 Feb 12 21:45:18.656426 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3227/6318] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:45:19.561163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:19.561816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:19.568980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:19.569486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:19.570292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:19.570739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:19.824491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:19.832403 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8e757158-8510-4d56-9b0c-5d8292264030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1681 microversion: 2.1 time: 0.274922 Feb 12 21:45:19.833092 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3092/6319] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:19 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:45:20.671513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-25aef67d-2f24-42b0-a1fa-b6b215a0d4aa req-74703148-d2b4-43db-b6fb-2b724397cc80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:20.673009 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:20.673009 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:45:20.680270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-25aef67d-2f24-42b0-a1fa-b6b215a0d4aa req-74703148-d2b4-43db-b6fb-2b724397cc80 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:20.680732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-25aef67d-2f24-42b0-a1fa-b6b215a0d4aa req-74703148-d2b4-43db-b6fb-2b724397cc80 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:20.692313 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-25aef67d-2f24-42b0-a1fa-b6b215a0d4aa req-74703148-d2b4-43db-b6fb-2b724397cc80 service nova] Creating event network-changed:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch1-master-1 Feb 12 21:45:20.697672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-25aef67d-2f24-42b0-a1fa-b6b215a0d4aa req-74703148-d2b4-43db-b6fb-2b724397cc80 service nova] Instance 82087afc-7369-4c73-9e70-f1ce64b475ee is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:45:20.708829 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-25aef67d-2f24-42b0-a1fa-b6b215a0d4aa req-74703148-d2b4-43db-b6fb-2b724397cc80 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042517 Feb 12 21:45:20.709457 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3228/6320] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:45:20.850385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:20.851158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:20.858092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:20.864275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:20.864275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:20.864275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:21.168849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:21.176988 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f650bcaa-ac3f-482c-8d75-23212caa0f91 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1679 microversion: 2.1 time: 0.330338 Feb 12 21:45:21.177803 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3093/6321] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:20 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:22.195936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:22.196718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:22.203210 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:22.203681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:22.204487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:22.204947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:22.346127 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:22.353591 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b983fe85-22e8-4878-a97d-1cd5b3c512bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1676 microversion: 2.1 time: 0.162666 Feb 12 21:45:22.354181 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3229/6322] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:22 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:22.369872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:22.370411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:22.377433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:22.377895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:22.378685 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:22.379130 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:22.604483 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f08ac76e-bfaa-4d96-8773-255445d8c7ec tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee/action" status: 204 len: 0 microversion: 2.1 time: 0.238090 Feb 12 21:45:22.605096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3094/6323] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:45:22 2022] POST /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee/action => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:45:22.614559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:22.615267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:22.621249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:22.621762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:22.623385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:22.623913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:22.762932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:22.771585 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cb8efbe0-79aa-4132-87a6-508d22ba032e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1676 microversion: 2.1 time: 0.161988 Feb 12 21:45:22.772181 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3230/6324] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:22 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:23.789995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:23.790729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:23.799265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:23.799723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:23.800531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:23.800977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:23.945913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:23.953693 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-756c6f7d-83b1-41f8-82f5-b2690196f1e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1676 microversion: 2.1 time: 0.167927 Feb 12 21:45:23.954262 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3095/6325] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:23 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:24.971161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:24.971814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:24.978350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:24.978821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:24.979614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:24.980060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.117436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:25.126439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b17aff16-c8d6-4ccc-8536-25072ad9c1c3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1668 microversion: 2.1 time: 0.159042 Feb 12 21:45:25.127222 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3231/6326] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:24 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:25.143420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:25.144029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:25.151115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.151576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.152387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.152835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.299906 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:25.307780 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a025111f-a036-4f0c-9953-7048b034a0f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1668 microversion: 2.1 time: 0.168802 Feb 12 21:45:25.308360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3096/6327] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:25 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:25.324433 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:25.325050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:25.331810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.332350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.333886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.333886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.399771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-940794ea-7eba-4b98-a018-5e4207fb435f req-8ddfe835-5f0f-4fb4-ae8a-6da08b53c3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "name": "network-vif-plugged", "status": "completed", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:25.402543 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:25.402543 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:45:25.409065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-940794ea-7eba-4b98-a018-5e4207fb435f req-8ddfe835-5f0f-4fb4-ae8a-6da08b53c3ce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.409557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-940794ea-7eba-4b98-a018-5e4207fb435f req-8ddfe835-5f0f-4fb4-ae8a-6da08b53c3ce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.421866 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-940794ea-7eba-4b98-a018-5e4207fb435f req-8ddfe835-5f0f-4fb4-ae8a-6da08b53c3ce service nova] Creating event network-vif-plugged:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch1-master-1 Feb 12 21:45:25.427138 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-940794ea-7eba-4b98-a018-5e4207fb435f req-8ddfe835-5f0f-4fb4-ae8a-6da08b53c3ce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 Feb 12 21:45:25.428098 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3097/6328] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:45:25.469541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:25.477142 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-097b60ce-28ff-41a2-8786-0f64ec8012c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1668 microversion: 2.1 time: 0.156422 Feb 12 21:45:25.477745 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3232/6329] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:25 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:25.493636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:25.496324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:25.501060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.501552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.502485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.502919 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.528463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:45:25.877207 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-77ad9c50-9dfd-44c3-a28c-35430a718634 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 204 len: 0 microversion: 2.1 time: 0.387398 Feb 12 21:45:25.877839 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3098/6330] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:45:25 2022] DELETE /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:45:25.885850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:25.886472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:25.893154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.893644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:25.894436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:25.894884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:26.028221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:26.036262 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a678c126-dd9d-48f0-86bf-49e297368ae6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1674 microversion: 2.1 time: 0.154167 Feb 12 21:45:26.036852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3233/6331] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:25 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:27.054863 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:27.055496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:27.062949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:27.063398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:27.064183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:27.064624 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:27.206738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:27.214728 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae78eae7-2d0e-4b27-9e04-3de3a491702d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1674 microversion: 2.1 time: 0.163960 Feb 12 21:45:27.215315 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3099/6332] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:27 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:28.232099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:28.234651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:28.244609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:28.244609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:28.245706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:28.246162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:28.298884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-229d66ee-40ea-4763-95a0-6e91c30a2256 req-ac5f4c54-e404-42f0-86e4-a06ed0d1ac7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82087afc-7369-4c73-9e70-f1ce64b475ee", "name": "network-vif-deleted", "tag": "11da9a80-0838-4dd0-8650-496ef5fdd27d"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:28.301253 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:28.301253 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:45:28.310414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-229d66ee-40ea-4763-95a0-6e91c30a2256 req-ac5f4c54-e404-42f0-86e4-a06ed0d1ac7d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:28.311209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-229d66ee-40ea-4763-95a0-6e91c30a2256 req-ac5f4c54-e404-42f0-86e4-a06ed0d1ac7d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:28.323755 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-229d66ee-40ea-4763-95a0-6e91c30a2256 req-ac5f4c54-e404-42f0-86e4-a06ed0d1ac7d service nova] Creating event network-vif-deleted:11da9a80-0838-4dd0-8650-496ef5fdd27d for instance 82087afc-7369-4c73-9e70-f1ce64b475ee on nch1-master-1 Feb 12 21:45:28.330363 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-229d66ee-40ea-4763-95a0-6e91c30a2256 req-ac5f4c54-e404-42f0-86e4-a06ed0d1ac7d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035358 Feb 12 21:45:28.331571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3100/6333] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:45:28.338315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:28.346434 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d4849f28-6e78-4108-b257-4328f42526ce tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 200 len: 1606 microversion: 2.1 time: 0.118095 Feb 12 21:45:28.347223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3234/6334] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:28 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 1606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:29.365521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:29.366192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:29.372752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:29.373202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:29.374142 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:29.375104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:29.389085 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. Feb 12 21:45:29.389729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:45:29.391245 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66521d7a-7541-4522-8d30-8039fe8bf227 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 404 len: 111 microversion: 2.1 time: 0.030683 Feb 12 21:45:29.391821 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3101/6335] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:29 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:45:29.408644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:29.409273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:29.416487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:29.416954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:29.417784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:29.418358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:29.431628 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. Feb 12 21:45:29.432228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:45:29.433094 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-db3c3ada-5c1b-4702-9912-7c0719d25ed5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 404 len: 111 microversion: 2.1 time: 0.028497 Feb 12 21:45:29.433660 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3235/6336] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:29 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:45:29.479928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-963186935", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "34fb4bd0-7538-4c5d-aca6-00f04cac631c"}], "security_groups": [{"name": "tempest-securitygroup--1424401669"}], "key_name": "tempest-keypair-482931291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:29.580955 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] validate_networks() for [('34fb4bd0-7538-4c5d-aca6-00f04cac631c', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:45:29.957467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:45:29.962954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:45:29.962954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:45:29.962954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:45:29.962954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:45:29.968510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:29.969111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:29.969960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:29.970400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:29.987671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:45:29.992849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:45:30.005913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:45:30.008331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:45:30.136078 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bcb45abe-3f91-4eb5-a951-453a43e5f58a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.659874 Feb 12 21:45:30.136735 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3102/6337] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:45:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:45:30.147869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-60fda9db-e0f3-4356-852f-c25824d887f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:30.152325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-60fda9db-e0f3-4356-852f-c25824d887f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:30.201981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-60fda9db-e0f3-4356-852f-c25824d887f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:30.209609 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-60fda9db-e0f3-4356-852f-c25824d887f1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1237 microversion: 2.1 time: 0.065404 Feb 12 21:45:30.210088 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3236/6338] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:30 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:31.227957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:31.228554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:31.235956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:31.236423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:31.237212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:31.237689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:31.299959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:31.307400 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc6b1571-7ead-46b0-acd2-da549d66a6cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1241 microversion: 2.1 time: 0.084015 Feb 12 21:45:31.308096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3103/6339] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:31 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:32.325305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:32.326104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:32.334028 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:32.334605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:32.335472 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:32.335994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:32.407167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:32.415203 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-909ad955-9ab3-4a12-83f3-4b8df4ae7b35 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1307 microversion: 2.1 time: 0.093801 Feb 12 21:45:32.416230 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3237/6340] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:32 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:33.432871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:33.437791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:33.440655 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:33.441110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:33.441927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:33.442398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:33.692922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:33.702816 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-86842ad6-d4d7-4660-bd6b-6bae82e58788 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.273502 Feb 12 21:45:33.712962 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3104/6341] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:33 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:33.882588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-60ac4ac0-84bf-45de-a275-a4bc7f6e88f3 req-a7c094a4-6736-420f-aeee-47152d8b69e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:33.886708 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:33.886708 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:45:33.896410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-60ac4ac0-84bf-45de-a275-a4bc7f6e88f3 req-a7c094a4-6736-420f-aeee-47152d8b69e5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:33.896889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-60ac4ac0-84bf-45de-a275-a4bc7f6e88f3 req-a7c094a4-6736-420f-aeee-47152d8b69e5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:33.910865 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-60ac4ac0-84bf-45de-a275-a4bc7f6e88f3 req-a7c094a4-6736-420f-aeee-47152d8b69e5 service nova] Creating event network-changed:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch1-master-1 Feb 12 21:45:33.915933 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-60ac4ac0-84bf-45de-a275-a4bc7f6e88f3 req-a7c094a4-6736-420f-aeee-47152d8b69e5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037151 Feb 12 21:45:33.916969 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3238/6342] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:45:34.720364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:34.720983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:34.727875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:34.728334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:34.729126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:34.729600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:34.865789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:34.873193 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a83d369f-87fb-45da-8c40-115d789dd428 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.156705 Feb 12 21:45:34.873802 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3105/6343] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:34 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:35.892492 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:35.893215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:35.900198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:35.900679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:35.910966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:35.910966 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:36.048383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:36.056172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8dff24ec-3128-4e37-b1df-64d1613d8ace tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.169189 Feb 12 21:45:36.056760 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3239/6344] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:35 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:37.075950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:37.077065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:37.214700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:37.214700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:37.214700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:37.214700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:37.243225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:37.250873 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed5e2765-54d9-4f58-a39b-9beab1f507a9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.179828 Feb 12 21:45:37.251456 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3106/6345] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:37 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:38.268270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:38.268894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:38.275753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:38.276223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:38.277017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:38.277496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:38.413650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:38.422378 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1b7b1003-95b1-402e-957f-b445dbefadd2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.156936 Feb 12 21:45:38.422899 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3240/6346] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:38 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:39.354318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ffd8fcbe-7d55-4f24-8f43-a8292f50a12e req-e300a32e-2492-487a-8025-6d9f11a06afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "name": "network-vif-plugged", "status": "completed", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:39.355940 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:39.355940 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:45:39.364245 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ffd8fcbe-7d55-4f24-8f43-a8292f50a12e req-e300a32e-2492-487a-8025-6d9f11a06afd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:39.364779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ffd8fcbe-7d55-4f24-8f43-a8292f50a12e req-e300a32e-2492-487a-8025-6d9f11a06afd service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:39.377979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ffd8fcbe-7d55-4f24-8f43-a8292f50a12e req-e300a32e-2492-487a-8025-6d9f11a06afd service nova] Creating event network-vif-plugged:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch1-master-1 Feb 12 21:45:39.382879 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ffd8fcbe-7d55-4f24-8f43-a8292f50a12e req-e300a32e-2492-487a-8025-6d9f11a06afd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032520 Feb 12 21:45:39.383477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3107/6347] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:45:39.439012 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:39.439643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:39.446726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:39.447213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:39.448004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:39.448457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:39.586903 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:39.595553 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-719389de-aace-4e38-8122-ddc5a6083f17 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.160207 Feb 12 21:45:39.596075 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3241/6348] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:39 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:40.614436 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:40.615146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:40.622237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:40.622695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:40.623490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:40.623934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:40.764377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:40.772623 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-276673ec-c992-43ac-8832-17a24dc9fcb4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1363 microversion: 2.1 time: 0.163335 Feb 12 21:45:40.773191 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3108/6349] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:40 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:41.790576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:41.791486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:41.799572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:41.800042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:41.800843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:41.801295 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:41.938668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:41.946792 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-56cccd8f-4150-4102-bf2c-6947b69bc1e7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1549 microversion: 2.1 time: 0.160028 Feb 12 21:45:41.947375 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3242/6350] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:41 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:45:41.963158 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:41.963818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:41.970653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:41.971104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:41.971887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:41.972325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:42.055968 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-efd20e7c-3268-4370-a7c7-4b2d30850809 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096363 Feb 12 21:45:42.056576 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3109/6351] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:45:41 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:45:43.412181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f4852a92-029b-472d-898a-896194443d46 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:43.415113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-13b6dae4-d123-4422-bcb1-fd08e75f74a1 req-262dda85-5674-4d05-aea5-b6959d7058d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:45:43.417004 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:45:43.417004 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:45:43.420578 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f4852a92-029b-472d-898a-896194443d46 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:43.421057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f4852a92-029b-472d-898a-896194443d46 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:43.425308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-13b6dae4-d123-4422-bcb1-fd08e75f74a1 req-262dda85-5674-4d05-aea5-b6959d7058d0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:43.426067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-13b6dae4-d123-4422-bcb1-fd08e75f74a1 req-262dda85-5674-4d05-aea5-b6959d7058d0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:43.438743 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-13b6dae4-d123-4422-bcb1-fd08e75f74a1 req-262dda85-5674-4d05-aea5-b6959d7058d0 service nova] Creating event network-changed:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch1-master-1 Feb 12 21:45:43.444272 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-13b6dae4-d123-4422-bcb1-fd08e75f74a1 req-262dda85-5674-4d05-aea5-b6959d7058d0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033856 Feb 12 21:45:43.444886 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3110/6352] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:45:43.447454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f4852a92-029b-472d-898a-896194443d46 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Going to try to stop instance {{(pid=141727) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:45:43.646232 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f4852a92-029b-472d-898a-896194443d46 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action" status: 202 len: 0 microversion: 2.1 time: 0.237446 Feb 12 21:45:43.647233 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3243/6353] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:45:43 2022] POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:45:43.657924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:43.659377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:43.672398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:43.672869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:43.673738 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:43.674399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:43.874719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:43.883189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2e5c2211-6f90-4be0-8525-12033a2ddb2b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1559 microversion: 2.1 time: 0.231486 Feb 12 21:45:43.884007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3111/6354] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:43 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:44.902185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:44.902918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:44.910370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:44.910835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:44.911628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:44.912072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:45.049227 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:45.056682 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aac94091-7249-428e-8385-f5ff8842fd59 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.159490 Feb 12 21:45:45.057272 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3244/6355] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:44 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:46.074673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:46.075214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:46.085785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:46.086234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:46.087034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:46.087490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:46.229336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:46.237695 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a9df5dcd-d29c-433d-b5a0-4fb36fef1836 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.166791 Feb 12 21:45:46.238266 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3112/6356] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:46 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:47.254895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:47.255528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:47.262443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:47.264059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:47.264059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:47.264314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:47.397764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:47.405127 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a87039b4-28eb-479c-8251-e148d60c1f9e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.154641 Feb 12 21:45:47.405811 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3245/6357] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:47 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:48.423649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:48.424269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:48.431174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:48.431631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:48.432415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:48.432857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:48.567185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:48.574654 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebdb0a0a-13ce-4967-b218-5a907f393fd5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.155264 Feb 12 21:45:48.575238 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3113/6358] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:48 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:49.591774 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:49.592397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:49.599291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:49.599758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:49.600595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:49.601050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:49.739017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:49.746548 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a6962d5c-fe10-46a5-957e-9905add53386 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.158543 Feb 12 21:45:49.747127 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3246/6359] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:49 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:50.763868 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:50.764486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:50.771343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:50.771799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:50.772622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:50.773065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:50.910516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:50.918374 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec73d84d-c32b-42a2-8af0-91f69dd5015d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.158208 Feb 12 21:45:50.918947 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3114/6360] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:50 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:51.936064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:51.936699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:51.944333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:51.944821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:51.945667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:51.946134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:52.081861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:52.089493 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-950dbc01-f6f5-441b-8ea0-373989fb78c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.157170 Feb 12 21:45:52.090068 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3247/6361] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:51 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:53.106668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:53.107289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:53.114345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:53.114799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:53.115579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:53.116013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:53.254702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:53.262221 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-abbd726d-681f-4f10-aaaa-d2841e28b5af tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.159572 Feb 12 21:45:53.262815 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3115/6362] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:53 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:54.280250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:54.281521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:54.288328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:54.288749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:54.289597 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:54.290056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:54.432316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:54.440335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5815db8d-85c6-4d51-b948-85f692eb7f70 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.164082 Feb 12 21:45:54.441027 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3248/6363] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:54 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:55.457864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:55.458542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:55.464983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:55.465490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:55.466296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:55.466744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:55.599390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:55.606890 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d616857-d2cb-46a4-8192-4c43db32ca48 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.152991 Feb 12 21:45:55.607464 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3116/6364] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:55 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:56.624354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:56.625671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:56.632376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:56.632840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:56.633733 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:56.634224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:56.769345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:56.776871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce6520c8-9845-4b3f-af9f-aff076f516ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.156264 Feb 12 21:45:56.777470 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3249/6365] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:56 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:57.793937 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:57.794545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:57.801781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:57.802239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:57.803033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:57.803474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:57.940883 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:57.948210 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cc451f91-a0ae-4d7e-a2b2-b2c1e304ec21 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.158456 Feb 12 21:45:57.948780 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3117/6366] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:57 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:45:58.966013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:45:58.966646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:45:58.974211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:58.974681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:58.975481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:45:58.975934 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:45:59.108955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:45:59.116536 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6d0e29fb-707f-4849-b142-6f1f725c8c73 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.154224 Feb 12 21:45:59.117109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3250/6367] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:45:58 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:00.136105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:00.136714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:00.143888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:00.144343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:00.145124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:00.145586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:00.278062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:00.285989 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48112851-dab9-4090-8819-351a7b47027d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.153804 Feb 12 21:46:00.286571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3118/6368] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:00 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:01.303336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:01.303962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:01.311365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:01.311832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:01.312637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:01.313083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:01.462526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:01.470113 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-26e126fe-bfda-45b8-bc22-56aafd8a76b1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.170503 Feb 12 21:46:01.470694 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3251/6369] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:01 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:02.487680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:02.488221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:02.495132 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:02.495582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:02.496360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:02.496797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:02.632112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:02.639417 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43f99b24-9b21-4cf1-828d-f14668325d8a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.156102 Feb 12 21:46:02.639987 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3119/6370] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:02 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:03.657779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:03.658394 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:03.665277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:03.665770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:03.666846 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:03.667303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:03.801510 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:03.809271 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-37dde556-6a4e-40f3-b19e-66553d305a16 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.155204 Feb 12 21:46:03.809904 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3252/6371] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:03 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:04.827126 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:04.827775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:04.835307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:04.835763 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:04.836553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:04.836991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:04.969086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:04.977260 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ca64f15-05f0-492b-a54c-fddd44615f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.153841 Feb 12 21:46:04.977866 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3120/6372] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:04 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:05.994386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:05.995020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:06.002134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:06.002547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:06.003383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:06.003839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:06.140700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:06.148293 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c4780f2-629f-4a02-a9d1-9156eefcfa7e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.157718 Feb 12 21:46:06.148864 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3253/6373] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:05 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:46:07.165880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:07.166872 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:07.174391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:07.175005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:07.175837 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:07.176280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:07.314443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:07.321954 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d53c8835-410e-4a76-9217-5faecaf0a886 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.159799 Feb 12 21:46:07.322547 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3121/6374] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:07 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:08.339521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:08.340291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:08.347404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:08.347865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:08.348656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:08.349104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:08.482384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:08.490313 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1dab961a-23c9-46a3-a94d-05a80c348f49 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.154699 Feb 12 21:46:08.490889 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3254/6375] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:08 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:09.507358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:09.507977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:09.514669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:09.515120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:09.515952 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:09.516391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:09.653949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:09.661861 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d115d125-24df-45e6-a571-a562e65dd87e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1654 microversion: 2.1 time: 0.158397 Feb 12 21:46:09.662432 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3122/6376] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:09 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:09.679034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:09.680083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:09.686867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:09.687339 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:09.688143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:09.688593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:09.717798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:09.723670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Old instance type m1.heat2, new instance type m1.heat {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:46:09.729860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:46:09.730370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:46:09.730856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:46:09.731274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:46:09.731698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:46:09.903162 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96de7f3c-78a0-470a-b3d2-246226b7af1c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action" status: 202 len: 0 microversion: 2.1 time: 0.228029 Feb 12 21:46:09.903711 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3255/6377] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:46:09 2022] POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:46:09.911822 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:09.914445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:09.918742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:09.919196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:09.919995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:09.920432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:10.058285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:10.066940 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-571ba6cf-6d91-4104-94aa-88ff3dda54cf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.158688 Feb 12 21:46:10.076168 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3123/6378] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:09 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:11.084666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:11.085928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:11.092833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:11.093309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:11.099405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:11.099405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:11.239191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:11.246790 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89082bb1-8efb-4c6b-a7f9-f45e01f1bfbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.166614 Feb 12 21:46:11.247368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3256/6379] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:11 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:12.265181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:12.265799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:12.273153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:12.273650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:12.274445 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:12.274894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:12.489013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:12.496691 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4164a0a2-24c6-4a03-94d6-b4a7f606101a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1677 microversion: 2.1 time: 0.235332 Feb 12 21:46:12.497278 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3124/6380] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:12 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:13.513668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:13.514296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:13.522025 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:13.522496 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:13.523297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:13.523750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:13.659958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:13.668092 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e0d81871-51fd-4de1-bfe8-d8484b6ca338 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1682 microversion: 2.1 time: 0.158155 Feb 12 21:46:13.668667 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3257/6381] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:13 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:14.685610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:14.686175 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:14.694047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:14.694505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:14.695321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:14.695766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:14.833466 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:14.840791 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-397de218-bfa2-4914-a46c-bd1e637ed198 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1682 microversion: 2.1 time: 0.159150 Feb 12 21:46:14.841372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3125/6382] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:14 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:15.858685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:15.859637 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:15.864299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d41699c4-332d-4b6c-84c6-88d429cbbf6e req-9707d223-3b10-463a-a5ab-d2533de424a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "name": "network-vif-unplugged", "status": "completed", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:15.867138 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:15.867138 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:46:15.867927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:15.868400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:15.869213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:15.870003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:15.876289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d41699c4-332d-4b6c-84c6-88d429cbbf6e req-9707d223-3b10-463a-a5ab-d2533de424a4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:15.876289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d41699c4-332d-4b6c-84c6-88d429cbbf6e req-9707d223-3b10-463a-a5ab-d2533de424a4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:15.887123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d41699c4-332d-4b6c-84c6-88d429cbbf6e req-9707d223-3b10-463a-a5ab-d2533de424a4 service nova] Creating event network-vif-unplugged:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch2-master-1 Feb 12 21:46:15.892452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-d41699c4-332d-4b6c-84c6-88d429cbbf6e req-9707d223-3b10-463a-a5ab-d2533de424a4 service nova] Instance 47636390-fb2d-4baf-9973-c169abf215eb is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:46:15.903090 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d41699c4-332d-4b6c-84c6-88d429cbbf6e req-9707d223-3b10-463a-a5ab-d2533de424a4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042403 Feb 12 21:46:15.904893 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3126/6383] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:16.018879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:16.027190 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9e0721fe-acd0-4c2d-b803-8f43a347622a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1681 microversion: 2.1 time: 0.172237 Feb 12 21:46:16.027992 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3258/6384] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:15 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:17.046737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:17.047451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:17.054441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:17.054905 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:17.055710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:17.056156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:17.193001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:17.201006 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7df75ab-80cd-4416-9fe1-912b7a025cde tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1681 microversion: 2.1 time: 0.159781 Feb 12 21:46:17.201732 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3127/6385] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:17 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:17.918349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-1a2ba408-dce5-448a-99f4-e48d65ad6fcb req-9beafc59-d7c7-4214-8e32-70f1d7b241aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:17.919934 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:17.919934 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:46:17.928352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1a2ba408-dce5-448a-99f4-e48d65ad6fcb req-9beafc59-d7c7-4214-8e32-70f1d7b241aa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:17.933337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-1a2ba408-dce5-448a-99f4-e48d65ad6fcb req-9beafc59-d7c7-4214-8e32-70f1d7b241aa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:17.940196 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-1a2ba408-dce5-448a-99f4-e48d65ad6fcb req-9beafc59-d7c7-4214-8e32-70f1d7b241aa service nova] Creating event network-changed:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch2-master-1 Feb 12 21:46:17.945858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-1a2ba408-dce5-448a-99f4-e48d65ad6fcb req-9beafc59-d7c7-4214-8e32-70f1d7b241aa service nova] Instance 47636390-fb2d-4baf-9973-c169abf215eb is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:46:17.956871 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-1a2ba408-dce5-448a-99f4-e48d65ad6fcb req-9beafc59-d7c7-4214-8e32-70f1d7b241aa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042471 Feb 12 21:46:17.957512 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3259/6386] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:18.218966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:18.219658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:18.227354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:18.227885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:18.228747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:18.229250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:18.914546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:18.922395 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ccc9f3df-f495-4859-9c72-ee982898b298 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1679 microversion: 2.1 time: 0.707302 Feb 12 21:46:18.923152 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3128/6387] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:18 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1679 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:19.941334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:19.942074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:19.948856 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:19.949330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:19.950154 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:19.950612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:20.086032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:20.094099 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e5702c97-1784-4b86-b225-055549f1176f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1675 microversion: 2.1 time: 0.157717 Feb 12 21:46:20.094690 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3260/6388] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:19 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:20.113149 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:20.113770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:20.121757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:20.122221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:20.123137 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:20.123585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:20.319704 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ba39a254-bb0b-4a4b-b864-fbd5f63960d1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action" status: 204 len: 0 microversion: 2.1 time: 0.210146 Feb 12 21:46:20.320314 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3129/6389] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:46:20 2022] POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:46:20.328562 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:20.329484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:20.337266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:20.337775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:20.339099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:20.339612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:20.507905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:20.515826 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5329647a-c5d1-4cc5-826e-381d010f0d0d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1675 microversion: 2.1 time: 0.191141 Feb 12 21:46:20.516668 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3261/6390] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:20 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:21.534762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:21.535431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:21.542403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:21.542862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:21.543660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:21.544102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:21.684561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:21.692076 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-002288e3-7d1c-4505-abf3-77537ad7868a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1675 microversion: 2.1 time: 0.162423 Feb 12 21:46:21.692677 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3130/6391] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:21 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:22.710414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:22.710951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:22.717459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:22.717932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:22.718739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:22.719191 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:22.853909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:22.861367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c897d94a-98e2-4794-92b6-da918c6dcb86 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1654 microversion: 2.1 time: 0.155616 Feb 12 21:46:22.861954 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3262/6392] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:22 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:22.877880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:22.878491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:22.886182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:22.886640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:22.887438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:22.887882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:23.027995 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:23.035561 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-437acdb0-ee8b-4509-a4bd-5deea6af28cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1654 microversion: 2.1 time: 0.161259 Feb 12 21:46:23.036138 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3131/6393] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:22 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:23.052636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-186b07f7-5537-4b98-8a4e-7da758d46ca0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:23.058748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186b07f7-5537-4b98-8a4e-7da758d46ca0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:23.059218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-186b07f7-5537-4b98-8a4e-7da758d46ca0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:23.082278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-186b07f7-5537-4b98-8a4e-7da758d46ca0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Going to try to start instance {{(pid=141727) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:46:23.127726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-c5993d12-4f69-41ee-a7f8-6398cd17e199 req-883bde53-aa50-4a99-819e-ae055b0ad8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "name": "network-vif-plugged", "status": "completed", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:23.129739 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:23.129739 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:46:23.137002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c5993d12-4f69-41ee-a7f8-6398cd17e199 req-883bde53-aa50-4a99-819e-ae055b0ad8d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:23.137518 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-c5993d12-4f69-41ee-a7f8-6398cd17e199 req-883bde53-aa50-4a99-819e-ae055b0ad8d1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:23.148722 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-c5993d12-4f69-41ee-a7f8-6398cd17e199 req-883bde53-aa50-4a99-819e-ae055b0ad8d1 service nova] Creating event network-vif-plugged:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch2-master-1 Feb 12 21:46:23.153882 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-c5993d12-4f69-41ee-a7f8-6398cd17e199 req-883bde53-aa50-4a99-819e-ae055b0ad8d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030404 Feb 12 21:46:23.158578 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3132/6394] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:46:23.294143 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-186b07f7-5537-4b98-8a4e-7da758d46ca0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action" status: 202 len: 0 microversion: 2.1 time: 0.245108 Feb 12 21:46:23.294804 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3263/6395] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:46:23 2022] POST /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:46:23.304480 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:23.305439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:23.311815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:23.312266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:23.313061 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:23.313558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:23.454214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:23.462625 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5661c2df-d509-4dfe-8b74-b3a56047a29b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1663 microversion: 2.1 time: 0.163088 Feb 12 21:46:23.463343 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3133/6396] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:23 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:24.481657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:24.482374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:24.488615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:24.489082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:24.490403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:24.490882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:24.636031 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:24.643574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c144a3ba-e8ee-456e-82af-ee3fbff7c8b3 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1663 microversion: 2.1 time: 0.166997 Feb 12 21:46:24.644155 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3264/6397] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:24 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:25.660721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:25.661426 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:25.668534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:25.668991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:25.669802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:25.670246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:25.806031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:25.813576 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7ae57bbf-8a58-494b-9b29-f202b13a199b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1667 microversion: 2.1 time: 0.157001 Feb 12 21:46:25.814145 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3134/6398] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:25 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:25.830167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:25.837521 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:25.838708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:25.839208 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:25.840013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:25.840464 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:25.867575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:46:26.153380 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a728447c-b9c0-4b32-9a38-4c211ee0b842 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 204 len: 0 microversion: 2.1 time: 0.326815 Feb 12 21:46:26.153983 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3265/6399] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:46:25 2022] DELETE /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:46:26.162041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:26.162656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:26.168979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:26.169464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:26.170251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:26.170694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:26.310157 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:26.318095 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5ef18b73-6aa5-423e-9e99-2d8a05bf0a18 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1673 microversion: 2.1 time: 0.159171 Feb 12 21:46:26.318933 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3135/6400] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:26 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:27.339878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:27.340594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:27.347636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:27.348100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:27.348981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:27.349548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:27.488168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:27.496647 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07bc08d9-1cc2-44fd-9e0c-d525ce65b25e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1673 microversion: 2.1 time: 0.160925 Feb 12 21:46:27.497231 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3266/6401] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:27 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:28.384234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a86b4a85-bde7-4f38-8882-74b184b8da61 req-7423c672-2e92-41c5-b9b3-b76aeb398625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47636390-fb2d-4baf-9973-c169abf215eb", "name": "network-vif-deleted", "tag": "dd7e0643-84b8-463e-b9ff-fefe35d6cab9"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:28.386054 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:28.386054 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:46:28.394885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a86b4a85-bde7-4f38-8882-74b184b8da61 req-7423c672-2e92-41c5-b9b3-b76aeb398625 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:28.395342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a86b4a85-bde7-4f38-8882-74b184b8da61 req-7423c672-2e92-41c5-b9b3-b76aeb398625 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:28.408269 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a86b4a85-bde7-4f38-8882-74b184b8da61 req-7423c672-2e92-41c5-b9b3-b76aeb398625 service nova] Creating event network-vif-deleted:dd7e0643-84b8-463e-b9ff-fefe35d6cab9 for instance 47636390-fb2d-4baf-9973-c169abf215eb on nch2-master-1 Feb 12 21:46:28.414674 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a86b4a85-bde7-4f38-8882-74b184b8da61 req-7423c672-2e92-41c5-b9b3-b76aeb398625 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Feb 12 21:46:28.415294 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3136/6402] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:28.513262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:28.513897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:28.522240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:28.523056 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:28.523951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:28.524621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:28.589928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:28.597662 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f168aeea-ad24-45c4-a8f6-a2248e5e3d63 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 200 len: 1322 microversion: 2.1 time: 0.088107 Feb 12 21:46:28.598248 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3267/6403] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:28 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 1322 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:29.616761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:29.617494 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:29.624572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:29.625023 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:29.625830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:29.626266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:29.641891 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. Feb 12 21:46:29.642818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:46:29.643638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a11a3d0a-2c69-436b-b4dc-23c28b006f2a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 404 len: 111 microversion: 2.1 time: 0.031818 Feb 12 21:46:29.644168 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3137/6404] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:29 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:46:29.664272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:29.664905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:29.674279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:29.674600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:29.675425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:29.675881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:29.691957 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. Feb 12 21:46:29.693249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:46:29.694114 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0ef856af-8a31-4852-86a5-2d307cf9d8e8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 404 len: 111 microversion: 2.1 time: 0.034953 Feb 12 21:46:29.694690 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3268/6405] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:29 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:46:29.741484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-707559373", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "34fb4bd0-7538-4c5d-aca6-00f04cac631c"}], "security_groups": [{"name": "tempest-securitygroup--1424401669"}], "key_name": "tempest-keypair-482931291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:29.846780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] validate_networks() for [('34fb4bd0-7538-4c5d-aca6-00f04cac631c', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:46:30.217779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:46:30.218205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:46:30.218682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:46:30.219092 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:46:30.219505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:46:30.228924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:30.229402 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:30.230220 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:30.230654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:30.246936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:46:30.252032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:46:30.264047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:46:30.267401 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:46:30.406638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3b7373cf-5846-40a7-96ae-9c80e062c1e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669407 Feb 12 21:46:30.407287 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3138/6406] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:46:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:46:30.418588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dac8d6a2-049f-4663-b0db-e82f60fd9baa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:30.419258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dac8d6a2-049f-4663-b0db-e82f60fd9baa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:30.473626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dac8d6a2-049f-4663-b0db-e82f60fd9baa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:30.480973 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dac8d6a2-049f-4663-b0db-e82f60fd9baa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1237 microversion: 2.1 time: 0.066473 Feb 12 21:46:30.481770 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3269/6407] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:30 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:31.499690 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:31.500375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:31.507996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:31.508383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:31.511435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:31.511435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:31.573852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:31.581374 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50f54e70-7005-4ad5-a577-57fd1008aead tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1233 microversion: 2.1 time: 0.086604 Feb 12 21:46:31.581959 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3139/6408] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:31 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:32.609142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:32.609909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:32.619233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:32.619878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:32.621090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:32.621702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:32.691531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:32.700782 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2bcbfa9-6619-4f9e-9c66-5474ded1c0cd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1295 microversion: 2.1 time: 0.096458 Feb 12 21:46:32.701701 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3270/6409] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:32 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:33.718086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:33.718779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:33.726713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:33.727242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:33.728106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:33.728820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:33.916783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:33.924613 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0bedfb22-cfdd-4413-88e1-a0e69a79c4df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1363 microversion: 2.1 time: 0.210266 Feb 12 21:46:33.925177 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3140/6410] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:33 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:33.987949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5367ecec-5df9-4c0e-a670-4b781646804c req-53d49385-2ace-4adc-ba45-9ab4c5de6c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:33.992617 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:33.992617 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:46:33.999622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5367ecec-5df9-4c0e-a670-4b781646804c req-53d49385-2ace-4adc-ba45-9ab4c5de6c3f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:34.000310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5367ecec-5df9-4c0e-a670-4b781646804c req-53d49385-2ace-4adc-ba45-9ab4c5de6c3f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:34.015134 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5367ecec-5df9-4c0e-a670-4b781646804c req-53d49385-2ace-4adc-ba45-9ab4c5de6c3f service nova] Creating event network-changed:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:46:34.020647 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5367ecec-5df9-4c0e-a670-4b781646804c req-53d49385-2ace-4adc-ba45-9ab4c5de6c3f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036390 Feb 12 21:46:34.022012 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3271/6411] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:34.942339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:34.942996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:34.950557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:34.951012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:34.951802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:34.952242 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:35.089657 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:35.096895 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-83f8904e-73f0-434f-9f95-aaf98ed3e67c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1363 microversion: 2.1 time: 0.158261 Feb 12 21:46:35.097492 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3141/6412] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:34 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:36.116355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:36.117063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:36.122778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:36.123245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:36.124083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:36.124534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:36.261088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:36.268550 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-accf3e5b-2ce1-4915-95fa-dac0868ad9f6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1363 microversion: 2.1 time: 0.157743 Feb 12 21:46:36.269131 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3272/6413] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:36 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:46:37.286377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:37.287047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:37.296705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:37.297292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:37.298454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:37.298895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:37.443887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:37.451941 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-55da0984-74c1-4925-abb9-1066af7f3b03 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1363 microversion: 2.1 time: 0.169172 Feb 12 21:46:37.452531 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3142/6414] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:37 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:46:38.469967 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:38.470586 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:38.477791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:38.478257 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:38.479051 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:38.479500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:38.611794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:38.619260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-170313d0-a2dd-4bb5-b587-80470e67482d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1363 microversion: 2.1 time: 0.153075 Feb 12 21:46:38.619847 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3273/6415] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:38 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:39.184718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e0b4b9b8-9940-46f3-af24-fba879f17f24 req-18e3f7e9-2d4a-41c3-85c3-7c6a9d1b3c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "name": "network-vif-plugged", "status": "completed", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:39.190624 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:39.190624 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:46:39.194481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e0b4b9b8-9940-46f3-af24-fba879f17f24 req-18e3f7e9-2d4a-41c3-85c3-7c6a9d1b3c5c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:39.194929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e0b4b9b8-9940-46f3-af24-fba879f17f24 req-18e3f7e9-2d4a-41c3-85c3-7c6a9d1b3c5c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:39.207979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e0b4b9b8-9940-46f3-af24-fba879f17f24 req-18e3f7e9-2d4a-41c3-85c3-7c6a9d1b3c5c service nova] Creating event network-vif-plugged:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:46:39.213873 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e0b4b9b8-9940-46f3-af24-fba879f17f24 req-18e3f7e9-2d4a-41c3-85c3-7c6a9d1b3c5c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Feb 12 21:46:39.214479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3143/6416] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:39.636245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:39.636870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:39.643812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:39.644283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:39.645087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:39.645587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:39.784531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:39.792587 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7362d32d-135a-443a-8323-7c7a018226d2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1363 microversion: 2.1 time: 0.159803 Feb 12 21:46:39.793164 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3274/6417] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:39 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:40.810978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:40.811681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:40.817893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:40.819143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:40.819902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:40.820346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:40.959988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:40.967938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1c150a4e-5694-4497-9648-be537e4daee1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1550 microversion: 2.1 time: 0.161820 Feb 12 21:46:40.968531 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3144/6418] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:40 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:40.986623 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:40.987186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:41.000731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:41.001303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:41.002241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:41.002779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:41.088961 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-446c4d79-4e8a-4fa9-957d-d6d6a7005e34 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106830 Feb 12 21:46:41.089603 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3275/6419] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:46:40 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:42.153528 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:42.157225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:42.159053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-6ba6e177-9763-46f0-a189-6dc29b5dd450 req-ed9b28eb-c0b6-4632-8002-8f46ad23d152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:46:42.160679 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:46:42.160679 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:46:42.169392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:42.169837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6ba6e177-9763-46f0-a189-6dc29b5dd450 req-ed9b28eb-c0b6-4632-8002-8f46ad23d152 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:42.169972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:42.170391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-6ba6e177-9763-46f0-a189-6dc29b5dd450 req-ed9b28eb-c0b6-4632-8002-8f46ad23d152 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:42.170723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:42.171159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:42.184484 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-6ba6e177-9763-46f0-a189-6dc29b5dd450 req-ed9b28eb-c0b6-4632-8002-8f46ad23d152 service nova] Creating event network-changed:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:46:42.190357 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-6ba6e177-9763-46f0-a189-6dc29b5dd450 req-ed9b28eb-c0b6-4632-8002-8f46ad23d152 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043843 Feb 12 21:46:42.191001 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3276/6420] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:46:42.204683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:42.212337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Old instance type m1.heat2, new instance type m1.heat {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:46:42.219442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:46:42.219861 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:46:42.220334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:46:42.220809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:46:42.221147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:46:42.409678 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c00dfbf3-5bf6-44fd-96c3-d06d6f00acb7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d/action" status: 202 len: 0 microversion: 2.1 time: 0.264962 Feb 12 21:46:42.414521 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3145/6421] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:46:42 2022] POST /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:46:42.420276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:42.421002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:42.436542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:42.437014 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:42.437866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:42.444129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:42.612560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:42.621476 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2689df16-d17d-4867-b136-c97e6f3eb8d8 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1559 microversion: 2.1 time: 0.205483 Feb 12 21:46:42.632344 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3277/6422] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:42 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:46:43.640155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:43.640785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:43.647866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:43.648329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:43.651674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:43.651674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:43.789305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:43.797631 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0ed82c78-7e15-4315-9449-59b284d85677 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1677 microversion: 2.1 time: 0.161217 Feb 12 21:46:43.798216 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3146/6423] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:43 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:44.814965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:44.815592 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:44.823163 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:44.826059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:44.826059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:44.826059 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:44.963420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:44.971412 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b3bd453-0df3-4fb9-947d-0d681b0c1e05 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1677 microversion: 2.1 time: 0.160187 Feb 12 21:46:44.972018 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3278/6424] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:44 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:45.991010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:45.991729 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:45.998652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:45.999110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:45.999901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:46.000399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:46.478200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:46.485679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8f4f91e-0561-41c2-a9b7-c3666743a8c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.498526 Feb 12 21:46:46.486251 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3147/6425] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:45 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:47.503945 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:47.504573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:47.512120 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:47.512589 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:47.513406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:47.513866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:47.651779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:47.659318 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8ef7f249-b2f4-4c6e-a259-2fe58fbe9993 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.159149 Feb 12 21:46:47.659898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3279/6426] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:47 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:48.676703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:48.677320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:48.684362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:48.684820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:48.685637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:48.686080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:48.818551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:48.826466 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3f85d5b8-c9d6-4969-a3c6-ab96c0ef41d9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.153340 Feb 12 21:46:48.827029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3148/6427] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:48 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:49.843779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:49.844439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:49.851383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:49.851855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:49.852655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:49.853113 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:49.989500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:49.997584 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-50213e99-d964-4284-94ed-6c924b55969c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.157480 Feb 12 21:46:49.998165 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3280/6428] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:49 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:51.015499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:51.016071 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:51.023489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:51.023947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:51.024735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:51.025179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:51.163925 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:51.171614 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2db0c43c-0eab-45ea-80bf-91dbb3a60334 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.160001 Feb 12 21:46:51.172193 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3149/6429] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:51 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:51.468489 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:46:51.469073 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 21:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:46:52.189679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:52.190297 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:52.196765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:52.197229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:52.198066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:52.198512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:52.337264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:52.346760 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6cb8af7c-105f-44e5-b542-157df9c87476 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.161022 Feb 12 21:46:52.347337 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3281/6430] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:52 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:53.363225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:53.363859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:53.370783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:53.371236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:53.372009 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:53.372446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:53.505113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:53.513035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5489a3be-ae00-46e4-9bae-cbf524dd2370 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.153548 Feb 12 21:46:53.513701 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3150/6431] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:53 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:54.531141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:54.532516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:54.539593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:54.540324 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:54.541130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:54.541607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:54.676842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:54.684819 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-03a8a03e-21e4-482f-b3cd-111fa61fcfb9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.158244 Feb 12 21:46:54.685682 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3282/6432] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:54 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:55.702808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:55.703471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:55.710683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:55.711135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:55.712034 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:55.712476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:55.850742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:55.858857 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-939a209c-a124-4458-83ce-10ee77e86970 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.159642 Feb 12 21:46:55.859454 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3151/6433] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:55 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:56.876178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:56.876802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:56.883737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:56.884199 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:56.884992 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:56.885465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:57.018168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:57.026278 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee1dc2cf-fb11-4df9-83ac-005b1745eab0 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.153871 Feb 12 21:46:57.026854 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3283/6434] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:56 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:58.044048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:58.044584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:58.051433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:58.051893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:58.052677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:58.053114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:58.257187 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:58.265019 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee2f00d9-29db-4df9-ade2-87ae040d4045 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.225022 Feb 12 21:46:58.265624 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3152/6435] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:58 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:46:59.281901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:46:59.282534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:46:59.290429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:59.290904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:59.291712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:46:59.292172 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:46:59.434083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:46:59.441747 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27b2a485-ff86-4b8c-8924-ad58c38c9c1a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.163578 Feb 12 21:46:59.442326 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3284/6436] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:46:59 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:00.458792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:00.459407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:00.466718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:00.467168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:00.467949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:00.468384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:00.611727 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:00.619083 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0a231e4a-219f-464e-902c-fdef339360bc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.163978 Feb 12 21:47:00.619652 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3153/6437] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:00 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:01.636107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:01.636850 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:01.643738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:01.644209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:01.645013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:01.645502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:01.779390 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:01.787058 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-19016885-2b07-40f5-8fa4-47a2b24c2ada tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1682 microversion: 2.1 time: 0.154948 Feb 12 21:47:01.787641 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3285/6438] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:01 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:02.805114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:02.806080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:02.813153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:02.813636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:02.814429 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:02.814873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:02.844793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-0ba91d28-c015-40fa-b80f-561ab44372f8 req-2472222e-a801-4194-bcda-3802797b3bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "name": "network-vif-unplugged", "status": "completed", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:02.846684 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:02.846684 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:02.858361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0ba91d28-c015-40fa-b80f-561ab44372f8 req-2472222e-a801-4194-bcda-3802797b3bde service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:02.860438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-0ba91d28-c015-40fa-b80f-561ab44372f8 req-2472222e-a801-4194-bcda-3802797b3bde service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:02.874252 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-0ba91d28-c015-40fa-b80f-561ab44372f8 req-2472222e-a801-4194-bcda-3802797b3bde service nova] Creating event network-vif-unplugged:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch1-master-1 Feb 12 21:47:02.880110 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-0ba91d28-c015-40fa-b80f-561ab44372f8 req-2472222e-a801-4194-bcda-3802797b3bde service nova] Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:47:02.892260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-0ba91d28-c015-40fa-b80f-561ab44372f8 req-2472222e-a801-4194-bcda-3802797b3bde service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052785 Feb 12 21:47:02.892868 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3286/6439] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:47:02.996139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:03.003887 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cbd8b24a-7e1a-4b2b-95a8-5bee698570cc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1681 microversion: 2.1 time: 0.202449 Feb 12 21:47:03.004724 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3154/6440] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:02 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:04.023890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:04.024605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:04.032179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:04.032649 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:04.033471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:04.033924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:04.179202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:04.187712 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c6f1cdf-3fc5-489f-a58f-1a82c549a2f7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1681 microversion: 2.1 time: 0.168713 Feb 12 21:47:04.188501 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3287/6441] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:04 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:04.906877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-296d8154-6b80-4cea-93c2-a617c4b17247 req-c3290533-e8a0-4ea6-91f9-329b4c9c7116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:04.908428 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:04.908428 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:47:04.916337 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-296d8154-6b80-4cea-93c2-a617c4b17247 req-c3290533-e8a0-4ea6-91f9-329b4c9c7116 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:04.916781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-296d8154-6b80-4cea-93c2-a617c4b17247 req-c3290533-e8a0-4ea6-91f9-329b4c9c7116 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:04.931327 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-296d8154-6b80-4cea-93c2-a617c4b17247 req-c3290533-e8a0-4ea6-91f9-329b4c9c7116 service nova] Creating event network-changed:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch1-master-1 Feb 12 21:47:04.936829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-296d8154-6b80-4cea-93c2-a617c4b17247 req-c3290533-e8a0-4ea6-91f9-329b4c9c7116 service nova] Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:47:04.948704 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-296d8154-6b80-4cea-93c2-a617c4b17247 req-c3290533-e8a0-4ea6-91f9-329b4c9c7116 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045395 Feb 12 21:47:04.949312 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3155/6442] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:05.204736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:05.205608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:05.212470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:05.212944 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:05.213790 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:05.214359 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:05.353852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:05.361439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f01a97cd-b85b-4163-a780-e4f5a7a9c322 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1679 microversion: 2.1 time: 0.160439 Feb 12 21:47:05.362025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3288/6443] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:05 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:06.380743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:06.381481 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:06.387827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.388285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.389077 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.389554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.530700 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:06.538211 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6cfce034-8bc1-48a5-93d3-923110178381 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1676 microversion: 2.1 time: 0.162334 Feb 12 21:47:06.538832 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3156/6444] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:06 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:06.555344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:06.555893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:06.562884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.563345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.564153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.564611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.596848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.597314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.598164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.598618 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.619600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:47:06.624609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:47:06.970177 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cea9ede6-f13a-4223-be86-b9b66fa66030 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d/action" status: 202 len: 0 microversion: 2.1 time: 0.418341 Feb 12 21:47:06.970837 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3289/6445] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:47:06 2022] POST /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:47:06.979359 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:06.979975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:06.986122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.991516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:06.991516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:06.991516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:07.152681 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:07.160238 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a291b659-87eb-42de-9da3-146fa3b59b6c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1675 microversion: 2.1 time: 0.185257 Feb 12 21:47:07.160821 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3157/6446] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:06 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:08.179499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:08.180401 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:08.187454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:08.187928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:08.188731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:08.189187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:08.327756 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:08.335262 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a3e1bda2-78e4-4fb8-b8d2-f78bf6077672 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1675 microversion: 2.1 time: 0.159938 Feb 12 21:47:08.336658 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3290/6447] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:08 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:09.353487 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:09.354097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:09.360661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:09.361114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:09.361936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:09.362369 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:09.495329 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:09.502720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9bfed4fe-a25e-4128-8dcb-6216a5dcdc10 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1675 microversion: 2.1 time: 0.153210 Feb 12 21:47:09.503291 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3158/6448] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:09 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:09.844469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-7c9583f6-4945-4e31-af73-f61bf1afdca5 req-f3e6e968-6437-43ea-989e-028c9a549793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "name": "network-vif-plugged", "status": "completed", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:09.846079 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:09.846079 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:09.853815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7c9583f6-4945-4e31-af73-f61bf1afdca5 req-f3e6e968-6437-43ea-989e-028c9a549793 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:09.854270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-7c9583f6-4945-4e31-af73-f61bf1afdca5 req-f3e6e968-6437-43ea-989e-028c9a549793 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:09.866816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-7c9583f6-4945-4e31-af73-f61bf1afdca5 req-f3e6e968-6437-43ea-989e-028c9a549793 service nova] Creating event network-vif-plugged:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch1-master-1 Feb 12 21:47:09.874035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-7c9583f6-4945-4e31-af73-f61bf1afdca5 req-f3e6e968-6437-43ea-989e-028c9a549793 service nova] Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:47:09.884997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-7c9583f6-4945-4e31-af73-f61bf1afdca5 req-f3e6e968-6437-43ea-989e-028c9a549793 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109828 Feb 12 21:47:09.885659 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3291/6449] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:10.519735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:10.520357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:10.527346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:10.527806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:10.528599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:10.529333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:10.799297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:10.806900 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85bcafbe-39d4-4bdc-84e9-7dc9b795177d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1675 microversion: 2.1 time: 0.290807 Feb 12 21:47:10.808308 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3159/6450] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:10 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1675 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:10.877182 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fa052c7e-6a65-408e-8b67-bcc1eedc7dc3 req-c93142e5-d269-4217-ac52-afb3a0e572a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "name": "network-vif-unplugged", "status": "completed", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:10.878283 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:10.878283 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:10.885580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fa052c7e-6a65-408e-8b67-bcc1eedc7dc3 req-c93142e5-d269-4217-ac52-afb3a0e572a2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:10.886034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fa052c7e-6a65-408e-8b67-bcc1eedc7dc3 req-c93142e5-d269-4217-ac52-afb3a0e572a2 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:10.897778 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fa052c7e-6a65-408e-8b67-bcc1eedc7dc3 req-c93142e5-d269-4217-ac52-afb3a0e572a2 service nova] Creating event network-vif-unplugged:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:47:10.903996 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-fa052c7e-6a65-408e-8b67-bcc1eedc7dc3 req-c93142e5-d269-4217-ac52-afb3a0e572a2 service nova] Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:47:10.915996 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fa052c7e-6a65-408e-8b67-bcc1eedc7dc3 req-c93142e5-d269-4217-ac52-afb3a0e572a2 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044907 Feb 12 21:47:10.916610 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3292/6451] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:11.824885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:11.825551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:11.833415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:11.833879 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:11.834675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:11.835113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:12.045294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:12.052726 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a18fa824-0f1e-4b69-a99b-b66429ded8c9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1675 microversion: 2.1 time: 0.232512 Feb 12 21:47:12.053349 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3160/6452] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:11 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:12.932017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4e5b3894-4e4d-4fb7-831b-10644af859ce req-3da10a05-3e69-4724-ae53-c5200d3b576f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:12.933558 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:12.933558 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:12.940722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4e5b3894-4e4d-4fb7-831b-10644af859ce req-3da10a05-3e69-4724-ae53-c5200d3b576f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:12.941180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4e5b3894-4e4d-4fb7-831b-10644af859ce req-3da10a05-3e69-4724-ae53-c5200d3b576f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:12.953371 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4e5b3894-4e4d-4fb7-831b-10644af859ce req-3da10a05-3e69-4724-ae53-c5200d3b576f service nova] Creating event network-changed:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:47:12.958668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-4e5b3894-4e4d-4fb7-831b-10644af859ce req-3da10a05-3e69-4724-ae53-c5200d3b576f service nova] Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:47:12.969279 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4e5b3894-4e4d-4fb7-831b-10644af859ce req-3da10a05-3e69-4724-ae53-c5200d3b576f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042817 Feb 12 21:47:12.969918 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3293/6453] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:13.071140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:13.071800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:13.078668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:13.079295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:13.080001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:13.080448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:13.809315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:13.817171 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5c712729-da40-433b-8715-6cf0a5dc64c4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1675 microversion: 2.1 time: 0.750286 Feb 12 21:47:13.817995 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3161/6454] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:13 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1675 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:14.836313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:14.837016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:14.843211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:14.843677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:14.844471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:14.844918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.043411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:15.051101 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2e85a67c-47e7-48e3-a329-08b25d6829bb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1668 microversion: 2.1 time: 0.219762 Feb 12 21:47:15.051887 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3294/6455] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:14 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:15.067815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:15.068434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:15.075474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.076041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.076976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.077459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.218910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:15.226518 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f03d34f2-4b96-4572-9065-6b9ada3b8b56 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1668 microversion: 2.1 time: 0.162331 Feb 12 21:47:15.227096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3162/6456] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:15 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:15.243358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:15.243991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:15.251513 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.253565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.253565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.253565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.390845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:15.400619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dff07d49-db5b-4f8b-a2d5-60b4066ddaf6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1668 microversion: 2.1 time: 0.161589 Feb 12 21:47:15.401206 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3295/6457] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:15 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:15.416603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:15.417106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:15.423300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.423750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.424524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.424961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.450057 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:47:15.737078 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a4dcd785-eea2-4166-a3a1-fefae046a71b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 204 len: 0 microversion: 2.1 time: 0.324148 Feb 12 21:47:15.737749 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3163/6458] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:47:15 2022] DELETE /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:47:15.746556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:15.747201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:15.753377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.753854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.754657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:15.755115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:15.893905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:15.902175 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2990af3b-e6c0-486c-9c01-01fa73dbfaca tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1674 microversion: 2.1 time: 0.160174 Feb 12 21:47:15.902761 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3296/6459] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:15 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:16.919623 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:16.920327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:16.928259 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:16.928715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:16.930091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:16.930535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:17.092744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:17.100219 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ebc6cb51-2f35-4482-bc9d-105327228cae tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1674 microversion: 2.1 time: 0.184906 Feb 12 21:47:17.102793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3164/6460] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:16 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:17.230328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2e2f7cd7-19cc-4423-92f7-a74308ed69d1 req-bb11b2e3-6278-4574-9a89-fcab0baa7a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "name": "network-vif-plugged", "status": "completed", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:17.232724 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:17.232724 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:17.241060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2e2f7cd7-19cc-4423-92f7-a74308ed69d1 req-bb11b2e3-6278-4574-9a89-fcab0baa7a80 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:17.241556 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2e2f7cd7-19cc-4423-92f7-a74308ed69d1 req-bb11b2e3-6278-4574-9a89-fcab0baa7a80 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:17.253874 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2e2f7cd7-19cc-4423-92f7-a74308ed69d1 req-bb11b2e3-6278-4574-9a89-fcab0baa7a80 service nova] Creating event network-vif-plugged:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:47:17.259176 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2e2f7cd7-19cc-4423-92f7-a74308ed69d1 req-bb11b2e3-6278-4574-9a89-fcab0baa7a80 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Feb 12 21:47:17.259790 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3297/6461] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:18.029477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-51e26ec2-66f9-431b-b683-c76a90d1743f req-6deb6c8f-e6fd-48c5-ab96-1c74d54f5d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e537702-8e49-42dc-b3a3-433c23cfaf2d", "name": "network-vif-deleted", "tag": "57aea46a-0aec-4027-a9a5-dfa9dd27f4db"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:18.031000 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:18.031000 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:47:18.043283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-51e26ec2-66f9-431b-b683-c76a90d1743f req-6deb6c8f-e6fd-48c5-ab96-1c74d54f5d29 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:18.043767 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-51e26ec2-66f9-431b-b683-c76a90d1743f req-6deb6c8f-e6fd-48c5-ab96-1c74d54f5d29 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:18.055237 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-51e26ec2-66f9-431b-b683-c76a90d1743f req-6deb6c8f-e6fd-48c5-ab96-1c74d54f5d29 service nova] Creating event network-vif-deleted:57aea46a-0aec-4027-a9a5-dfa9dd27f4db for instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d on nch2-master-1 Feb 12 21:47:18.060525 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-51e26ec2-66f9-431b-b683-c76a90d1743f req-6deb6c8f-e6fd-48c5-ab96-1c74d54f5d29 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034736 Feb 12 21:47:18.061343 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3165/6462] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:18.119759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:18.120764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:18.127488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:18.128326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:18.129153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:18.129835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:18.204677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:18.212304 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-067eb738-431f-4ab8-a00a-8ffa8cc99bcb tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 200 len: 1606 microversion: 2.1 time: 0.096822 Feb 12 21:47:18.212886 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3298/6463] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:18 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 1606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:19.230178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:19.230911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:19.237940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:19.238397 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:19.239177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:19.239615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:19.253938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. Feb 12 21:47:19.254451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:47:19.255262 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7873f332-26c4-466d-a938-1509d7b10c0b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 404 len: 111 microversion: 2.1 time: 0.029664 Feb 12 21:47:19.255795 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3166/6464] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:19 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:47:19.273207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:19.273950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:19.280887 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:19.281385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:19.282184 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:19.282707 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:19.297245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. Feb 12 21:47:19.297907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:47:19.298741 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27183c67-0f38-4e12-a714-5ae811965bed tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 404 len: 111 microversion: 2.1 time: 0.029301 Feb 12 21:47:19.299274 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3299/6465] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:19 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:47:19.345502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1859074083", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "34fb4bd0-7538-4c5d-aca6-00f04cac631c"}], "security_groups": [{"name": "tempest-securitygroup--1424401669"}], "key_name": "tempest-keypair-482931291", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:19.446747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] validate_networks() for [('34fb4bd0-7538-4c5d-aca6-00f04cac631c', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:47:19.817718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:47:19.818153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:47:19.818633 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:47:19.819042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:47:19.819453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:47:19.828892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:19.829338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:19.830177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:19.830613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:19.846779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:47:19.851941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:47:19.863966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:47:19.866327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:47:19.995155 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4394c68b-a18f-4c7b-8042-db4aa37932e1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653383 Feb 12 21:47:19.996018 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3167/6466] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:47:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:47:20.006240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-23f15477-c952-4c62-a8cf-46e3f829a83e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:20.006865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-23f15477-c952-4c62-a8cf-46e3f829a83e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:20.064139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-23f15477-c952-4c62-a8cf-46e3f829a83e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:20.071212 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-23f15477-c952-4c62-a8cf-46e3f829a83e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1238 microversion: 2.1 time: 0.068691 Feb 12 21:47:20.071719 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3300/6467] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:20 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:21.088961 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:21.089600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:21.097113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:21.097675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:21.098470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:21.098911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:21.160490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:21.169659 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e812cff3-38c9-4b26-adbc-8275729c906f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1234 microversion: 2.1 time: 0.085163 Feb 12 21:47:21.170262 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3168/6468] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:21 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:22.188373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:22.188994 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:22.197474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:22.197889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:22.198696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:22.199326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:22.263340 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:22.270954 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-875e932d-c6c2-4d1b-918b-65349eea5a6f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1296 microversion: 2.1 time: 0.086445 Feb 12 21:47:22.271763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3301/6469] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:22 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:23.288045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:23.288746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:23.297080 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:23.297576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:23.298387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:23.298836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:23.494661 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:23.501646 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-79a4b3f2-ee02-4895-aa84-59e8e881ee4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.217427 Feb 12 21:47:23.502220 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3169/6470] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:23 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:23.566634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-09c5dbec-471b-47bb-b50e-09ba939c1626 req-f8bf5d0a-2965-425f-9059-7445570066c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:23.575319 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:23.575319 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:23.578575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-09c5dbec-471b-47bb-b50e-09ba939c1626 req-f8bf5d0a-2965-425f-9059-7445570066c7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:23.579044 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-09c5dbec-471b-47bb-b50e-09ba939c1626 req-f8bf5d0a-2965-425f-9059-7445570066c7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:23.591519 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-09c5dbec-471b-47bb-b50e-09ba939c1626 req-f8bf5d0a-2965-425f-9059-7445570066c7 service nova] Creating event network-changed:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:47:23.596435 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-09c5dbec-471b-47bb-b50e-09ba939c1626 req-f8bf5d0a-2965-425f-9059-7445570066c7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033487 Feb 12 21:47:23.597390 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3302/6471] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:24.519520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:24.520076 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:24.527631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:24.528086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:24.528904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:24.529431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:24.666798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:24.674437 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5ad96045-4725-4b0f-81a6-b64c16bf5e55 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.158681 Feb 12 21:47:24.675011 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3170/6472] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:24 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:25.692489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:25.693195 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:25.701114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:25.701606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:25.702414 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:25.702863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:25.843425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:25.850927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-06ab216f-ba5c-4246-aa0d-62f4c8d0ecab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.162640 Feb 12 21:47:25.851513 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3303/6473] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:25 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:47:26.869115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:26.869791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:26.876467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:26.876924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:26.877741 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:26.878184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:27.010230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:27.017597 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4879e738-dc30-4e53-8291-6bb62176c1ab tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.152928 Feb 12 21:47:27.018172 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3171/6474] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:26 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:28.034264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:28.034898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:28.041877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:28.042349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:28.043404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:28.043859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:28.178337 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:28.186428 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4c0789ad-8273-4fb8-bc5c-3ef373259db6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.155927 Feb 12 21:47:28.187017 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3304/6475] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:28 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:29.203810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:29.204417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:29.211438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:29.211898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:29.212725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:29.213134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:29.344391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:29.352436 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1fa43a0f-b8d4-4f4c-9d2d-3a17b5c60518 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.151598 Feb 12 21:47:29.353264 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3172/6476] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:29 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:29.933802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-d5da6126-a551-46fc-8cfc-28f358155861 req-7bc1f51a-8bf3-44e7-b5cc-065660d36736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "name": "network-vif-plugged", "status": "completed", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:29.935494 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:29.935494 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:29.943585 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d5da6126-a551-46fc-8cfc-28f358155861 req-7bc1f51a-8bf3-44e7-b5cc-065660d36736 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:29.944049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-d5da6126-a551-46fc-8cfc-28f358155861 req-7bc1f51a-8bf3-44e7-b5cc-065660d36736 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:29.955695 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-d5da6126-a551-46fc-8cfc-28f358155861 req-7bc1f51a-8bf3-44e7-b5cc-065660d36736 service nova] Creating event network-vif-plugged:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:47:29.960622 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-d5da6126-a551-46fc-8cfc-28f358155861 req-7bc1f51a-8bf3-44e7-b5cc-065660d36736 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030736 Feb 12 21:47:29.961978 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3305/6477] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:47:30.370779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:30.371391 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:30.378662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:30.379112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:30.379892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:30.380328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:30.518016 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:30.525731 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1665a9aa-bc63-4b70-a5eb-86520170aa77 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1364 microversion: 2.1 time: 0.159418 Feb 12 21:47:30.526308 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3173/6478] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:30 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:31.544555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:31.545303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:31.551522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:31.551997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:31.552798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:31.553253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:31.692929 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:31.705441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-051f859f-e5ae-4727-ad96-19595aeda549 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1551 microversion: 2.1 time: 0.166169 Feb 12 21:47:31.706027 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3306/6479] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:31 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:31.721946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:31.722460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:31.729153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:31.729640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:31.730419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:31.730855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:31.819489 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5639310-7462-44da-a770-421d2b72a26a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101113 Feb 12 21:47:31.820094 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3174/6480] 10.222.0.31 () {58 vars in 1274 bytes} [Sat Feb 12 21:47:31 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:47:33.170771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-da48d7f5-e5e1-4d41-887b-b54d5c7643cd req-9b2c6c24-a2dc-40b3-a8b5-965121df75c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:33.172809 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:47:33.172809 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:47:33.181156 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-da48d7f5-e5e1-4d41-887b-b54d5c7643cd req-9b2c6c24-a2dc-40b3-a8b5-965121df75c4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:33.181810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-da48d7f5-e5e1-4d41-887b-b54d5c7643cd req-9b2c6c24-a2dc-40b3-a8b5-965121df75c4 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:33.193076 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-da48d7f5-e5e1-4d41-887b-b54d5c7643cd req-9b2c6c24-a2dc-40b3-a8b5-965121df75c4 service nova] Creating event network-changed:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:47:33.198963 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-da48d7f5-e5e1-4d41-887b-b54d5c7643cd req-9b2c6c24-a2dc-40b3-a8b5-965121df75c4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032111 Feb 12 21:47:33.199876 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3307/6481] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:34.842701 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:34.843316 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:34.849389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:34.849849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:34.850637 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:34.851083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:34.989902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:34.997679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ec6d6ebf-32bc-4385-88dd-02dbbb6ca956 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1669 microversion: 2.1 time: 0.159410 Feb 12 21:47:34.998248 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3175/6482] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:34 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:35.015836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8b711c5-5e7d-49f4-852c-25b581c931a5"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:35.017236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:35.024173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:35.024676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:35.025511 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:35.025965 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:35.730082 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-94db0b00-811b-4100-9ede-56ca2f7b9044 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719000 Feb 12 21:47:35.730726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3308/6483] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:47:35 2022] POST /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:47:40.037665 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:47:40.038683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:40.046538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:40.046987 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:40.047771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:40.048208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:40.075708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:40.081335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Old instance type m1.heat2, new instance type m1.heat {{(pid=141726) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:47:40.088718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:47:40.089145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:47:40.089721 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:47:40.090144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:47:40.090564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:47:40.243350 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-894b027b-d251-4c0b-b95c-6e964aada9df tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/action" status: 202 len: 0 microversion: 2.1 time: 0.209486 Feb 12 21:47:40.244671 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3176/6484] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:47:40 2022] POST /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:47:40.252745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:40.253581 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:40.261507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:40.261974 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:40.262783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:40.263236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:40.402762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:40.411109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e40595c-7e16-4cd8-adb1-fb745b545af2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1724 microversion: 2.1 time: 0.162367 Feb 12 21:47:40.411697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3309/6485] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:40 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:41.429558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:41.430095 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:41.436313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:41.436764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:41.437586 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:41.438024 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:41.577172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:41.585384 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-43f1ee16-6336-405c-bd7b-d229ab838f23 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1724 microversion: 2.1 time: 0.160285 Feb 12 21:47:41.585978 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3177/6486] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:41 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:42.603626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:42.604837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:42.611980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:42.612450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:42.613267 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:42.613744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:42.750691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:42.758795 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ddbcdf71-5012-4c66-844a-32666a7c1b85 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1724 microversion: 2.1 time: 0.158977 Feb 12 21:47:42.759368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3310/6487] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:42 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:43.776324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:43.776992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:43.784272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:43.784724 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:43.785576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:43.786010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:43.930169 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:43.938184 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fe5b0046-1738-49aa-8970-c4a166d6f89a tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.166098 Feb 12 21:47:43.938762 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3178/6488] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:43 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:44.955669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:44.956293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:44.963171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:44.963776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:44.964582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:44.965035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:45.098590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:45.107091 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-51be1811-ea6d-4598-b371-b333eda70ecf tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.155124 Feb 12 21:47:45.107909 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3311/6489] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:44 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:46.123986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:46.124527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:46.131432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:46.131888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:46.132703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:46.133239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:46.268949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:46.277920 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-636c74ad-c5d8-4dd7-8a64-bf6bfc81d938 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.157779 Feb 12 21:47:46.278500 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3179/6490] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:46 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:47.296100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:47.296727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:47.303605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:47.304073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:47.304878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:47.305333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:47.443882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:47.452040 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49299991-9992-4824-a8d2-24ae3d1df3e2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.160573 Feb 12 21:47:47.452629 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3312/6491] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:47 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:48.469534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:48.470140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:48.476922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:48.477400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:48.478189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:48.478620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:48.609781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:48.617897 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6e8356bd-5596-4c02-83f4-d4d6dad448f5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.152372 Feb 12 21:47:48.618472 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3180/6492] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:48 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:49.635372 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:49.635993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:49.642927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:49.643396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:49.644220 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:49.644669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:49.784961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:49.793918 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2d931646-0aa2-453b-bbfa-adc6ede26250 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.162026 Feb 12 21:47:49.794714 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3313/6493] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:49 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:50.811607 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:50.814396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:50.819249 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:50.819813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:50.820677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:50.821133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:50.957769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:50.965649 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b595eb2b-fa9c-44d5-8b09-38737c216239 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.158632 Feb 12 21:47:50.966231 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3181/6494] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:50 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:51.983978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:51.984656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:51.991287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:51.991816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:51.992801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:51.993282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:52.139737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:52.147642 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cfd1bc81-53bf-433e-b35d-6070233b924e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.168605 Feb 12 21:47:52.148221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3314/6495] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:51 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:53.164605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:53.165219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:53.172294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:53.172744 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:53.173550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:53.173988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:53.309718 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:53.317558 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-8295642b-78cb-4791-b169-2893cf6e947b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.156551 Feb 12 21:47:53.318136 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3182/6496] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:53 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:54.335007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:54.335633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:54.342676 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:54.343153 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:54.343954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:54.344413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:54.476198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:54.484833 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-df66d711-86f6-423e-921a-453d328b9f4e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.153781 Feb 12 21:47:54.485417 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3315/6497] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:54 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:55.502464 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:55.503075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:55.509689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:55.510658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:55.513799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:55.514250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:55.658074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:55.667957 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9ccc37a0-2806-434f-b6aa-a099b5780574 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.169315 Feb 12 21:47:55.668826 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3183/6498] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:55 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:56.685668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:56.686329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:56.693447 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:56.693927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:56.694737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:56.695192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:56.832421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:56.841163 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce302f95-8ab8-4fd0-806e-0d79b62979dd tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.159412 Feb 12 21:47:56.841855 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3316/6499] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:56 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:57.859032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:57.859651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:57.866542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:57.866999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:57.867816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:57.868260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:58.000656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:58.008518 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3975d9be-e05f-4259-9846-b8c4108cdfa6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.153137 Feb 12 21:47:58.009029 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3184/6500] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:57 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:47:59.025730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:47:59.026360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:47:59.033121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:59.033613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:59.034407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:47:59.034859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:47:59.169166 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:47:59.177282 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-429a305e-9766-4205-b463-e885a59464e5 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.155347 Feb 12 21:47:59.178018 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3317/6501] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:47:59 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:48:00.194565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:00.195209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:00.202800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:00.203252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:00.204035 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:00.204472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:00.343177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:00.351110 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5c05991-a6b0-4175-b8a1-229553d8dc28 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.160227 Feb 12 21:48:00.351684 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3185/6502] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:00 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:01.368241 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:01.368783 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:01.376555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:01.377021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:01.377852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:01.378299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:01.510976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:01.519159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-567bcfee-c9f0-41c3-8232-2e7821d70085 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1729 microversion: 2.1 time: 0.154728 Feb 12 21:48:01.519744 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3318/6503] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:01 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:02.154462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5872cfe1-5942-4a6d-be8d-5730d2dd6ab4 req-d5645c44-b712-462a-89ba-2841c4460bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "name": "network-vif-unplugged", "status": "completed", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:02.156933 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:02.156933 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:48:02.166978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5872cfe1-5942-4a6d-be8d-5730d2dd6ab4 req-d5645c44-b712-462a-89ba-2841c4460bd3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:02.167689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5872cfe1-5942-4a6d-be8d-5730d2dd6ab4 req-d5645c44-b712-462a-89ba-2841c4460bd3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:02.182235 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5872cfe1-5942-4a6d-be8d-5730d2dd6ab4 req-d5645c44-b712-462a-89ba-2841c4460bd3 service nova] Creating event network-vif-unplugged:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch2-master-1 Feb 12 21:48:02.189307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-5872cfe1-5942-4a6d-be8d-5730d2dd6ab4 req-d5645c44-b712-462a-89ba-2841c4460bd3 service nova] Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:48:02.200570 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5872cfe1-5942-4a6d-be8d-5730d2dd6ab4 req-d5645c44-b712-462a-89ba-2841c4460bd3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050336 Feb 12 21:48:02.201335 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3186/6504] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:48:02.537039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:02.537772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:02.545516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:02.545989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:02.546855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:02.547283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:02.686487 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:02.695062 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b55b8f0-43c3-4753-bb8d-5bed9c1f283c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1728 microversion: 2.1 time: 0.161756 Feb 12 21:48:02.700881 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3319/6505] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:02 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:03.719810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:03.720517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:03.727354 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:03.727810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:03.728651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:03.729097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:03.875384 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:03.886710 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d5e1d1c0-1a39-4404-a9ef-e206bdc7e212 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1726 microversion: 2.1 time: 0.172247 Feb 12 21:48:03.889599 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3187/6506] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:03 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:04.215121 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-27987f30-ef04-4fdf-9b97-eea043248867 req-c8e10f3a-5a88-4853-b074-553fbd9b7c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:04.216812 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:04.216812 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:48:04.224721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-27987f30-ef04-4fdf-9b97-eea043248867 req-c8e10f3a-5a88-4853-b074-553fbd9b7c9b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:04.225187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-27987f30-ef04-4fdf-9b97-eea043248867 req-c8e10f3a-5a88-4853-b074-553fbd9b7c9b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:04.237603 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-27987f30-ef04-4fdf-9b97-eea043248867 req-c8e10f3a-5a88-4853-b074-553fbd9b7c9b service nova] Creating event network-changed:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch2-master-1 Feb 12 21:48:04.243203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-27987f30-ef04-4fdf-9b97-eea043248867 req-c8e10f3a-5a88-4853-b074-553fbd9b7c9b service nova] Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:48:04.255367 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-27987f30-ef04-4fdf-9b97-eea043248867 req-c8e10f3a-5a88-4853-b074-553fbd9b7c9b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043932 Feb 12 21:48:04.255964 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3320/6507] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:04.905504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:04.906129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:04.912947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:04.913424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:04.914227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:04.914673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:05.558898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:05.567683 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d193d8d0-cc6b-4aa7-9223-35c102d66864 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1726 microversion: 2.1 time: 0.666537 Feb 12 21:48:05.568263 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3188/6508] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:04 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1726 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:06.586579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:06.587319 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:06.595607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:06.596077 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:06.596866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:06.597314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:06.732122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:06.740463 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-eb6c5605-81c4-492d-9c02-fcd69e5a5d7f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1726 microversion: 2.1 time: 0.158075 Feb 12 21:48:06.741239 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3321/6509] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:06 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:07.758696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:07.759347 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:07.767184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:07.767664 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:07.771286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:07.771286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:07.908238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:07.916142 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-df6dc01c-73ed-4fcb-b420-aa393e2d8d74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1726 microversion: 2.1 time: 0.161557 Feb 12 21:48:07.916741 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3189/6510] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:07 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:08.933973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:08.935234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:08.942114 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:08.942588 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:08.943391 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:08.943845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.079507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:09.087402 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-22ef6d64-1498-4336-8fdd-6ce35710900e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1723 microversion: 2.1 time: 0.157129 Feb 12 21:48:09.087976 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3322/6511] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:08 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:09.104302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:09.104873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:09.111933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:09.112394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.113188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:09.113672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.145075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:09.145566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.146439 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:09.146885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.167293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for project 902f92c068c04a1994a8d95036240a10. Resources: {'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:48:09.173190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Getting quotas for user 3c8938385d324996b1f80337c56f69fb and project 902f92c068c04a1994a8d95036240a10. Resources: {'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:48:09.466109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85900c51-06e1-428d-99f2-b6fa0a44b8a7 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "POST /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/action" status: 202 len: 0 microversion: 2.1 time: 0.365377 Feb 12 21:48:09.466731 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3190/6512] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:48:09 2022] POST /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:48:09.479040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:09.479040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:09.483698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:09.484237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.485011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:09.485500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:09.628787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:09.637047 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-74328744-1c0e-468d-bf78-340bacc02a47 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.165808 Feb 12 21:48:09.638543 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3323/6513] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:09 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:48:10.656542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:10.657604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:10.664698 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:10.665156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:10.665976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:10.666422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:10.804751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:10.813524 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b580d842-f0a7-4b2d-8c2f-bcbc5f24bb74 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.162266 Feb 12 21:48:10.825237 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3191/6514] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:10 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:11.494760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f9303adf-b2b2-4f04-9fdc-7f15580169a8 req-a0bd8015-6458-41e8-aa36-7b130e95fd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "name": "network-vif-plugged", "status": "completed", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:11.496300 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:11.496300 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:48:11.504947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f9303adf-b2b2-4f04-9fdc-7f15580169a8 req-a0bd8015-6458-41e8-aa36-7b130e95fd2d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:11.505334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f9303adf-b2b2-4f04-9fdc-7f15580169a8 req-a0bd8015-6458-41e8-aa36-7b130e95fd2d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:11.517393 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f9303adf-b2b2-4f04-9fdc-7f15580169a8 req-a0bd8015-6458-41e8-aa36-7b130e95fd2d service nova] Creating event network-vif-plugged:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch2-master-1 Feb 12 21:48:11.522625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-f9303adf-b2b2-4f04-9fdc-7f15580169a8 req-a0bd8015-6458-41e8-aa36-7b130e95fd2d service nova] Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:48:11.533967 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f9303adf-b2b2-4f04-9fdc-7f15580169a8 req-a0bd8015-6458-41e8-aa36-7b130e95fd2d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042901 Feb 12 21:48:11.534567 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3324/6515] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:11.830909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:11.831531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:11.838333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:11.838800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:11.839600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:11.840045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:11.980218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:11.988975 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b18e666d-e07e-456c-9a26-b09337c3bc50 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.161759 Feb 12 21:48:11.989593 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3192/6516] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:11 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:13.008255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:13.008894 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:13.015705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:13.019416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:13.019416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:13.019416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:13.161810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:13.170608 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-93554b98-35d3-4bc8-87e6-7a085e66fe2e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.167363 Feb 12 21:48:13.171267 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3325/6517] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:13 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:13.781119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-af073350-1686-400c-8daf-946d2cbe8792 req-f2adce02-f2f0-4192-938f-143185cbdf31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "name": "network-vif-unplugged", "status": "completed", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:13.786360 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:13.786360 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:48:13.790713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-af073350-1686-400c-8daf-946d2cbe8792 req-f2adce02-f2f0-4192-938f-143185cbdf31 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:13.791188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-af073350-1686-400c-8daf-946d2cbe8792 req-f2adce02-f2f0-4192-938f-143185cbdf31 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:13.803990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-af073350-1686-400c-8daf-946d2cbe8792 req-f2adce02-f2f0-4192-938f-143185cbdf31 service nova] Creating event network-vif-unplugged:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:48:13.809374 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-af073350-1686-400c-8daf-946d2cbe8792 req-f2adce02-f2f0-4192-938f-143185cbdf31 service nova] Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:48:13.821111 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-af073350-1686-400c-8daf-946d2cbe8792 req-f2adce02-f2f0-4192-938f-143185cbdf31 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043759 Feb 12 21:48:13.821768 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3193/6518] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:14.188395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:14.189836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:14.197650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:14.198055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:14.198873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:14.199343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:14.342598 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:14.351820 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1c25b3fa-8710-45a3-9845-c2f3650ec513 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.167561 Feb 12 21:48:14.353177 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3326/6519] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:14 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:15.370986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:15.372795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:15.379103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:15.379564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:15.380355 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:15.380929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:15.518581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:15.526739 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4f97219a-42d1-4682-a3eb-69e7d4f46dbc tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.160863 Feb 12 21:48:15.527505 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3194/6520] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:15 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:15.835655 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-80954208-a540-4d3e-b5ee-b4867bfcdf74 req-753d693f-880b-4d1e-8092-309fc7828ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:15.837233 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:15.837233 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:48:15.845775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-80954208-a540-4d3e-b5ee-b4867bfcdf74 req-753d693f-880b-4d1e-8092-309fc7828ddc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:15.846275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-80954208-a540-4d3e-b5ee-b4867bfcdf74 req-753d693f-880b-4d1e-8092-309fc7828ddc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:15.858538 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-80954208-a540-4d3e-b5ee-b4867bfcdf74 req-753d693f-880b-4d1e-8092-309fc7828ddc service nova] Creating event network-changed:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:48:15.863932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-80954208-a540-4d3e-b5ee-b4867bfcdf74 req-753d693f-880b-4d1e-8092-309fc7828ddc service nova] Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:48:15.874642 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-80954208-a540-4d3e-b5ee-b4867bfcdf74 req-753d693f-880b-4d1e-8092-309fc7828ddc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042614 Feb 12 21:48:15.875182 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3327/6521] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:48:16.544303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:16.544962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:16.551808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:16.552300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:16.553124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:16.553596 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:16.839206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:16.847534 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae718380-a31e-4f7d-885d-680d9dca34e4 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.307221 Feb 12 21:48:16.848149 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3195/6522] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:16 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:17.866572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:17.867286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:17.873767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:17.874255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:17.875049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:17.875500 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:18.008861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:18.017685 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a9f60e3d-b9fa-45c8-9889-3ec1eee0b660 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.156001 Feb 12 21:48:18.018260 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3328/6523] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:17 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:19.035408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:19.035966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:19.043486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:19.044203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:19.044998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:19.045462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:19.184326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:19.193428 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a39207e7-6adf-40b1-afc8-10bf43bde7b2 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1722 microversion: 2.1 time: 0.161797 Feb 12 21:48:19.194016 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3196/6524] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:19 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:20.210941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:20.212177 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:20.219439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.219914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.220797 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.221278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.362159 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:20.370291 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f7d9cf54-9ea3-4f85-aee8-80821792267b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1715 microversion: 2.1 time: 0.163249 Feb 12 21:48:20.370921 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3329/6525] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:20 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:20.386778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:20.387399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:20.395271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.395725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.396525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.396973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.533926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:20.542028 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-776df549-d991-49d3-9431-f731b5aa699e tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1715 microversion: 2.1 time: 0.158874 Feb 12 21:48:20.542607 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3197/6526] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:20 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:20.559302 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:20.559932 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:20.566631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.567034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.567849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.568307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.699599 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:20.708332 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aa369dda-6eca-49f6-bf21-58ef931f8ade tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1715 microversion: 2.1 time: 0.152732 Feb 12 21:48:20.708908 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3330/6527] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:20 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:20.724833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:20.725339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:20.731330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.731782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.732565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:20.733010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:20.761308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:48:21.026842 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-18173bee-c5ce-4513-b5e1-70909b3b6b4c tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 204 len: 0 microversion: 2.1 time: 0.305360 Feb 12 21:48:21.027448 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3198/6528] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:48:20 2022] DELETE /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:48:21.036408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:21.037038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:21.043292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:21.044032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:21.045219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:21.045712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:21.183695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:21.192220 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81b20a97-d784-43c9-8afa-a8e1d964a8ff tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1721 microversion: 2.1 time: 0.159727 Feb 12 21:48:21.192805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3331/6529] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:21 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:22.161050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-03528728-b0fb-4115-bf6e-23f0a02935f7 req-7678d72b-4cee-487f-b356-0b54a6cc5e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "name": "network-vif-plugged", "status": "completed", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:22.162657 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:22.162657 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:48:22.170625 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-03528728-b0fb-4115-bf6e-23f0a02935f7 req-7678d72b-4cee-487f-b356-0b54a6cc5e2f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:22.171177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-03528728-b0fb-4115-bf6e-23f0a02935f7 req-7678d72b-4cee-487f-b356-0b54a6cc5e2f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:22.182399 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-03528728-b0fb-4115-bf6e-23f0a02935f7 req-7678d72b-4cee-487f-b356-0b54a6cc5e2f service nova] Creating event network-vif-plugged:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:48:22.187357 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-03528728-b0fb-4115-bf6e-23f0a02935f7 req-7678d72b-4cee-487f-b356-0b54a6cc5e2f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Feb 12 21:48:22.188212 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3199/6530] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:22.210010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:22.210907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:22.217648 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:22.218116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:22.219845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:22.219979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:22.358751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:22.367159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-31e99f68-269e-4c46-9506-4fddcffb4f93 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1721 microversion: 2.1 time: 0.160896 Feb 12 21:48:22.367852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3332/6531] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:22 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:23.385484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:23.386185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:23.393806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:23.394260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:23.395055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:23.395493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:23.631581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:23.642507 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0183f264-24b7-4086-a7d7-f7bad95ac8f9 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1721 microversion: 2.1 time: 0.261872 Feb 12 21:48:23.644110 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3200/6532] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:23 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:23.840240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f1e9d75b-5426-4d2c-bc0f-051d4d79ed2d req-aeda3578-c358-4891-8b49-7030e817cceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c72556-2f9f-46da-b4c4-9a6fdb32e786", "name": "network-vif-deleted", "tag": "334d81e3-f89e-4056-ac3e-0401cc06b686"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:23.849001 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:23.849001 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:48:23.856701 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f1e9d75b-5426-4d2c-bc0f-051d4d79ed2d req-aeda3578-c358-4891-8b49-7030e817cceb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:23.857170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f1e9d75b-5426-4d2c-bc0f-051d4d79ed2d req-aeda3578-c358-4891-8b49-7030e817cceb service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:23.868875 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f1e9d75b-5426-4d2c-bc0f-051d4d79ed2d req-aeda3578-c358-4891-8b49-7030e817cceb service nova] Creating event network-vif-deleted:334d81e3-f89e-4056-ac3e-0401cc06b686 for instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 on nch1-master-1 Feb 12 21:48:23.874438 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f1e9d75b-5426-4d2c-bc0f-051d4d79ed2d req-aeda3578-c358-4891-8b49-7030e817cceb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038155 Feb 12 21:48:23.875104 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3333/6533] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:24.660622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:24.661232 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:24.668124 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:24.668575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:24.669636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:24.670079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:24.704687 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:24.705215 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:24.705704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lazy-loading 'fault' on Instance uuid f6c72556-2f9f-46da-b4c4-9a6fdb32e786 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:48:24.754902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8938385d324996b1f80337c56f69fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902f92c068c04a1994a8d95036240a10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:24.763398 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9d131d4-7595-4fee-aa83-f97f8d2eade1 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 200 len: 1374 microversion: 2.1 time: 0.107145 Feb 12 21:48:24.763987 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3201/6534] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:24 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 1374 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:25.783360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:25.784103 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:25.790352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:25.790833 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:25.791629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:25.792064 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:25.806295 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. Feb 12 21:48:25.807402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:25.807816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6365d3aa-2c25-4a8b-b7a3-463b7687b826 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 404 len: 111 microversion: 2.1 time: 0.029848 Feb 12 21:48:25.808364 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3334/6535] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:25 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:25.864610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:25.865569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:25.871914 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:25.872368 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:25.873159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:25.873627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:25.888906 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. Feb 12 21:48:25.889536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:25.890372 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1cb11401-fb77-47cb-aaf8-c1a2aa8ac80f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029734 Feb 12 21:48:25.891599 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3202/6536] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:48:25 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:29.315779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.316290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.323148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.323611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.324399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.324881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.339480 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. Feb 12 21:48:29.340019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.340851 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-62d62e2e-82f0-4402-9010-1c5f380e094b tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 404 len: 111 microversion: 2.1 time: 0.029818 Feb 12 21:48:29.341403 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3335/6537] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:48:29 2022] DELETE /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:48:29.349516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.350133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: f6c72556-2f9f-46da-b4c4-9a6fdb32e786] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.356970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.357463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.358254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.358699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.372679 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. Feb 12 21:48:29.374804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance f6c72556-2f9f-46da-b4c4-9a6fdb32e786 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.374804 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dcae9c6d-1f0b-463d-883f-48e2ddaaeb8f tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786" status: 404 len: 111 microversion: 2.1 time: 0.028727 Feb 12 21:48:29.375048 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3203/6538] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:29 2022] GET /compute/v2.1/servers/f6c72556-2f9f-46da-b4c4-9a6fdb32e786 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:48:29.383393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.383912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.390004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.390482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.391876 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.392330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.405664 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. Feb 12 21:48:29.406389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.407280 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d5e9efa6-8e1d-4fb6-9b96-92f9d31e1967 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 404 len: 111 microversion: 2.1 time: 0.027559 Feb 12 21:48:29.407818 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3336/6539] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:48:29 2022] DELETE /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 21:48:29.415422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.416041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 7e537702-8e49-42dc-b3a3-433c23cfaf2d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.422746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.423201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.424163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.424603 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.438872 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. Feb 12 21:48:29.439459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 7e537702-8e49-42dc-b3a3-433c23cfaf2d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.440271 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76dc5cd0-a555-4537-999e-8364b3b36e65 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d" status: 404 len: 111 microversion: 2.1 time: 0.028565 Feb 12 21:48:29.440794 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3204/6540] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:29 2022] GET /compute/v2.1/servers/7e537702-8e49-42dc-b3a3-433c23cfaf2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:29.448573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.449083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.455979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.456450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.457247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.457732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.470969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. Feb 12 21:48:29.471567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.472400 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cdf64aa-8d1e-4eaa-9cff-010746df9aaa tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 404 len: 111 microversion: 2.1 time: 0.027583 Feb 12 21:48:29.472938 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3337/6541] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:48:29 2022] DELETE /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:29.480555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.481218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 47636390-fb2d-4baf-9973-c169abf215eb] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.487447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.487898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.488671 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.489109 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.502717 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. Feb 12 21:48:29.503297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 47636390-fb2d-4baf-9973-c169abf215eb could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.504101 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a414ca6a-5642-40c2-b091-1134b994e8c6 tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb" status: 404 len: 111 microversion: 2.1 time: 0.027196 Feb 12 21:48:29.504618 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3205/6542] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:29 2022] GET /compute/v2.1/servers/47636390-fb2d-4baf-9973-c169abf215eb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:29.512168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.512713 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.519593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.520065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.520865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.521322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.534591 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. Feb 12 21:48:29.535194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.536018 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d085085c-3991-42f4-a464-7542057b3e2d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 404 len: 111 microversion: 2.1 time: 0.027496 Feb 12 21:48:29.536541 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3338/6543] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:48:29 2022] DELETE /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:29.544519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.545141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] [instance: 82087afc-7369-4c73-9e70-f1ce64b475ee] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:29.552136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.552594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.553412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:29.553862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:29.567996 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] HTTP exception thrown: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. Feb 12 21:48:29.569342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Returning 404 to user: Instance 82087afc-7369-4c73-9e70-f1ce64b475ee could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:48:29.569518 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa3fe2c3-28cd-454e-bef6-533bee7b754d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee" status: 404 len: 111 microversion: 2.1 time: 0.028872 Feb 12 21:48:29.569983 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3206/6544] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:29 2022] GET /compute/v2.1/servers/82087afc-7369-4c73-9e70-f1ce64b475ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:48:29.578089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d0c11877-bdde-4108-b9f3-6438d982b88d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] Calling method '.version_select at 0x7fa8fe06a8b0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:29.674837 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d0c11877-bdde-4108-b9f3-6438d982b88d tempest-ServerActionsTestJSON-123457624 tempest-ServerActionsTestJSON-123457624-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482931291" status: 202 len: 0 microversion: 2.1 time: 0.100350 Feb 12 21:48:29.675425 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3339/6545] 10.222.0.31 () {58 vars in 1217 bytes} [Sat Feb 12 21:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482931291 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:48:31.776721 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:48:31.777284 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 21:48:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:48:36.904308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1907088472", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "eb8bc6aa-1bb7-45e5-a430-dd54ebf70f6f"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:36.956742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] validate_networks() for [('eb8bc6aa-1bb7-45e5-a430-dd54ebf70f6f', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:48:37.350530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:48:37.350977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:48:37.351488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:48:37.351885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:48:37.352294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:48:37.361295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:37.361772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:37.362616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:37.363050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:37.379274 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Getting quotas for project d38accd245be44a99cb7c89cb2dc18cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:48:37.384284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Getting quotas for user 92e237a1cc044978b7a9d8c262a738ea and project d38accd245be44a99cb7c89cb2dc18cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:48:37.397514 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:48:37.399865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:48:37.490788 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b9b4284f-625e-4168-affc-9a984599697c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703180 Feb 12 21:48:37.491479 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3207/6546] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:48:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:48:37.503101 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bdde6a81-96e0-4716-aaa1-4757891c22ce tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:37.503742 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bdde6a81-96e0-4716-aaa1-4757891c22ce tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:37.558576 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bdde6a81-96e0-4716-aaa1-4757891c22ce tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:37.566198 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bdde6a81-96e0-4716-aaa1-4757891c22ce tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1217 microversion: 2.1 time: 0.068642 Feb 12 21:48:37.566853 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3340/6547] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:37 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:38.583641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:38.584288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:38.590992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:38.591448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:38.592234 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:38.592675 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:38.653146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:38.661296 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1626f39-9ac4-4f66-a985-3733ca9291d5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1221 microversion: 2.1 time: 0.081573 Feb 12 21:48:38.661889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3208/6548] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:38 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:39.678923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:39.680013 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:39.687728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:39.688313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:39.689864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:39.689864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:39.759681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:39.767483 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-46f8ceaa-7e57-4c58-98f4-ab95625637c5 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1287 microversion: 2.1 time: 0.092335 Feb 12 21:48:39.768052 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3341/6549] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:39 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:40.785146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:40.785146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:40.791944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:40.792405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:40.793185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:40.793644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:41.375833 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:41.383027 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-402e9504-7c51-4e31-91b3-b9a9f2218c87 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1317 microversion: 2.1 time: 0.603232 Feb 12 21:48:41.383632 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3209/6550] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:40 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:41.604055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-120a7b1f-8be0-4917-8e6d-f84f0d0bae29 req-e9021537-4ab9-46e7-9f44-41da42673ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e1381b-d471-40f3-a558-7657cb1a48c2", "tag": "3258d224-67ed-44c1-920e-274671e1d2e4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:41.605658 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:41.605658 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:48:41.612814 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-120a7b1f-8be0-4917-8e6d-f84f0d0bae29 req-e9021537-4ab9-46e7-9f44-41da42673ab9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:41.613304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-120a7b1f-8be0-4917-8e6d-f84f0d0bae29 req-e9021537-4ab9-46e7-9f44-41da42673ab9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:41.624250 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-120a7b1f-8be0-4917-8e6d-f84f0d0bae29 req-e9021537-4ab9-46e7-9f44-41da42673ab9 service nova] Creating event network-changed:3258d224-67ed-44c1-920e-274671e1d2e4 for instance 76e1381b-d471-40f3-a558-7657cb1a48c2 on nch1-master-1 Feb 12 21:48:41.630281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-120a7b1f-8be0-4917-8e6d-f84f0d0bae29 req-e9021537-4ab9-46e7-9f44-41da42673ab9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101255 Feb 12 21:48:41.631407 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3342/6551] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:42.399824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:42.401183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:42.408659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:42.409236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:42.410135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:42.410761 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:42.607000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:42.614363 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6835457c-3361-498a-85cf-f8f00551f224 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1317 microversion: 2.1 time: 0.218247 Feb 12 21:48:42.614931 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3210/6552] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:42 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:43.633019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:43.635971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:43.640174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:43.640644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:43.641522 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:43.641983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:43.786376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:43.793843 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ef074870-3f00-493a-8dcb-0282446a82ec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1317 microversion: 2.1 time: 0.165917 Feb 12 21:48:43.794677 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3343/6553] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:43 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:44.810526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:44.811138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:44.819287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:44.819749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:44.820550 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:44.820996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:44.962561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:44.969933 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cfe9ab95-ed76-41a1-a8bc-c47b6708f5b9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1317 microversion: 2.1 time: 0.163182 Feb 12 21:48:44.971014 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3211/6554] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:44 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:45.988108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:45.988769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:45.995836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:45.996308 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:45.997126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:45.997630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:46.132519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:46.140085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1e980ad8-da62-4755-8a76-97c539b03bc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1317 microversion: 2.1 time: 0.156531 Feb 12 21:48:46.140662 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3344/6555] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:45 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:46.259519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-9b606711-cf2e-4f8a-8f77-bdca1eaa8b1c req-c15d945e-5962-4809-a968-d45ec68e123a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e1381b-d471-40f3-a558-7657cb1a48c2", "name": "network-vif-plugged", "status": "completed", "tag": "3258d224-67ed-44c1-920e-274671e1d2e4"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:46.261126 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:46.261126 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:48:46.269084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9b606711-cf2e-4f8a-8f77-bdca1eaa8b1c req-c15d945e-5962-4809-a968-d45ec68e123a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:46.269583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-9b606711-cf2e-4f8a-8f77-bdca1eaa8b1c req-c15d945e-5962-4809-a968-d45ec68e123a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:46.280381 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-9b606711-cf2e-4f8a-8f77-bdca1eaa8b1c req-c15d945e-5962-4809-a968-d45ec68e123a service nova] Creating event network-vif-plugged:3258d224-67ed-44c1-920e-274671e1d2e4 for instance 76e1381b-d471-40f3-a558-7657cb1a48c2 on nch1-master-1 Feb 12 21:48:46.285488 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-9b606711-cf2e-4f8a-8f77-bdca1eaa8b1c req-c15d945e-5962-4809-a968-d45ec68e123a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029564 Feb 12 21:48:46.286010 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3212/6556] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:48:47.156807 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:47.157560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:47.164723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:47.165200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:47.166042 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:47.166497 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:47.303751 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:47.311159 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f2b493e-0f5e-451b-ad53-239143bb8dd6 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1317 microversion: 2.1 time: 0.158311 Feb 12 21:48:47.311725 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3345/6557] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:47 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:48.329932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:48.330650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:48.337529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:48.337990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:48.338778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:48.339219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:48.476931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:48.484357 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6c512c55-e351-4cfb-8a8d-f48f7bce0872 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.159297 Feb 12 21:48:48.484926 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3213/6558] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:48 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:48.538045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-311937403", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "eb8bc6aa-1bb7-45e5-a430-dd54ebf70f6f"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:48.588376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] validate_networks() for [('eb8bc6aa-1bb7-45e5-a430-dd54ebf70f6f', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:48:49.017779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:48:49.019332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:48:49.019332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:48:49.019332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:48:49.020777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:48:49.029759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:49.030226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:49.031197 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:49.031656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:49.049018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Getting quotas for project d38accd245be44a99cb7c89cb2dc18cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:48:49.054810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Getting quotas for user 92e237a1cc044978b7a9d8c262a738ea and project d38accd245be44a99cb7c89cb2dc18cf. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:48:49.067677 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:48:49.070041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:48:49.171140 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-074e28e3-5580-48f6-9e33-af17b2b57f12 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637540 Feb 12 21:48:49.172080 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3346/6559] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:48:49.182303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ac975307-0f31-4465-8fdd-9073f9bac927 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:49.184546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ac975307-0f31-4465-8fdd-9073f9bac927 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:49.236405 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ac975307-0f31-4465-8fdd-9073f9bac927 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:49.243608 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ac975307-0f31-4465-8fdd-9073f9bac927 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1216 microversion: 2.1 time: 0.065121 Feb 12 21:48:49.244206 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3214/6560] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:49 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:48:50.262313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:50.264328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:50.270997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:50.271467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:50.272270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:50.272718 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:50.334955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:50.342445 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-07dad187-45ea-4e4c-97d3-c04dc5bf0be9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1212 microversion: 2.1 time: 0.084928 Feb 12 21:48:50.343026 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3347/6561] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:50 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:48:51.362726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:51.363378 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:51.371254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:51.371710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:51.372752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:51.373196 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:51.450684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:51.458012 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0e9de14d-5d5d-44b2-8f41-6a6b54e09114 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1274 microversion: 2.1 time: 0.099635 Feb 12 21:48:51.458583 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3215/6562] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:51 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:52.478954 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:52.479582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:52.486290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:52.486761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:52.487805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:52.488258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:52.536742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a694314d-38b4-4f3d-9aa2-46a62a922b38 req-f2320dec-4f17-498d-a14b-e1795018753d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bddec952-e261-498e-b9d0-45b690a99d50", "tag": "ce7c7d3c-bc55-487f-acd8-dbf134ce890c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:52.540752 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:52.540752 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:48:52.552831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a694314d-38b4-4f3d-9aa2-46a62a922b38 req-f2320dec-4f17-498d-a14b-e1795018753d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:52.552831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a694314d-38b4-4f3d-9aa2-46a62a922b38 req-f2320dec-4f17-498d-a14b-e1795018753d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:52.563188 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a694314d-38b4-4f3d-9aa2-46a62a922b38 req-f2320dec-4f17-498d-a14b-e1795018753d service nova] Creating event network-changed:ce7c7d3c-bc55-487f-acd8-dbf134ce890c for instance bddec952-e261-498e-b9d0-45b690a99d50 on nch2-master-1 Feb 12 21:48:52.569806 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a694314d-38b4-4f3d-9aa2-46a62a922b38 req-f2320dec-4f17-498d-a14b-e1795018753d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039064 Feb 12 21:48:52.570989 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3216/6563] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:48:52.638370 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:52.646534 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3904895e-8bf9-4f9c-a815-391bc7537a5c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1316 microversion: 2.1 time: 0.171222 Feb 12 21:48:52.647137 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3348/6564] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:52 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:53.665011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:53.665725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:53.672258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:53.675928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:53.675928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:53.675928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:53.814452 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:53.822599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1abb7157-eb9e-45a6-b5f9-e4389bbd1bb1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1316 microversion: 2.1 time: 0.162492 Feb 12 21:48:53.827308 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3217/6565] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:53 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:54.840139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:54.840689 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:54.847731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:54.852250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:54.852250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:54.852250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:55.293973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:55.301774 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-122f7559-8474-40d8-933e-47abafff1fc9 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1316 microversion: 2.1 time: 0.465657 Feb 12 21:48:55.302360 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3349/6566] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:54 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:56.322139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:56.322757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:56.329545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:56.330116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:56.330831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:56.331277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:56.464530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:56.471951 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f91aca02-76cb-4ba5-9d52-9715cdaab92c tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1316 microversion: 2.1 time: 0.153933 Feb 12 21:48:56.472530 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3218/6567] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:56 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:57.490160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:57.490828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:57.497872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:57.498417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:57.499228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:57.499684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:57.638363 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:57.646631 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e26a826b-a3b0-47af-a617-34d43fd232cb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1316 microversion: 2.1 time: 0.161080 Feb 12 21:48:57.647454 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3350/6568] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:57 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:57.651804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6748c38c-b873-47f8-8014-a211b96a41bb req-9a36281b-e9de-466a-af6c-9e5f0653d00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bddec952-e261-498e-b9d0-45b690a99d50", "name": "network-vif-plugged", "status": "completed", "tag": "ce7c7d3c-bc55-487f-acd8-dbf134ce890c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:48:57.653687 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:48:57.653687 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:48:57.663105 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6748c38c-b873-47f8-8014-a211b96a41bb req-9a36281b-e9de-466a-af6c-9e5f0653d00d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:57.663561 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6748c38c-b873-47f8-8014-a211b96a41bb req-9a36281b-e9de-466a-af6c-9e5f0653d00d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:57.677765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6748c38c-b873-47f8-8014-a211b96a41bb req-9a36281b-e9de-466a-af6c-9e5f0653d00d service nova] Creating event network-vif-plugged:ce7c7d3c-bc55-487f-acd8-dbf134ce890c for instance bddec952-e261-498e-b9d0-45b690a99d50 on nch2-master-1 Feb 12 21:48:57.692445 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6748c38c-b873-47f8-8014-a211b96a41bb req-9a36281b-e9de-466a-af6c-9e5f0653d00d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034938 Feb 12 21:48:57.692445 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3219/6569] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:48:58.664115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:58.664769 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:58.671911 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:58.672380 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:58.673180 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:58.673659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:58.821017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:48:58.829388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c94426a-fa2d-4594-982c-02c1fa25fdec tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1316 microversion: 2.1 time: 0.169074 Feb 12 21:48:58.829987 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3351/6570] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:58 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:48:59.847283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:48:59.848581 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:48:59.855931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:59.856421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:59.857241 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:48:59.857731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:48:59.995462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:00.003158 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-caacc413-808e-451a-8a12-fc793053d6dc tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1505 microversion: 2.1 time: 0.159836 Feb 12 21:49:00.003734 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3220/6571] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:48:59 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:00.019348 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:00.022815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:00.026926 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:00.027402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:00.028209 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:00.028813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:00.055410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:49:00.352532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e989b88f-4d84-40c1-ad2f-af66bfff6282 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 204 len: 0 microversion: 2.1 time: 0.336496 Feb 12 21:49:00.353057 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3352/6572] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:49:00 2022] DELETE /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:49:00.361019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:00.361682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:00.367852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:00.368309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:00.369101 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:00.369602 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:00.501326 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:00.508901 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76ba8ba3-985a-4be3-b962-b543b2cac2aa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1511 microversion: 2.1 time: 0.151706 Feb 12 21:49:00.509495 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3221/6573] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:00 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:01.526374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:01.527216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:01.534072 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:01.534544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:01.535386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:01.535891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:01.673684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:01.681435 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3b6a15d2-3c99-476d-b773-c500b95b2da7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1511 microversion: 2.1 time: 0.159124 Feb 12 21:49:01.682032 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3353/6574] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:01 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:02.129331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-158136dd-39b6-4e45-bec9-da4ebcfe7a0d req-ac0b49b6-f0e5-4e1c-8667-faa27ec7d7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bddec952-e261-498e-b9d0-45b690a99d50", "name": "network-vif-deleted", "tag": "ce7c7d3c-bc55-487f-acd8-dbf134ce890c"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:02.131365 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:49:02.131365 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:49:02.142221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-158136dd-39b6-4e45-bec9-da4ebcfe7a0d req-ac0b49b6-f0e5-4e1c-8667-faa27ec7d7ce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:02.142821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-158136dd-39b6-4e45-bec9-da4ebcfe7a0d req-ac0b49b6-f0e5-4e1c-8667-faa27ec7d7ce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:02.156719 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-158136dd-39b6-4e45-bec9-da4ebcfe7a0d req-ac0b49b6-f0e5-4e1c-8667-faa27ec7d7ce service nova] Creating event network-vif-deleted:ce7c7d3c-bc55-487f-acd8-dbf134ce890c for instance bddec952-e261-498e-b9d0-45b690a99d50 on nch2-master-1 Feb 12 21:49:02.163224 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-158136dd-39b6-4e45-bec9-da4ebcfe7a0d req-ac0b49b6-f0e5-4e1c-8667-faa27ec7d7ce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036447 Feb 12 21:49:02.163850 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3222/6575] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:49:02.698819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:02.699440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:02.706389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:02.706890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:02.707693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:02.708758 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:02.747073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:02.747557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:02.748006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lazy-loading 'fault' on Instance uuid bddec952-e261-498e-b9d0-45b690a99d50 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:49:02.791187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:02.799027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9b958149-89be-46d2-9349-4eea235fa123 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 200 len: 1306 microversion: 2.1 time: 0.104058 Feb 12 21:49:02.799624 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3354/6576] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:02 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:03.816913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:03.817779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:03.825200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:03.838388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:03.838388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:03.838388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:03.840988 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] HTTP exception thrown: Instance bddec952-e261-498e-b9d0-45b690a99d50 could not be found. Feb 12 21:49:03.841693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 404 to user: Instance bddec952-e261-498e-b9d0-45b690a99d50 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:03.842603 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-48907cf3-c28f-43e9-baae-03e557f873de tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 404 len: 111 microversion: 2.1 time: 0.029699 Feb 12 21:49:03.843214 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3223/6577] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:03 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:49:03.852694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:03.853406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:03.860237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:03.860699 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:03.861523 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:03.861973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:03.998636 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.007027 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-89fe666e-749f-4019-bb34-918dbe57dcbb tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.158803 Feb 12 21:49:04.007961 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3355/6578] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:03 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:04.027014 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab283b79-00f9-4f06-aad2-631639cb4148 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:04.028059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab283b79-00f9-4f06-aad2-631639cb4148 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: d6e3c8e3-68ac-46a8-9efd-c177e80e53dc] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.034452 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ab283b79-00f9-4f06-aad2-631639cb4148 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] HTTP exception thrown: Instance d6e3c8e3-68ac-46a8-9efd-c177e80e53dc could not be found. Feb 12 21:49:04.035026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab283b79-00f9-4f06-aad2-631639cb4148 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 404 to user: Instance d6e3c8e3-68ac-46a8-9efd-c177e80e53dc could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:04.036013 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab283b79-00f9-4f06-aad2-631639cb4148 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "POST /compute/v2.1/servers/d6e3c8e3-68ac-46a8-9efd-c177e80e53dc/action" status: 404 len: 111 microversion: 2.1 time: 0.012935 Feb 12 21:49:04.037220 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3224/6579] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:49:04 2022] POST /compute/v2.1/servers/d6e3c8e3-68ac-46a8-9efd-c177e80e53dc/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:49:04.046904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:04.047564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.053811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.054279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.055078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.055533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.190136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.197720 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05f51fdc-1dad-4322-85f1-78599cd3e8a3 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.156239 Feb 12 21:49:04.198307 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3356/6580] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:04 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:04.215563 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:04.216176 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.222934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.223386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.224734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.225184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.357350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.365870 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5452d7b6-e0f3-4d89-9d96-37a8c556896b tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.153896 Feb 12 21:49:04.366465 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3225/6581] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:04 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:04.382687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "714e692d-9680-4a93-8178-523c777a8788"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:04.383750 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.389800 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.390273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.391109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.391561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.420422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.425691 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] HTTP exception thrown: Flavor 714e692d-9680-4a93-8178-523c777a8788 could not be found. Feb 12 21:49:04.426304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 400 to user: Flavor 714e692d-9680-4a93-8178-523c777a8788 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:04.427448 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cd8ed8c-f7f2-46d7-b9a0-3159ace5cdbe tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "POST /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2/action" status: 400 len: 107 microversion: 2.1 time: 0.048895 Feb 12 21:49:04.427964 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3357/6582] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:49:04 2022] POST /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2/action => generated 107 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:49:04.435918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:04.436526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.442386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.443358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.444128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.444564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.578746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.586832 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f025f33e-ed67-4bf3-97d1-ebcd5ec065fa tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.154545 Feb 12 21:49:04.587547 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3226/6583] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:04 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:04.603628 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:04.604249 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.610200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.610700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.611494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.611953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.764717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.769464 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-91fb6bb4-00f1-4636-aa0e-7be7f06c654d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.169536 Feb 12 21:49:04.770030 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3358/6584] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:04 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:04.786020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-013d05b1-6010-47e4-88aa-287d023bd74e tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:04.787315 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-013d05b1-6010-47e4-88aa-287d023bd74e tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:04.789768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-013d05b1-6010-47e4-88aa-287d023bd74e tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "POST /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2/action" status: 400 len: 113 microversion: 2.1 time: 0.006081 Feb 12 21:49:04.789768 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3227/6585] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:49:04 2022] POST /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 12 21:49:04.798035 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:04.798650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.805451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.805953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.806788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.807252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.940189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:04.948506 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4be84e11-a391-492a-8dab-9f757fbcf408 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1506 microversion: 2.1 time: 0.154598 Feb 12 21:49:04.949080 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3359/6586] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:04 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:04.968626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:04.969224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:04.976293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.976758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.977609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:04.978053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:04.993963 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] HTTP exception thrown: Instance bddec952-e261-498e-b9d0-45b690a99d50 could not be found. Feb 12 21:49:04.993963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 404 to user: Instance bddec952-e261-498e-b9d0-45b690a99d50 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:04.993963 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4dd0130c-fce2-4385-b53b-c2fa74329a99 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 404 len: 111 microversion: 2.1 time: 0.028861 Feb 12 21:49:04.993963 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3228/6587] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:49:04 2022] DELETE /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:49:05.001229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:05.001892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: bddec952-e261-498e-b9d0-45b690a99d50] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:05.008565 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:05.009032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:05.009854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:05.010305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:05.024213 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] HTTP exception thrown: Instance bddec952-e261-498e-b9d0-45b690a99d50 could not be found. Feb 12 21:49:05.024809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 404 to user: Instance bddec952-e261-498e-b9d0-45b690a99d50 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:05.025675 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1cc9f68c-7fd5-465c-96bd-2b7a26179854 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50" status: 404 len: 111 microversion: 2.1 time: 0.028089 Feb 12 21:49:05.026216 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3360/6588] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:04 2022] GET /compute/v2.1/servers/bddec952-e261-498e-b9d0-45b690a99d50 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:49:05.034693 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:05.035217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:05.042850 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:05.043314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:05.044115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:05.044843 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:05.070599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:49:05.358059 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2d5652cd-a779-4a70-98e7-ddf07d7e72f7 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "DELETE /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 204 len: 0 microversion: 2.1 time: 0.327240 Feb 12 21:49:05.358674 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3229/6589] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:49:05 2022] DELETE /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 12 21:49:05.367115 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:05.367744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:05.374810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:05.375545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:05.376377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:05.376841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:05.513264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:05.520693 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ede24c6a-82ce-4bd3-9445-dda613964ab1 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1512 microversion: 2.1 time: 0.157855 Feb 12 21:49:05.521429 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3361/6590] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:05 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:06.539226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:06.539946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:06.547021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:06.547486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:06.548281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:06.548723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:06.683476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:06.690938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9489dfed-2a6a-4f4c-b2db-e18e11ab2325 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1512 microversion: 2.1 time: 0.156604 Feb 12 21:49:06.691515 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3230/6591] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:06 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:07.392298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-836ab390-7607-4626-a1ac-7fd34f9ec6bc req-7c5679e1-3fd0-4c0d-ae40-723ed14caf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e1381b-d471-40f3-a558-7657cb1a48c2", "name": "network-vif-deleted", "tag": "3258d224-67ed-44c1-920e-274671e1d2e4"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:07.393868 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:49:07.393868 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:49:07.402782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-836ab390-7607-4626-a1ac-7fd34f9ec6bc req-7c5679e1-3fd0-4c0d-ae40-723ed14caf16 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:07.405060 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-836ab390-7607-4626-a1ac-7fd34f9ec6bc req-7c5679e1-3fd0-4c0d-ae40-723ed14caf16 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:07.414948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-836ab390-7607-4626-a1ac-7fd34f9ec6bc req-7c5679e1-3fd0-4c0d-ae40-723ed14caf16 service nova] Creating event network-vif-deleted:3258d224-67ed-44c1-920e-274671e1d2e4 for instance 76e1381b-d471-40f3-a558-7657cb1a48c2 on nch1-master-1 Feb 12 21:49:07.420168 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-836ab390-7607-4626-a1ac-7fd34f9ec6bc req-7c5679e1-3fd0-4c0d-ae40-723ed14caf16 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031302 Feb 12 21:49:07.422109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3362/6592] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:49:07.707580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:07.708223 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:07.715408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:07.716981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:07.716981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:07.717301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:07.749752 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:07.750207 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:07.750674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lazy-loading 'fault' on Instance uuid 76e1381b-d471-40f3-a558-7657cb1a48c2 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:49:07.790766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e237a1cc044978b7a9d8c262a738ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38accd245be44a99cb7c89cb2dc18cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:07.798337 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-50d1009d-a926-4c33-99d1-cae222f0242d tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 200 len: 1307 microversion: 2.1 time: 0.094692 Feb 12 21:49:07.798902 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3231/6593] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:07 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:08.817165 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:08.817825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] [instance: 76e1381b-d471-40f3-a558-7657cb1a48c2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:08.824922 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:08.825416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:08.826226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:08.826680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:08.842292 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] HTTP exception thrown: Instance 76e1381b-d471-40f3-a558-7657cb1a48c2 could not be found. Feb 12 21:49:08.842900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] Returning 404 to user: Instance 76e1381b-d471-40f3-a558-7657cb1a48c2 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:49:08.843736 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb295dd8-1712-43c6-9a81-b21f1fd18d63 tempest-ServersNegativeTestJSON-1803033610 tempest-ServersNegativeTestJSON-1803033610-project] 10.222.0.31 "GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2" status: 404 len: 111 microversion: 2.1 time: 0.031645 Feb 12 21:49:08.844279 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3363/6594] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:08 2022] GET /compute/v2.1/servers/76e1381b-d471-40f3-a558-7657cb1a48c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:49:59.096554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e6861472-0279-4dd3-8ab3-9ee21bbf1da1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Action: 'create', calling method: .version_select at 0x7fa8fe1b64c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1470107555"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:59.110498 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e6861472-0279-4dd3-8ab3-9ee21bbf1da1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Getting quotas for project 64d444f067e241a0ba61105f426bc943. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:49:59.115454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e6861472-0279-4dd3-8ab3-9ee21bbf1da1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Getting quotas for user 452d610a87c2437b9eb07dd432a218e1 and project 64d444f067e241a0ba61105f426bc943. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:49:59.258876 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e6861472-0279-4dd3-8ab3-9ee21bbf1da1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Getting quotas for project 64d444f067e241a0ba61105f426bc943. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:49:59.264516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-e6861472-0279-4dd3-8ab3-9ee21bbf1da1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Getting quotas for user 452d610a87c2437b9eb07dd432a218e1 and project 64d444f067e241a0ba61105f426bc943. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:49:59.278904 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e6861472-0279-4dd3-8ab3-9ee21bbf1da1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.186409 Feb 12 21:49:59.279500 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3232/6595] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:49:59 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:49:59.326793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-244163691", "imageRef": "3a50503f-716c-4b6d-b711-5dc89a6284f7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1470107555", "networks": [{"uuid": "dc0e0f46-1573-4d40-ad1f-8176452918ae"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:49:59.376279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] validate_networks() for [('dc0e0f46-1573-4d40-ad1f-8176452918ae', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:49:59.752361 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:49:59.752803 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:49:59.753293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:49:59.753824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:49:59.754254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:49:59.763900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:59.764365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:59.765201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:49:59.765680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:49:59.784003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Getting quotas for project 64d444f067e241a0ba61105f426bc943. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:49:59.789239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Getting quotas for user 452d610a87c2437b9eb07dd432a218e1 and project 64d444f067e241a0ba61105f426bc943. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:49:59.802480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:49:59.804828 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a50503f-716c-4b6d-b711-5dc89a6284f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:49:59.919984 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e443bf61-6767-4a54-8086-4bfeabe46d3c tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596922 Feb 12 21:49:59.920907 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3364/6596] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:49:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:49:59.930775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fa17629f-8dad-4756-966c-c76f57ad2e5d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:49:59.931470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fa17629f-8dad-4756-966c-c76f57ad2e5d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:49:59.984531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fa17629f-8dad-4756-966c-c76f57ad2e5d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:49:59.991257 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fa17629f-8dad-4756-966c-c76f57ad2e5d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1258 microversion: 2.1 time: 0.064473 Feb 12 21:49:59.991793 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3233/6597] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:49:59 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:50:01.008909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:01.009571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:01.016504 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:01.016968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:01.017869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:01.018329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:01.079909 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:01.087530 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-88271b13-db95-4f67-83e3-0d9d7e65c7c3 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1262 microversion: 2.1 time: 0.083443 Feb 12 21:50:01.088738 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3365/6598] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:01 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:02.104227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:02.104851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:02.114395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:02.115128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:02.115932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:02.116375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:02.184931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:02.192530 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-da878b10-6fe5-48be-a6eb-8b7beeaa7e0a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1328 microversion: 2.1 time: 0.092202 Feb 12 21:50:02.193104 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3234/6599] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:02 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:03.217923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:03.219541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:03.227104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:03.227567 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:03.228386 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:03.228843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:03.373779 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:03.382014 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-29d512db-3619-4275-9b84-6461a73074c9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.169153 Feb 12 21:50:03.382616 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3366/6600] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:03 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:04.403411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:04.405038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:04.414325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:04.414866 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:04.415810 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:04.416307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:04.578066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:04.586204 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a0965b4c-ae52-4882-a6ae-208eb94eb996 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.189147 Feb 12 21:50:04.586790 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3235/6601] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:04 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:05.608033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:05.608682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:05.616009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:05.616485 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:05.617312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:05.617786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:05.780038 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:05.786580 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-180c547c-bdfb-4727-a031-a58b1806ac47 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.182657 Feb 12 21:50:05.787174 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3367/6602] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:05 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:06.804631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:06.806027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:06.814271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:06.814643 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:06.815640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:06.816086 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:06.962963 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:06.971600 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-042f725c-1206-4df3-afcd-c4b7baa89a3b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.171169 Feb 12 21:50:06.972205 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3236/6603] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:06 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:07.991229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:07.992360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:07.999893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:08.000443 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:08.002488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:08.002488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:08.144235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:08.152980 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-63c865f9-3e81-4012-9666-d51957a9f300 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.165495 Feb 12 21:50:08.154368 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3368/6604] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:07 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:09.171111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:09.171742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:09.178491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:09.178950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:09.179878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:09.180382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:09.338089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:09.346115 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f6b1c44b-eb5e-4291-a891-3a1080e7c991 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.179444 Feb 12 21:50:09.346707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3237/6605] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:09 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:10.363775 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:10.364396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:10.371202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:10.371672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:10.373312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:10.373812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:10.518970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:10.526919 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-53ba4f38-2e8b-40d5-9a77-0295cad825d0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.166940 Feb 12 21:50:10.527587 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3369/6606] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:10 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:11.544848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:11.545749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:11.553284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:11.553782 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:11.554583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:11.555019 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:11.722156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:11.729736 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7bb917c3-bb84-48c3-9ebd-6b9bbc60d536 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.188837 Feb 12 21:50:11.730455 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3238/6607] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:11 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:11.791229 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-62b3d46b-c334-4731-85da-1bf97c5da573 req-fbe28946-3278-48ce-a3ac-aab1c70d05db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:11.792803 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:50:11.792803 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:50:11.802222 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-62b3d46b-c334-4731-85da-1bf97c5da573 req-fbe28946-3278-48ce-a3ac-aab1c70d05db service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:11.802680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-62b3d46b-c334-4731-85da-1bf97c5da573 req-fbe28946-3278-48ce-a3ac-aab1c70d05db service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:11.813954 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-62b3d46b-c334-4731-85da-1bf97c5da573 req-fbe28946-3278-48ce-a3ac-aab1c70d05db service nova] Creating event network-changed:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:50:11.819396 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-62b3d46b-c334-4731-85da-1bf97c5da573 req-fbe28946-3278-48ce-a3ac-aab1c70d05db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031734 Feb 12 21:50:11.823780 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3370/6608] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:50:12.747734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:12.749579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:12.756658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:12.757191 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:12.758085 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:12.758634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:12.975064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:12.983258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-30ab0a0c-9ca1-48b3-a613-1aae72c221fe tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.239822 Feb 12 21:50:12.983960 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3239/6609] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:12 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:14.001705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:14.002351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:14.008673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:14.012778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:14.012778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:14.012778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:14.150148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:14.158365 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1d51a502-69a2-488f-980b-89c7a2c0e313 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.162132 Feb 12 21:50:14.158955 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3371/6610] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:13 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:50:15.175433 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:15.176045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:15.183295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:15.183747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:15.184534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:15.184971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:15.321324 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:15.328657 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-62138a51-0ef0-472a-8675-f0f40df18b22 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.157039 Feb 12 21:50:15.329226 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3240/6611] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:15 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:16.345697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:16.346326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:16.353161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:16.353674 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:16.354490 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:16.355018 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:16.492955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:16.501343 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fb225776-499b-47ef-a754-5d4aa39091e5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.159394 Feb 12 21:50:16.510614 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3372/6612] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:16 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:16.695472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e8d59ec2-4f1d-4278-8bc3-b1ce1d9e4477 req-89e92916-0cfd-44ae-a723-efd3f06d734d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "name": "network-vif-plugged", "status": "completed", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:16.697064 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:50:16.697064 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:50:16.705021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e8d59ec2-4f1d-4278-8bc3-b1ce1d9e4477 req-89e92916-0cfd-44ae-a723-efd3f06d734d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:16.706181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e8d59ec2-4f1d-4278-8bc3-b1ce1d9e4477 req-89e92916-0cfd-44ae-a723-efd3f06d734d service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:16.716841 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e8d59ec2-4f1d-4278-8bc3-b1ce1d9e4477 req-89e92916-0cfd-44ae-a723-efd3f06d734d service nova] Creating event network-vif-plugged:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:50:16.722137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e8d59ec2-4f1d-4278-8bc3-b1ce1d9e4477 req-89e92916-0cfd-44ae-a723-efd3f06d734d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031472 Feb 12 21:50:16.722754 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3241/6613] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:50:17.518747 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:17.519375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:17.526146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:17.526612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:17.527442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:17.527890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:17.662118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:17.669469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d2ae0073-a604-4032-a3a1-7ae469a5979b tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1358 microversion: 2.1 time: 0.154998 Feb 12 21:50:17.670043 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3373/6614] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:17 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:18.689144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:18.689873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:18.696243 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:18.696699 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:18.697523 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:18.697968 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:18.831265 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:18.838598 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1ef70fa7-73b7-410c-bd85-864cd5a67651 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1549 microversion: 2.1 time: 0.155797 Feb 12 21:50:18.839168 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3242/6615] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:18 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:18.854563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:18.855196 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:18.862150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:18.862622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:18.863420 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:18.863874 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:19.007548 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:19.015025 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ccf0556-a622-4f3a-a84b-ed4f69e64bcc tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1549 microversion: 2.1 time: 0.164097 Feb 12 21:50:19.015608 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3374/6616] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:18 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:19.031331 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:19.034804 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:50:19.034804 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:50:19.035958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:19.036708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Searching by: {'deleted': False, 'project_id': '64d444f067e241a0ba61105f426bc943'} {{(pid=141726) get_all /opt/stack/nova/nova/compute/api.py:2927}} Feb 12 21:50:19.042320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:19.042777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:19.043587 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:19.044213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:19.070482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.multi_cell_list [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=141726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 12 21:50:19.097467 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f1a15d9-7800-4b96-aa95-3ac10df5302a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069689 Feb 12 21:50:19.098063 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3243/6617] 10.222.0.31 () {58 vars in 1124 bytes} [Sat Feb 12 21:50:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:50:19.108019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:19.108700 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:19.115536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:19.116023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:19.116811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:19.117263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:19.258305 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:19.266612 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-aab3d78b-e1b5-4c77-90cf-9be51a1af024 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1549 microversion: 2.1 time: 0.161614 Feb 12 21:50:19.267188 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3375/6618] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:19 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:21.119513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faa73997-a56d-47de-8320-764458199373"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:21.121543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:21.127956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:21.128414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:21.129204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:21.129669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:21.829990 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a4ee7f46-296b-4db2-8083-2a9130cb1f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713977 Feb 12 21:50:21.830687 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3244/6619] 10.222.0.31 () {60 vars in 1322 bytes} [Sat Feb 12 21:50:21 2022] POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:50:25.146984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:25.147614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:25.153645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:25.154122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:25.154950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:25.155408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:25.288385 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:25.296611 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc99492a-3968-42bf-a4b7-6a29544ed548 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1595 microversion: 2.1 time: 0.153783 Feb 12 21:50:25.297190 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3376/6620] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:25 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:27.768268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-e68a891f-f82e-41d3-b710-5b4908807a6a req-40af87df-2281-40e5-896d-75b60f6162af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:27.768268 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:50:27.768268 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:50:27.774538 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e68a891f-f82e-41d3-b710-5b4908807a6a req-40af87df-2281-40e5-896d-75b60f6162af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:27.775111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-e68a891f-f82e-41d3-b710-5b4908807a6a req-40af87df-2281-40e5-896d-75b60f6162af service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:27.787886 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-e68a891f-f82e-41d3-b710-5b4908807a6a req-40af87df-2281-40e5-896d-75b60f6162af service nova] Creating event network-changed:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:50:27.793671 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-e68a891f-f82e-41d3-b710-5b4908807a6a req-40af87df-2281-40e5-896d-75b60f6162af service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164504 Feb 12 21:50:27.794385 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3245/6621] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:50:29.944768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1105704075"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:29.945329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:29.952278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:29.952749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:29.953590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:29.954160 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:30.085309 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.network.security_group_api [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Adding security group 2f9768d6-16ba-4939-a3a8-604c1b92a060 to port 811a62c5-a9c0-43fd-b595-30c92bd6d51e Feb 12 21:50:30.485742 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a7697527-d8a2-43c9-a3a2-4de1dddccc65 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.544365 Feb 12 21:50:30.486480 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3377/6622] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:50:29 2022] POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:50:30.500026 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:30.501021 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-5546a2fc-0b62-4078-89f1-fcd623709ce8 req-58ba4fb7-e1c3-48c5-8d72-06e279fdbd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:30.502843 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:50:30.502843 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:50:30.504179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:30.520972 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:30.524846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:30.526740 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5546a2fc-0b62-4078-89f1-fcd623709ce8 req-58ba4fb7-e1c3-48c5-8d72-06e279fdbd42 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:30.527804 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:30.528512 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:30.530841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-5546a2fc-0b62-4078-89f1-fcd623709ce8 req-58ba4fb7-e1c3-48c5-8d72-06e279fdbd42 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:30.549948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-5546a2fc-0b62-4078-89f1-fcd623709ce8 req-58ba4fb7-e1c3-48c5-8d72-06e279fdbd42 service nova] Creating event network-changed:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:50:30.555054 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-5546a2fc-0b62-4078-89f1-fcd623709ce8 req-58ba4fb7-e1c3-48c5-8d72-06e279fdbd42 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060304 Feb 12 21:50:30.555674 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3378/6623] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:50:30.809387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:30.818820 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c6a3c1dc-3fd4-49c6-88d9-e2a42de04bd5 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1761 microversion: 2.1 time: 0.327909 Feb 12 21:50:30.820166 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3246/6624] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:30 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1761 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:54.399230 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:50:54.400272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:54.406818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:54.407286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:54.408089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:54.408543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:54.619177 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4ea2ce30-08ea-4691-8894-12b9dbfe41bb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.224684 Feb 12 21:50:54.620197 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3379/6625] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:50:54 2022] POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:50:54.628311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:54.628931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:54.635728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:54.636193 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:54.636992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:54.637502 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:54.825820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:54.833982 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-851cf8fd-3ebb-471f-a92f-7c8dad0cd295 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1753 microversion: 2.1 time: 0.209544 Feb 12 21:50:54.834564 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3247/6626] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:54 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:55.852010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:55.852802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:55.859995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:55.863122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:55.863122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:55.863122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:56.008961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:56.017038 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ed08db63-d665-4ded-9bf1-b57a36fed482 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.169215 Feb 12 21:50:56.017635 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3380/6627] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:55 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:57.034889 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:57.035559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:57.042216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:57.042672 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:57.043463 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:57.043898 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:57.196991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:57.205211 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c8bf240d-7290-44b0-97d0-7d2048ec7eb6 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.174227 Feb 12 21:50:57.206529 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3248/6628] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:57 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:58.224125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:58.224748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:58.231612 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:58.232086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:58.232882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:58.233346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:58.387726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:58.396517 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-90bd8a1c-3b19-48dc-87a7-c3e6e3fac6b1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.176949 Feb 12 21:50:58.399026 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3381/6629] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:58 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:50:59.414394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:50:59.415004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:50:59.422063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:59.422513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:59.423286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:50:59.423723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:50:59.570281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:50:59.578175 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-78d0d2ad-76af-4b78-b07b-f4bc8b1faee0 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.167749 Feb 12 21:50:59.578749 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3249/6630] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:50:59 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:00.594877 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:00.595534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:00.603045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:00.603514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:00.604320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:00.604773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:00.752162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:00.760326 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d0a22866-e413-4be7-9a29-929bf42e8f24 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.169190 Feb 12 21:51:00.760905 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3382/6631] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:00 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:01.777580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:01.778192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:01.784980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:01.785474 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:01.786288 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:01.786725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:01.932658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:01.940545 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-41791035-f511-471c-ae37-61a084628499 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.166690 Feb 12 21:51:01.941773 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3250/6632] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:01 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:02.958680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:02.959306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:02.966146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:02.966615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:02.967411 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:02.967871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:03.116360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:03.124618 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77f8e07f-4f71-4063-909d-4714254d8649 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.170322 Feb 12 21:51:03.125198 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3383/6633] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:02 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:04.143844 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:04.144565 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:04.151454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:04.151901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:04.152678 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:04.153119 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:04.303909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:04.311808 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7e31e13b-bfe6-4312-b18f-1aba741e2558 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.171632 Feb 12 21:51:04.312394 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3251/6634] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:04 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:51:05.329609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:05.330233 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:05.338112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:05.338584 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:05.339378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:05.339830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:05.488358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:05.496337 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0cba44ac-fa99-48cc-aef0-11fcd838aa46 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1758 microversion: 2.1 time: 0.170429 Feb 12 21:51:05.496916 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3384/6635] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:05 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:06.514164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:06.514796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:06.522320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:06.522778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:06.523569 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:06.524013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:06.668205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:06.676927 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2af63da6-d254-4756-8dcb-84701a98c8e1 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1761 microversion: 2.1 time: 0.166382 Feb 12 21:51:06.677538 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3252/6636] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:06 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:39.548533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1105704075"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:51:39.549171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:39.555951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:39.556419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:39.557206 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:39.557691 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:39.695015 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.network.security_group_api [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Removing security group 2f9768d6-16ba-4939-a3a8-604c1b92a060 from port 811a62c5-a9c0-43fd-b595-30c92bd6d51e Feb 12 21:51:40.130287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1890406e-adb8-4c91-b673-dc80f760380a tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.585999 Feb 12 21:51:40.131440 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3385/6637] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:51:39 2022] POST /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:51:40.141795 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-aeacdffd-867e-4bfc-b966-535048de01fb req-befec4e9-256a-4ed3-bbc0-6e560336abdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:51:40.143390 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:51:40.143390 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:51:40.157415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-aeacdffd-867e-4bfc-b966-535048de01fb req-befec4e9-256a-4ed3-bbc0-6e560336abdc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:40.158365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-aeacdffd-867e-4bfc-b966-535048de01fb req-befec4e9-256a-4ed3-bbc0-6e560336abdc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:40.185300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-aeacdffd-867e-4bfc-b966-535048de01fb req-befec4e9-256a-4ed3-bbc0-6e560336abdc service nova] Creating event network-changed:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:51:40.190979 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-aeacdffd-867e-4bfc-b966-535048de01fb req-befec4e9-256a-4ed3-bbc0-6e560336abdc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056008 Feb 12 21:51:40.192398 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3253/6638] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:51:41.480540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:41.481085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:41.487378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:41.487843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:41.488638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:41.489090 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:41.567373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lazy-loading 'services' on Instance uuid e7abd173-7fe4-4054-95e4-a6c9ed013a3e {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:51:41.823437 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ed1bf07f-7714-4899-91fb-522e618ee2eb tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments/faa73997-a56d-47de-8320-764458199373" status: 202 len: 0 microversion: 2.1 time: 0.347509 Feb 12 21:51:41.823955 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3386/6639] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:51:41 2022] DELETE /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments/faa73997-a56d-47de-8320-764458199373 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:51:41.834011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:41.835152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:41.841779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:41.842237 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:41.843040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:41.843477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:41.874854 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-806602f6-ebfd-4678-87cb-a8f68f9df997 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Feb 12 21:51:41.875439 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3254/6640] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:51:41 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:51:42.206608 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-90076d0f-45e3-4c65-aa41-2f70c10ba9a7 req-818ebaaf-bdbb-4fc3-8616-828320fbe54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:51:42.208182 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:51:42.208182 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:51:42.216570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-90076d0f-45e3-4c65-aa41-2f70c10ba9a7 req-818ebaaf-bdbb-4fc3-8616-828320fbe54f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:42.217037 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-90076d0f-45e3-4c65-aa41-2f70c10ba9a7 req-818ebaaf-bdbb-4fc3-8616-828320fbe54f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:42.229499 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-90076d0f-45e3-4c65-aa41-2f70c10ba9a7 req-818ebaaf-bdbb-4fc3-8616-828320fbe54f service nova] Creating event network-changed:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:51:42.234388 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-90076d0f-45e3-4c65-aa41-2f70c10ba9a7 req-818ebaaf-bdbb-4fc3-8616-828320fbe54f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031957 Feb 12 21:51:42.234987 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3387/6641] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:51:42.886766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:42.887704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:42.894567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:42.895025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:42.895809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:42.896248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:42.927082 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ab505c36-8a16-43c9-b448-52f2bcd8aaca tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043814 Feb 12 21:51:42.929038 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3255/6642] 10.222.0.31 () {58 vars in 1301 bytes} [Sat Feb 12 21:51:42 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 12 21:51:42.944865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:42.945682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:42.952260 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:42.954939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:42.954939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:42.954939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:43.031524 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] HTTP exception thrown: Instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e is not attached to volume faa73997-a56d-47de-8320-764458199373 Feb 12 21:51:43.032142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Returning 404 to user: Instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e is not attached to volume faa73997-a56d-47de-8320-764458199373 {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:51:43.032999 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-17800a5a-677e-4bff-85cd-d902cd43601d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments/faa73997-a56d-47de-8320-764458199373" status: 404 len: 154 microversion: 2.1 time: 0.099191 Feb 12 21:51:43.033601 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3388/6643] 10.222.0.31 () {58 vars in 1415 bytes} [Sat Feb 12 21:51:42 2022] DELETE /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e/os-volume_attachments/faa73997-a56d-47de-8320-764458199373 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:51:47.422948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:47.423475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:47.430579 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:47.431038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:47.431832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:47.432276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:47.457301 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:51:47.762769 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d0322c34-4fef-4a35-9a08-6f2d92fd42e9 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 204 len: 0 microversion: 2.1 time: 0.343504 Feb 12 21:51:47.763465 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3256/6644] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:51:47 2022] DELETE /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:51:47.771645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:47.772273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:47.780212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:47.780952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:47.781784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:47.782368 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:47.922130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:47.930018 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f60e9caa-fcac-4803-a0b9-d47782040478 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1555 microversion: 2.1 time: 0.162293 Feb 12 21:51:47.930599 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3389/6645] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:47 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:48.947881 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:48.948583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:48.955295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:48.955745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:48.956524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:48.956981 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:49.093723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:49.102066 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85985952-d299-4381-9eba-cf2574352949 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1555 microversion: 2.1 time: 0.158391 Feb 12 21:51:49.102577 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3257/6646] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:48 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:50.119763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:50.120413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:50.127181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:50.131868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:50.131868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:50.131868 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:50.267572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '452d610a87c2437b9eb07dd432a218e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d444f067e241a0ba61105f426bc943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:51:50.275740 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-350fba22-01cc-42ec-910d-22f902d48786 tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 200 len: 1555 microversion: 2.1 time: 0.160448 Feb 12 21:51:50.276463 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3390/6647] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:50 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:51:50.282875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-03e95fce-19bd-4f58-8008-0c7ef1b0f390 req-cc5e7264-8dd9-4904-8b0a-38206ab310bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7abd173-7fe4-4054-95e4-a6c9ed013a3e", "name": "network-vif-deleted", "tag": "811a62c5-a9c0-43fd-b595-30c92bd6d51e"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:51:50.284962 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:51:50.284962 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:51:50.293772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-03e95fce-19bd-4f58-8008-0c7ef1b0f390 req-cc5e7264-8dd9-4904-8b0a-38206ab310bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:50.298283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-03e95fce-19bd-4f58-8008-0c7ef1b0f390 req-cc5e7264-8dd9-4904-8b0a-38206ab310bf service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:50.306272 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-03e95fce-19bd-4f58-8008-0c7ef1b0f390 req-cc5e7264-8dd9-4904-8b0a-38206ab310bf service nova] Creating event network-vif-deleted:811a62c5-a9c0-43fd-b595-30c92bd6d51e for instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e on nch1-master-1 Feb 12 21:51:50.311351 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-03e95fce-19bd-4f58-8008-0c7ef1b0f390 req-cc5e7264-8dd9-4904-8b0a-38206ab310bf service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032198 Feb 12 21:51:50.311945 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3258/6648] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:51:51.292754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:51.293375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] [instance: e7abd173-7fe4-4054-95e4-a6c9ed013a3e] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:51:51.300125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:51.300594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:51.301416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:51:51.301867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:51:51.314953 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] HTTP exception thrown: Instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e could not be found. Feb 12 21:51:51.315544 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Returning 404 to user: Instance e7abd173-7fe4-4054-95e4-a6c9ed013a3e could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:51:51.316361 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d03fb394-927c-444d-89a2-65eb8bedf81d tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e" status: 404 len: 111 microversion: 2.1 time: 0.028197 Feb 12 21:51:51.316890 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3391/6649] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:51:51 2022] GET /compute/v2.1/servers/e7abd173-7fe4-4054-95e4-a6c9ed013a3e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:51:51.325967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2d85dc17-4422-49b5-a999-bb18bb9d09cf tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] Calling method '.version_select at 0x7fa8fd0f6a60>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:51:51.409589 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2d85dc17-4422-49b5-a999-bb18bb9d09cf tempest-TestMinimumBasicScenario-541339579 tempest-TestMinimumBasicScenario-541339579-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1470107555" status: 202 len: 0 microversion: 2.1 time: 0.087849 Feb 12 21:51:51.410184 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3259/6650] 10.222.0.31 () {58 vars in 1271 bytes} [Sat Feb 12 21:51:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1470107555 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:51:51.894142 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:51:51.894365 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 21:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:52:03.818687 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-71956711-d39d-483b-9a75-1a851543f9f1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: .version_select at 0x7fa8fc5fb700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1669360881"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:52:03.836179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-71956711-d39d-483b-9a75-1a851543f9f1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:52:03.841427 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-71956711-d39d-483b-9a75-1a851543f9f1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:52:04.033782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-71956711-d39d-483b-9a75-1a851543f9f1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:52:04.039501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-71956711-d39d-483b-9a75-1a851543f9f1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:52:04.054034 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-71956711-d39d-483b-9a75-1a851543f9f1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.401982 Feb 12 21:52:04.054555 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3392/6651] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:52:03 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:12.351743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2023586389", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "7ab4106e-482c-4094-adb4-89294aad6c76"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1669360881", "security_groups": [{"name": "tempest-secgroup-smoke-269789807"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:52:12.788308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] validate_networks() for [('7ab4106e-482c-4094-adb4-89294aad6c76', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:52:13.318153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:52:13.318553 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:52:13.320127 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:52:13.320537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:52:13.320970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:52:13.332789 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:13.333254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:13.334145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:13.334591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:13.355236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:52:13.360613 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:52:13.373825 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:52:13.376297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:52:13.488574 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7a6fb2ba-c068-4180-b3c5-7e47ade2446f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.144705 Feb 12 21:52:13.489245 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3260/6652] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:52:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:52:13.501054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4404a51c-7adc-49a7-9708-4423ce1cb11a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:13.510705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4404a51c-7adc-49a7-9708-4423ce1cb11a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:13.579452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4404a51c-7adc-49a7-9708-4423ce1cb11a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:13.602287 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4404a51c-7adc-49a7-9708-4423ce1cb11a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1267 microversion: 2.1 time: 0.105731 Feb 12 21:52:13.603878 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3393/6653] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:13 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:14.620111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4b926b1-2253-41f2-82b7-a1b393aaad29 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:14.620784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4b926b1-2253-41f2-82b7-a1b393aaad29 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:14.681375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4b926b1-2253-41f2-82b7-a1b393aaad29 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:14.690282 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4b926b1-2253-41f2-82b7-a1b393aaad29 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1267 microversion: 2.1 time: 0.074048 Feb 12 21:52:14.690943 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3261/6654] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:14 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:15.707000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:15.707543 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:15.715626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:15.719188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:15.719188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:15.719188 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:15.861923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:15.871803 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f4bc73e4-6d89-4a1d-bc18-9e365d0feaea tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1319 microversion: 2.1 time: 0.168505 Feb 12 21:52:15.872986 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3394/6655] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:15 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:16.889548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:16.890260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:16.898801 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:16.899457 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:16.900263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:16.900704 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:17.142230 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:17.150086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de6225f1-9783-4ff8-a6fb-8c6ad3652503 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.264283 Feb 12 21:52:17.150666 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3262/6656] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:16 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:17.577593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c4bb0446-52e8-42a9-b97d-9bdee6ceb992 req-83ee40d1-1c7d-4ad2-b900-fb62c94e8f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71", "tag": "aec1fd3c-6800-4110-9094-7e5802ef873b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:52:17.579111 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:52:17.579111 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:52:17.598065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c4bb0446-52e8-42a9-b97d-9bdee6ceb992 req-83ee40d1-1c7d-4ad2-b900-fb62c94e8f12 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:17.598542 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c4bb0446-52e8-42a9-b97d-9bdee6ceb992 req-83ee40d1-1c7d-4ad2-b900-fb62c94e8f12 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:17.612138 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c4bb0446-52e8-42a9-b97d-9bdee6ceb992 req-83ee40d1-1c7d-4ad2-b900-fb62c94e8f12 service nova] Creating event network-changed:aec1fd3c-6800-4110-9094-7e5802ef873b for instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 on nch1-master-1 Feb 12 21:52:17.617726 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c4bb0446-52e8-42a9-b97d-9bdee6ceb992 req-83ee40d1-1c7d-4ad2-b900-fb62c94e8f12 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043924 Feb 12 21:52:17.618671 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3395/6657] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:52:18.167719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:18.168342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:18.175558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:18.176017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:18.176820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:18.177263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:18.403045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:18.410579 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cd9fb758-fad1-411e-9664-c72b3c0d7a6e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.247269 Feb 12 21:52:18.411163 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3263/6658] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:18 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:19.430494 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:19.431217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:19.437533 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:19.438007 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:19.438809 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:19.439269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:19.580703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:19.588590 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3ca07149-c43c-488d-b4c6-e21874f789f8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.163916 Feb 12 21:52:19.589166 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3396/6659] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:19 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:20.605815 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:20.606434 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:20.613244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:20.613730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:20.614516 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:20.614959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:20.753973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:20.762116 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b4ed1971-af5d-46a2-84c9-525fb2030cfa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.159971 Feb 12 21:52:20.762689 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3264/6660] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:20 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:52:21.779248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:21.779892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:21.786768 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:21.787238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:21.788032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:21.788595 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:21.932133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:21.940271 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d5a911e-46b9-43c1-8fdb-98992aa9ceeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.164674 Feb 12 21:52:21.940872 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3397/6661] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:21 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:22.958425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:22.959040 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:22.966855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:22.967305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:22.968102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:22.968543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:23.104419 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:23.111995 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9ea557d-a653-411f-b45c-86e6a3422653 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.157264 Feb 12 21:52:23.112572 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3265/6662] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:22 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:23.459242 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c3af15c7-e339-44a1-bd39-41d0df9823e0 req-01177498-6790-47d8-98c8-302c396b2f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71", "name": "network-vif-plugged", "status": "completed", "tag": "aec1fd3c-6800-4110-9094-7e5802ef873b"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:52:23.462007 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:52:23.462007 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:52:23.468047 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c3af15c7-e339-44a1-bd39-41d0df9823e0 req-01177498-6790-47d8-98c8-302c396b2f9a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:23.468549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c3af15c7-e339-44a1-bd39-41d0df9823e0 req-01177498-6790-47d8-98c8-302c396b2f9a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:23.479969 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c3af15c7-e339-44a1-bd39-41d0df9823e0 req-01177498-6790-47d8-98c8-302c396b2f9a service nova] Creating event network-vif-plugged:aec1fd3c-6800-4110-9094-7e5802ef873b for instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 on nch1-master-1 Feb 12 21:52:23.485645 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c3af15c7-e339-44a1-bd39-41d0df9823e0 req-01177498-6790-47d8-98c8-302c396b2f9a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102767 Feb 12 21:52:23.486462 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3398/6663] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:52:24.127854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:24.128472 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:24.135283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:24.135733 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:24.136510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:24.136944 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:24.277660 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:24.284957 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-de1bc552-e516-47e3-aeca-b0e4c0fc7b97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1392 microversion: 2.1 time: 0.160796 Feb 12 21:52:24.285570 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3266/6664] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:24 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:52:25.303004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:25.303712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:25.310092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:25.310560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:25.311351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:25.311799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:25.451468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:25.458905 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-691ba36f-bc7c-4b89-9832-3ae374b1924f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1564 microversion: 2.1 time: 0.161181 Feb 12 21:52:25.459505 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3399/6665] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:25 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:25.475500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:25.476114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:25.482668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:25.483121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:25.483907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:25.484346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:25.623469 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:25.631233 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92531909-bf40-497f-ab17-d751aa8a6a25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1564 microversion: 2.1 time: 0.159332 Feb 12 21:52:25.631808 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3267/6666] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:25 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:27.889916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:52:27.895205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d7f64ae6-9839-4660-b021-7f48ae9a9c36 req-ad76c562-2c89-4b9b-9b75-6aa3b769faea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71", "tag": "aec1fd3c-6800-4110-9094-7e5802ef873b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:52:27.896824 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:52:27.896824 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:52:27.901696 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:27.908387 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d7f64ae6-9839-4660-b021-7f48ae9a9c36 req-ad76c562-2c89-4b9b-9b75-6aa3b769faea service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:27.908681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:27.908980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d7f64ae6-9839-4660-b021-7f48ae9a9c36 req-ad76c562-2c89-4b9b-9b75-6aa3b769faea service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:27.909128 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:27.909953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:27.910410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:27.921439 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d7f64ae6-9839-4660-b021-7f48ae9a9c36 req-ad76c562-2c89-4b9b-9b75-6aa3b769faea service nova] Creating event network-changed:aec1fd3c-6800-4110-9094-7e5802ef873b for instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 on nch1-master-1 Feb 12 21:52:27.927240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d7f64ae6-9839-4660-b021-7f48ae9a9c36 req-ad76c562-2c89-4b9b-9b75-6aa3b769faea service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035434 Feb 12 21:52:27.928372 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3268/6667] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:52:28.086185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:52:28.096109 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d826ecaf-0ea0-40ad-af4f-2d8729f9c23c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1564 microversion: 2.1 time: 0.209252 Feb 12 21:52:28.096732 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3400/6668] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:52:27 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:52:51.395049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:52:51.396083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:52:51.403673 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:51.404128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:51.404911 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:52:51.405348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:52:51.454394 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-346b108f-04aa-46ee-ba6f-55dc39c84c78 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action" status: 200 len: 24569 microversion: 2.1 time: 0.063158 Feb 12 21:52:51.455007 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3269/6669] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:52:51 2022] POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action => generated 24569 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:53:02.407545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:02.408193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:02.414399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:02.414952 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:02.415754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:02.416207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:02.606243 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-59b927ab-0249-4539-824b-0a58c5665b9b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action" status: 202 len: 0 microversion: 2.1 time: 0.202380 Feb 12 21:53:02.606749 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3401/6670] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:53:02 2022] POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:53:02.615307 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:02.616020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:02.624609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:02.625050 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:02.625878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:02.626323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:02.767413 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:02.775956 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-54669d13-ac08-4f7e-bb90-faedcc2bd29f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1688 microversion: 2.1 time: 0.164569 Feb 12 21:53:02.777639 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3270/6671] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:02 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:03.796843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:03.798395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:03.804216 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:03.804726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:03.805633 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:03.806086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:03.948002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:03.955574 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3229ed3-000a-4093-8cb4-2b951838e499 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1668 microversion: 2.1 time: 0.164406 Feb 12 21:53:03.956142 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3402/6672] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:03 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:05.046051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:05.046941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:05.056146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:05.056619 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:05.057453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:05.057907 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:05.115772 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c5638f4-d984-4769-8357-2b4deb632c97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action" status: 200 len: 32640 microversion: 2.1 time: 0.073342 Feb 12 21:53:05.116487 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3271/6673] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:53:05 2022] POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action => generated 32640 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:53:05.127829 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:05.128410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:05.135387 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:05.135854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:05.136651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:05.137100 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:05.334444 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8fda7912-998a-4a73-a13e-8b0295d0a971 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action" status: 202 len: 0 microversion: 2.1 time: 0.210011 Feb 12 21:53:05.335244 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3403/6674] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:53:05 2022] POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 12 21:53:05.344079 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:05.344787 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:05.351567 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:05.352890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:05.353728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:05.354168 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:05.492930 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:05.500707 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6d70f882-68f6-4bdf-8729-7649911a64af tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1675 microversion: 2.1 time: 0.160513 Feb 12 21:53:05.501297 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3272/6675] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:05 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:06.519668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:06.520378 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:06.526993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:06.527476 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:06.528276 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:06.528730 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:06.664787 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:06.672281 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bb71c318-423c-414e-857f-4794ef4994fd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1683 microversion: 2.1 time: 0.157581 Feb 12 21:53:06.672858 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3404/6676] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:06 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:06.768915 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:06.770121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:06.778364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:06.778816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:06.779597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:06.780030 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:06.832509 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-69933b6a-eae7-46ef-8c34-f0ad330ca4b2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action" status: 200 len: 38021 microversion: 2.1 time: 0.067070 Feb 12 21:53:06.833172 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3273/6677] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:53:06 2022] POST /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71/action => generated 38021 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:53:07.886866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:07.887374 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:07.894750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4a120e2e-6d97-407e-8ccb-5c7c2d168447 req-16a0f4a0-dcb3-4055-9073-1378a432c6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71", "tag": "aec1fd3c-6800-4110-9094-7e5802ef873b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:07.896224 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:53:07.896224 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:53:07.906346 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4a120e2e-6d97-407e-8ccb-5c7c2d168447 req-16a0f4a0-dcb3-4055-9073-1378a432c6f7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:07.906853 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:07.907017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4a120e2e-6d97-407e-8ccb-5c7c2d168447 req-16a0f4a0-dcb3-4055-9073-1378a432c6f7 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:07.907335 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:07.908189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:07.908644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:07.920257 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4a120e2e-6d97-407e-8ccb-5c7c2d168447 req-16a0f4a0-dcb3-4055-9073-1378a432c6f7 service nova] Creating event network-changed:aec1fd3c-6800-4110-9094-7e5802ef873b for instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 on nch1-master-1 Feb 12 21:53:07.925674 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4a120e2e-6d97-407e-8ccb-5c7c2d168447 req-16a0f4a0-dcb3-4055-9073-1378a432c6f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034778 Feb 12 21:53:07.926620 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3274/6678] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:53:07.942205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:53:08.288172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-808b5c1b-477e-4a48-95d6-c8422b011f14 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 204 len: 0 microversion: 2.1 time: 0.406276 Feb 12 21:53:08.288912 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3405/6679] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:53:07 2022] DELETE /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:53:08.298848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:08.299957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:08.307338 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:08.312820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:08.312820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:08.312820 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:08.536513 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:08.547477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b867c39a-54b5-445a-aba3-2d7b99eefddb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1689 microversion: 2.1 time: 0.252181 Feb 12 21:53:08.547477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3275/6680] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:08 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:09.565048 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:09.565879 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:09.572881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:09.573371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:09.574200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:09.574656 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:09.714362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:09.721884 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-94d39cf6-8455-4a39-a5bb-5425486bf3f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1570 microversion: 2.1 time: 0.161130 Feb 12 21:53:09.722466 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3406/6681] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:09 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:10.579042 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ca01089c-6bd5-4271-bcf3-d7e82d017276 req-c84a8c08-ab1a-46c3-a169-ecf2a5e19fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71", "name": "network-vif-deleted", "tag": "aec1fd3c-6800-4110-9094-7e5802ef873b"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:10.580555 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:53:10.580555 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:53:10.588412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ca01089c-6bd5-4271-bcf3-d7e82d017276 req-c84a8c08-ab1a-46c3-a169-ecf2a5e19fce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:10.588856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ca01089c-6bd5-4271-bcf3-d7e82d017276 req-c84a8c08-ab1a-46c3-a169-ecf2a5e19fce service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:10.599804 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ca01089c-6bd5-4271-bcf3-d7e82d017276 req-c84a8c08-ab1a-46c3-a169-ecf2a5e19fce service nova] Creating event network-vif-deleted:aec1fd3c-6800-4110-9094-7e5802ef873b for instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 on nch1-master-1 Feb 12 21:53:10.604786 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ca01089c-6bd5-4271-bcf3-d7e82d017276 req-c84a8c08-ab1a-46c3-a169-ecf2a5e19fce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029461 Feb 12 21:53:10.605610 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3276/6682] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:53:10.739668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:10.740219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:10.748240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:10.748848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:10.749698 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:10.750147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:10.818480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:10.827140 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7101f58d-1994-4105-aeef-21d2e14c6515 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 200 len: 1352 microversion: 2.1 time: 0.091257 Feb 12 21:53:10.827721 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3407/6683] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:10 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:11.845885 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:11.846582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:11.853320 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:11.853807 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:11.854593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:11.855033 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:11.869408 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] HTTP exception thrown: Instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 could not be found. Feb 12 21:53:11.870013 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Returning 404 to user: Instance 2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:53:11.870845 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-65c7bd72-059e-4328-ba14-fae28e836ba9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71" status: 404 len: 111 microversion: 2.1 time: 0.030038 Feb 12 21:53:11.871392 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3277/6684] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:11 2022] GET /compute/v2.1/servers/2f9c0f44-dc9d-4d07-a9cf-2299b3b6bd71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:53:15.764653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1599ece4-4b58-4e14-a8fe-91fe3c12ef75 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '.version_select at 0x7fa8fead2e50>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:15.870464 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1599ece4-4b58-4e14-a8fe-91fe3c12ef75 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1669360881" status: 202 len: 0 microversion: 2.1 time: 0.109569 Feb 12 21:53:15.871062 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3408/6685] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 21:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1669360881 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:53:15.894303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7961f5e1-9fde-4237-84a4-07a01576dc6d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: .version_select at 0x7fa8fd080e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-222808451"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:15.910051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7961f5e1-9fde-4237-84a4-07a01576dc6d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:53:15.916501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7961f5e1-9fde-4237-84a4-07a01576dc6d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:53:16.318775 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7961f5e1-9fde-4237-84a4-07a01576dc6d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:53:16.324651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-7961f5e1-9fde-4237-84a4-07a01576dc6d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:53:16.343354 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7961f5e1-9fde-4237-84a4-07a01576dc6d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.452871 Feb 12 21:53:16.343986 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3278/6686] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:53:15 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:24.437982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-489253761", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "6419cbaf-9efd-484f-adfe-0c49ef1c04f0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-222808451", "security_groups": [{"name": "tempest-secgroup-smoke-879220085"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:24.549287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] validate_networks() for [('6419cbaf-9efd-484f-adfe-0c49ef1c04f0', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:53:24.954078 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:53:24.954516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:53:24.955043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:53:24.955498 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:53:24.955930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:53:24.965763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:24.966290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:24.967151 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:24.967683 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:24.987168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:53:24.992712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:53:25.005873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:53:25.008402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:53:25.135948 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05893562-266d-4562-ad28-006702d6f631 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702293 Feb 12 21:53:25.142179 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3409/6687] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:53:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 12 21:53:25.148617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-103101b2-2fa1-4170-b636-dc1821821d21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:25.148617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-103101b2-2fa1-4170-b636-dc1821821d21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:25.208783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-103101b2-2fa1-4170-b636-dc1821821d21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:25.217024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-103101b2-2fa1-4170-b636-dc1821821d21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1265 microversion: 2.1 time: 0.073424 Feb 12 21:53:25.226790 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3279/6688] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:25 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:26.235259 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:26.236749 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:26.243927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:26.245334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:26.245334 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:26.245681 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:26.309821 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:26.318195 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-259dddf0-2b11-4bc5-98f4-e397369be53e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1269 microversion: 2.1 time: 0.087804 Feb 12 21:53:26.318766 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3410/6689] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:26 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:27.335616 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:27.336224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:27.345154 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:27.345735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:27.346529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:27.346971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:27.446031 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:27.447665 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dfba4202-ee3a-424e-a8c2-97741fd9fe8c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1325 microversion: 2.1 time: 0.115701 Feb 12 21:53:27.448243 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3280/6690] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:27 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1325 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:28.464603 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:28.465320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:28.472684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:28.473225 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:28.474178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:28.475032 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:28.611375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:28.618859 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6aa29f38-8a31-4089-8d9d-90b4ef320b43 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.157983 Feb 12 21:53:28.619626 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3411/6691] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:28 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:28.981663 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6f5fc552-668b-44cf-9720-3fd5442e56d8 req-5d229609-89cc-480a-8301-859dcb4a449a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d6f95f-3c4c-44cd-bf80-00c013431ad3", "tag": "c26c779b-8c3f-4e5d-aa81-23acd0433ace"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:28.986746 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:53:28.986746 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:53:28.995691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6f5fc552-668b-44cf-9720-3fd5442e56d8 req-5d229609-89cc-480a-8301-859dcb4a449a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:28.996135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6f5fc552-668b-44cf-9720-3fd5442e56d8 req-5d229609-89cc-480a-8301-859dcb4a449a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:29.009243 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6f5fc552-668b-44cf-9720-3fd5442e56d8 req-5d229609-89cc-480a-8301-859dcb4a449a service nova] Creating event network-changed:c26c779b-8c3f-4e5d-aa81-23acd0433ace for instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 on nch1-master-1 Feb 12 21:53:29.015755 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6f5fc552-668b-44cf-9720-3fd5442e56d8 req-5d229609-89cc-480a-8301-859dcb4a449a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040798 Feb 12 21:53:29.017290 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3281/6692] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:53:29.636989 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:29.637631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:29.645333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:29.645842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:29.646662 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:29.647123 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:29.792858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:29.801761 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e47a05fb-2817-4f1c-8c67-bd0e87a9ab70 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.168498 Feb 12 21:53:29.802443 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3412/6693] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:29 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:30.820948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:30.821691 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:30.828083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:30.828537 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:30.829339 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:30.829802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:30.969589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:30.976921 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c7af7834-e043-4be3-96ca-e2ce0e5a703e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.160908 Feb 12 21:53:30.977518 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3282/6694] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:30 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:31.994620 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:31.995248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:32.002857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:32.003254 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:32.004057 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:32.004515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:32.141480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:32.150194 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-52ec1126-687d-4dc6-a5e8-eedc2c282cb3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.159241 Feb 12 21:53:32.150996 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3413/6695] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:31 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:33.168103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:33.168707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:33.175999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:33.176456 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:33.177236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:33.177709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:33.312781 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:33.320103 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a0543be2-c95a-48c3-b06a-053712ca1c25 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.155719 Feb 12 21:53:33.320685 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3283/6696] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:33 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:34.337017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:34.337609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:34.345304 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:34.346098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:34.346902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:34.347351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:34.486760 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:34.494085 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-058878b5-161d-4e25-adfa-ef13f23e6e65 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.160893 Feb 12 21:53:34.494651 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3414/6697] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:34 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:35.511809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:35.512425 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:35.520270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:35.520723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:35.521547 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:35.521988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:35.661739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:35.669191 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-440952b5-7bb3-4042-a51f-61de7adad914 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.161145 Feb 12 21:53:35.669880 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3284/6698] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:35 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:35.788885 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-f326d43d-15e4-4f4b-8c0a-82dde6bf0ad0 req-a3e36658-5a9e-4bfb-8f64-5f216bcd220a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d6f95f-3c4c-44cd-bf80-00c013431ad3", "name": "network-vif-plugged", "status": "completed", "tag": "c26c779b-8c3f-4e5d-aa81-23acd0433ace"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:35.790504 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:53:35.790504 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:53:35.799316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f326d43d-15e4-4f4b-8c0a-82dde6bf0ad0 req-a3e36658-5a9e-4bfb-8f64-5f216bcd220a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:35.799778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-f326d43d-15e4-4f4b-8c0a-82dde6bf0ad0 req-a3e36658-5a9e-4bfb-8f64-5f216bcd220a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:35.810679 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-f326d43d-15e4-4f4b-8c0a-82dde6bf0ad0 req-a3e36658-5a9e-4bfb-8f64-5f216bcd220a service nova] Creating event network-vif-plugged:c26c779b-8c3f-4e5d-aa81-23acd0433ace for instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 on nch1-master-1 Feb 12 21:53:35.815737 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-f326d43d-15e4-4f4b-8c0a-82dde6bf0ad0 req-a3e36658-5a9e-4bfb-8f64-5f216bcd220a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030524 Feb 12 21:53:35.816320 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3415/6699] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:53:36.685895 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:36.686765 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:36.696780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:36.696780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:36.696780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:36.696780 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:36.839152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:36.846768 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fd4129c4-4358-4928-a986-4c00cfce76c6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1390 microversion: 2.1 time: 0.164711 Feb 12 21:53:36.847340 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3285/6700] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:36 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:37.864694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:37.865330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:37.871715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:37.872189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:37.873099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:37.873729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:38.010272 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:38.018670 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e61415aa-3d19-4c4b-bbaf-e5497d76ce18 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1563 microversion: 2.1 time: 0.159002 Feb 12 21:53:38.019258 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3416/6701] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:37 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:53:38.035364 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:38.035983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:38.042772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:38.043235 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:38.044037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:38.044505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:38.180252 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:38.188235 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6a17e088-01df-46e4-9f6b-f0342f795c2a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1563 microversion: 2.1 time: 0.156486 Feb 12 21:53:38.188806 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3286/6702] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:38 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:53:40.442549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:53:40.443181 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:53:40.445268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b98c9900-9265-4fc9-92d7-938144004307 req-0c8002b3-5247-4168-a504-d13f9697bd63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d6f95f-3c4c-44cd-bf80-00c013431ad3", "tag": "c26c779b-8c3f-4e5d-aa81-23acd0433ace"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:53:40.447253 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:53:40.447253 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:53:40.450167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:40.450663 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:40.451466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:40.451918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:40.460555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b98c9900-9265-4fc9-92d7-938144004307 req-0c8002b3-5247-4168-a504-d13f9697bd63 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:53:40.461097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b98c9900-9265-4fc9-92d7-938144004307 req-0c8002b3-5247-4168-a504-d13f9697bd63 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:53:40.473513 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b98c9900-9265-4fc9-92d7-938144004307 req-0c8002b3-5247-4168-a504-d13f9697bd63 service nova] Creating event network-changed:c26c779b-8c3f-4e5d-aa81-23acd0433ace for instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 on nch1-master-1 Feb 12 21:53:40.479136 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b98c9900-9265-4fc9-92d7-938144004307 req-0c8002b3-5247-4168-a504-d13f9697bd63 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037650 Feb 12 21:53:40.480344 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3287/6703] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:53:40.608801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:53:40.617307 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2d1a904-0715-4352-b3bc-2fd19b586a5b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1563 microversion: 2.1 time: 0.178564 Feb 12 21:53:40.618112 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3417/6704] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:53:40 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:02.937029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:54:02.938134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:02.944719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:02.945178 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:02.946001 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:02.946447 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:03.000952 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c5faa01e-7650-46d8-bd2d-16b2546d5140 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3/action" status: 200 len: 24576 microversion: 2.1 time: 0.068942 Feb 12 21:54:03.001615 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3288/6705] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:54:02 2022] POST /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3/action => generated 24576 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:54:13.919702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:54:13.920670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:13.927449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:13.927924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:13.928725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:13.929186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:14.154172 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4f8967b1-4d24-4264-88c9-94fb51502238 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3/action" status: 202 len: 0 microversion: 2.1 time: 0.238081 Feb 12 21:54:14.154828 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3418/6706] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:54:13 2022] POST /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:54:14.164572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:14.165490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:14.172835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:14.174199 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:14.175044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:14.175493 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:14.351735 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:14.359469 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a150e95a-7147-4c6c-ba52-6609afdd25fa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1674 microversion: 2.1 time: 0.199418 Feb 12 21:54:14.359936 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3289/6707] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:14 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:15.379905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:15.380621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:15.387141 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:15.387606 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:15.388407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:15.388854 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:15.526950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:15.534468 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2cf67eaa-84a1-41e6-8235-e706804601ae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.160611 Feb 12 21:54:15.535046 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3419/6708] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:15 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:16.551932 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:16.552543 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:16.559682 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:16.560138 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:16.560924 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:16.561388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:16.706091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:16.713498 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e3098c62-6ed2-4a0a-8165-7650f543e815 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.165580 Feb 12 21:54:16.714067 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3290/6709] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:16 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:17.732017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:17.732665 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:17.739729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:17.745075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:17.745075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:17.745075 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:17.880788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:17.888270 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77da17c2-00ec-4da5-af56-f08e4f6e8fd8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.160439 Feb 12 21:54:17.888840 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3420/6710] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:17 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:18.905529 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:18.906144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:18.913936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:18.914393 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:18.915186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:18.915654 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:19.050559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:19.057971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7914de69-73bb-4e15-bd50-600f117a21ba tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.156204 Feb 12 21:54:19.058537 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3291/6711] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:18 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:20.075657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:20.076211 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:20.083375 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:20.083851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:20.084657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:20.085116 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:20.224786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:20.232218 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d0c8bd83-3b66-4484-b1a7-5302e9dfcba2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.160438 Feb 12 21:54:20.232785 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3421/6712] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:20 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:21.249520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:21.250136 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:21.257444 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:21.257958 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:21.258762 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:21.259213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:21.398268 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:21.405814 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6afd8e00-4efa-4f34-8dd9-6ebd3515935e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.160012 Feb 12 21:54:21.406393 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3292/6713] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:21 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:22.423563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:22.424410 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:22.430855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:22.431318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:22.432106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:22.432555 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:22.566629 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:22.574088 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ee7712f7-49e9-4429-b209-d93cfd25deef tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.154761 Feb 12 21:54:22.574693 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3422/6714] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:22 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:23.591985 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:23.592611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:23.600190 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:23.604630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:23.604630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:23.604630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:23.738011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:23.745426 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d106867-a620-4731-9e47-115b14eeed05 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.157138 Feb 12 21:54:23.746000 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3293/6715] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:23 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:24.762947 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:24.767097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:24.770301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:24.770773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:24.771575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:24.772034 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:24.911454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:24.918922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5cdb692e-312a-48c6-90d8-33d2bf3fdbfd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1679 microversion: 2.1 time: 0.159788 Feb 12 21:54:24.919490 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3423/6716] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:24 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:25.936688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:25.937291 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:25.944336 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:25.944790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:25.945609 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:25.946053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:26.082398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:54:26.089766 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bf01dfe7-4bc2-44a7-b36e-ba6caa1557b6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1682 microversion: 2.1 time: 0.156777 Feb 12 21:54:26.090339 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3294/6717] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:25 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:54:52.282971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:54:52.283904 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:52.290935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:52.291403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:52.292203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:52.292661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:52.350923 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cebf79cf-8847-4459-9ef7-f4fd4c195689 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3/action" status: 200 len: 69075 microversion: 2.1 time: 0.071543 Feb 12 21:54:52.351601 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3424/6718] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:54:52 2022] POST /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3/action => generated 69075 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:54:59.481283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:59.481899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:59.488973 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:59.489658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:59.490790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:59.491261 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:59.517046 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:54:59.563761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-03ccd47c-1911-494c-a0df-9d5c1b45163e req-00e78c42-a17d-44d2-8f21-ac6c0938deec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d6f95f-3c4c-44cd-bf80-00c013431ad3", "tag": "c26c779b-8c3f-4e5d-aa81-23acd0433ace"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:54:59.565424 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:54:59.565424 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:54:59.576816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-03ccd47c-1911-494c-a0df-9d5c1b45163e req-00e78c42-a17d-44d2-8f21-ac6c0938deec service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:59.576816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-03ccd47c-1911-494c-a0df-9d5c1b45163e req-00e78c42-a17d-44d2-8f21-ac6c0938deec service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:59.586260 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-03ccd47c-1911-494c-a0df-9d5c1b45163e req-00e78c42-a17d-44d2-8f21-ac6c0938deec service nova] Creating event network-changed:c26c779b-8c3f-4e5d-aa81-23acd0433ace for instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 on nch1-master-1 Feb 12 21:54:59.591365 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-03ccd47c-1911-494c-a0df-9d5c1b45163e req-00e78c42-a17d-44d2-8f21-ac6c0938deec service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110879 Feb 12 21:54:59.592345 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3425/6719] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:54:59.838896 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d9949bf9-b0ad-4525-8466-4db360b6ac59 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 204 len: 0 microversion: 2.1 time: 0.361992 Feb 12 21:54:59.839720 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3295/6720] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:54:59 2022] DELETE /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:54:59.856704 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:54:59.857461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:54:59.864892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:59.865980 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:54:59.866949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:54:59.867686 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:00.027405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:00.035910 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c144ca57-2e3a-4788-81da-d0466b8fbca0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1688 microversion: 2.1 time: 0.185210 Feb 12 21:55:00.037313 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3426/6721] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:54:59 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:01.055858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:01.056564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:01.063289 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:01.063746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:01.064536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:01.064974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:01.202544 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:01.210008 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-712b93c6-581f-45a8-9e8b-26e943896992 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1569 microversion: 2.1 time: 0.158955 Feb 12 21:55:01.210577 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3296/6722] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:01 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:02.009892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-53aa677c-38d0-4f9d-9530-cb3d045cf61c req-d96a335c-40ed-4ade-84ac-5b41464d34f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d6f95f-3c4c-44cd-bf80-00c013431ad3", "name": "network-vif-deleted", "tag": "c26c779b-8c3f-4e5d-aa81-23acd0433ace"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:02.011437 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:55:02.011437 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:55:02.019499 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-53aa677c-38d0-4f9d-9530-cb3d045cf61c req-d96a335c-40ed-4ade-84ac-5b41464d34f5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:02.023870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-53aa677c-38d0-4f9d-9530-cb3d045cf61c req-d96a335c-40ed-4ade-84ac-5b41464d34f5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:02.036112 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-53aa677c-38d0-4f9d-9530-cb3d045cf61c req-d96a335c-40ed-4ade-84ac-5b41464d34f5 service nova] Creating event network-vif-deleted:c26c779b-8c3f-4e5d-aa81-23acd0433ace for instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 on nch1-master-1 Feb 12 21:55:02.041601 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-53aa677c-38d0-4f9d-9530-cb3d045cf61c req-d96a335c-40ed-4ade-84ac-5b41464d34f5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036189 Feb 12 21:55:02.042397 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3427/6723] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:55:02.227308 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:02.227846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:02.234845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:02.235335 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:02.239725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:02.239725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:02.310064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:02.319144 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c318c849-d171-461e-a7a3-70b8f32a89d8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 200 len: 1350 microversion: 2.1 time: 0.095491 Feb 12 21:55:02.319764 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3297/6724] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:02 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:03.336818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:03.337580 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 36d6f95f-3c4c-44cd-bf80-00c013431ad3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:03.344622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:03.345092 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:03.345921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:03.346480 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:03.361571 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] HTTP exception thrown: Instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 could not be found. Feb 12 21:55:03.362187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Returning 404 to user: Instance 36d6f95f-3c4c-44cd-bf80-00c013431ad3 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:55:03.363044 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-016329fa-dca4-4a7f-aa08-0faad40cfc0c tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3" status: 404 len: 111 microversion: 2.1 time: 0.030689 Feb 12 21:55:03.363603 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3428/6725] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:03 2022] GET /compute/v2.1/servers/36d6f95f-3c4c-44cd-bf80-00c013431ad3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:55:06.968408 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bad7b0e9-7f6d-4386-b0b0-aafa96ed2bb1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '.version_select at 0x7fa8fe548f70>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:07.049444 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bad7b0e9-7f6d-4386-b0b0-aafa96ed2bb1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-222808451" status: 202 len: 0 microversion: 2.1 time: 0.084640 Feb 12 21:55:07.050307 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3298/6726] 10.222.0.31 () {58 vars in 1280 bytes} [Sat Feb 12 21:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-222808451 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:55:07.080777 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16d51171-dd5a-4351-8944-3cea1ea26a99 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: .version_select at 0x7fa8fe9e9ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-162633616"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:07.094923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-16d51171-dd5a-4351-8944-3cea1ea26a99 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:55:07.100902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-16d51171-dd5a-4351-8944-3cea1ea26a99 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:55:07.394002 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-16d51171-dd5a-4351-8944-3cea1ea26a99 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:55:07.398962 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-16d51171-dd5a-4351-8944-3cea1ea26a99 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:55:07.413430 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16d51171-dd5a-4351-8944-3cea1ea26a99 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.339338 Feb 12 21:55:07.414039 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3429/6727] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:55:07 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:11.903009 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 21:55:11.903493 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 21:55:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 21:55:15.693842 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-28384217", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "c2b938a5-2a00-4713-9be7-cd38730f698d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-162633616", "security_groups": [{"name": "tempest-secgroup-smoke-165480791"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:15.813161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] validate_networks() for [('c2b938a5-2a00-4713-9be7-cd38730f698d', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:55:16.329585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:55:16.330102 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:55:16.330582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:55:16.331226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:55:16.331848 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:55:16.348536 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:16.348986 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:16.350122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:16.350488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:16.369392 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:55:16.374642 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:55:16.387766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:55:16.390313 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:55:16.493119 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6f87725a-3a7c-4ce5-881f-e8c0438f64c8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.803420 Feb 12 21:55:16.493971 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3299/6728] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:55:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:55:16.504834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0067bfba-1a6d-4bdb-9f25-7e53b3feff21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:16.510087 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0067bfba-1a6d-4bdb-9f25-7e53b3feff21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:16.561590 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0067bfba-1a6d-4bdb-9f25-7e53b3feff21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:16.568619 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0067bfba-1a6d-4bdb-9f25-7e53b3feff21 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1264 microversion: 2.1 time: 0.068320 Feb 12 21:55:16.569192 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3430/6729] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:16 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1264 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:17.592325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-93110a2b-afea-4220-a2fe-36562f7af84d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:17.593617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-93110a2b-afea-4220-a2fe-36562f7af84d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:17.666460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-93110a2b-afea-4220-a2fe-36562f7af84d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:17.676021 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-93110a2b-afea-4220-a2fe-36562f7af84d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1264 microversion: 2.1 time: 0.092818 Feb 12 21:55:17.676672 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3300/6730] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:17 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:18.693982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c65b492c-9c2b-4f77-b0cb-38dda73a3000 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:18.694607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c65b492c-9c2b-4f77-b0cb-38dda73a3000 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:18.753465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c65b492c-9c2b-4f77-b0cb-38dda73a3000 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:18.760925 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c65b492c-9c2b-4f77-b0cb-38dda73a3000 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1264 microversion: 2.1 time: 0.070518 Feb 12 21:55:18.761844 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3431/6731] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:18 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1264 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:19.777299 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-babda0de-abb9-46b5-966d-da226e4dbda5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:19.778010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-babda0de-abb9-46b5-966d-da226e4dbda5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:19.831746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-babda0de-abb9-46b5-966d-da226e4dbda5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:19.838466 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-babda0de-abb9-46b5-966d-da226e4dbda5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1264 microversion: 2.1 time: 0.064990 Feb 12 21:55:19.839037 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3301/6732] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:19 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1264 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:55:20.855434 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:20.856055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:20.863033 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:20.869557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:20.869557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:20.869557 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:20.926277 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:20.934703 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f32493bb-31a1-470a-bb1f-2456d10a10df tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1268 microversion: 2.1 time: 0.083006 Feb 12 21:55:20.935274 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3432/6733] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:20 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1268 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:21.952135 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:21.952776 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:21.961129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:21.961612 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:21.962407 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:21.962978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:22.029037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:22.036448 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-fffdc10e-ca8b-4176-b1b1-dc05e1d960e8 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1316 microversion: 2.1 time: 0.088200 Feb 12 21:55:22.037246 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3302/6734] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:21 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:23.055157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:23.056357 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:23.063634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:23.064102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:23.064907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:23.065379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:23.128859 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:23.137054 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8de3589b-4715-4206-bc04-8b7e039c358a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1322 microversion: 2.1 time: 0.086148 Feb 12 21:55:23.137664 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3433/6735] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:23 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:24.154792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:24.157069 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:24.162545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:24.163011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:24.163805 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:24.164247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:24.290449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-c560109d-5bd3-4039-8f54-7531fa26f26d req-dc4790eb-c17a-4c7e-a121-de4dd4836b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:24.292233 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:55:24.292233 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:55:24.300139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c560109d-5bd3-4039-8f54-7531fa26f26d req-dc4790eb-c17a-4c7e-a121-de4dd4836b89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:24.300607 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-c560109d-5bd3-4039-8f54-7531fa26f26d req-dc4790eb-c17a-4c7e-a121-de4dd4836b89 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:24.314286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-c560109d-5bd3-4039-8f54-7531fa26f26d req-dc4790eb-c17a-4c7e-a121-de4dd4836b89 service nova] Creating event network-changed:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch1-master-1 Feb 12 21:55:24.320943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-c560109d-5bd3-4039-8f54-7531fa26f26d req-dc4790eb-c17a-4c7e-a121-de4dd4836b89 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Feb 12 21:55:24.321850 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3434/6736] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:55:24.409864 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:24.419779 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f589bffa-8dad-4c3f-b4a5-bdf67c3b0356 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.268652 Feb 12 21:55:24.420528 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3303/6737] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:24 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:25.438398 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:25.439142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:25.445482 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:25.445953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:25.446752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:25.447207 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:25.584937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:25.592495 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-38220157-a1ee-4b8b-a0eb-6199b3346033 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.158979 Feb 12 21:55:25.593069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3435/6738] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:25 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:26.609495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:26.610090 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:26.616884 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:26.617345 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:26.618150 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:26.618590 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:26.763500 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:26.771499 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b477f7a5-ef77-4a50-8d0b-e8f4f56eb53a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.165243 Feb 12 21:55:26.772222 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3304/6739] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:26 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:27.788617 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:27.789265 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:27.796162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:27.796625 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:27.797481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:27.797939 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:27.935312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:27.942802 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-27ec9938-253d-402d-904f-79df01d26d55 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.158043 Feb 12 21:55:27.943396 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3436/6740] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:27 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:28.960377 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:28.960990 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:28.967826 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:28.968311 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:28.969103 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:28.969644 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:29.105334 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:29.112647 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c9f8d08a-8e6c-4a9c-96d6-2d049c2153f6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.156837 Feb 12 21:55:29.113217 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3305/6741] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:28 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:30.129818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:30.131200 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:30.138251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:30.138717 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:30.139531 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:30.139983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:30.192382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-7ac2222d-2496-4963-b70f-88d146a341a5 req-ecdff200-c771-4b6d-ada4-c8acbbaa1706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "name": "network-vif-plugged", "status": "completed", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:30.194304 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:55:30.194304 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:55:30.202834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ac2222d-2496-4963-b70f-88d146a341a5 req-ecdff200-c771-4b6d-ada4-c8acbbaa1706 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:30.203280 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-7ac2222d-2496-4963-b70f-88d146a341a5 req-ecdff200-c771-4b6d-ada4-c8acbbaa1706 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:30.214500 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-7ac2222d-2496-4963-b70f-88d146a341a5 req-ecdff200-c771-4b6d-ada4-c8acbbaa1706 service nova] Creating event network-vif-plugged:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch1-master-1 Feb 12 21:55:30.219761 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-7ac2222d-2496-4963-b70f-88d146a341a5 req-ecdff200-c771-4b6d-ada4-c8acbbaa1706 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031216 Feb 12 21:55:30.220546 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3306/6742] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:55:30.288046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:30.305181 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b45d8a63-39ac-460b-b165-fb66e6586cc4 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.179120 Feb 12 21:55:30.305804 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3437/6743] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:30 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:31.324072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:31.324688 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:31.331044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:31.331499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:31.332285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:31.332725 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:31.471946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:31.479564 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-eb8121b8-546b-4736-902f-ef359faf6814 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1389 microversion: 2.1 time: 0.160596 Feb 12 21:55:31.480137 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3307/6744] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:31 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:32.495987 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:32.496559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:32.503468 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:32.503979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:32.504788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:32.505940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:32.642149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:32.650469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5ae53261-c137-498f-84c3-fb41af866793 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1560 microversion: 2.1 time: 0.158339 Feb 12 21:55:32.651044 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3438/6745] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:32 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:32.666998 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:32.667651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:32.674595 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:32.676592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:32.676592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:32.676592 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:32.811834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:32.819602 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-753a8945-57c2-4724-ae53-f7e79937cedc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1560 microversion: 2.1 time: 0.156230 Feb 12 21:55:32.820181 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3308/6746] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:32 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:34.768871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:55:34.768871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:34.773321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-af083dcc-f023-421c-a0f8-37b2f350ad21 req-591ca4ca-0208-483c-bb54-d23378ce129a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:34.774927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:34.775065 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:55:34.775065 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:55:34.775570 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:34.776395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:34.776841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:34.784343 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-af083dcc-f023-421c-a0f8-37b2f350ad21 req-591ca4ca-0208-483c-bb54-d23378ce129a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:34.784784 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-af083dcc-f023-421c-a0f8-37b2f350ad21 req-591ca4ca-0208-483c-bb54-d23378ce129a service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:34.797925 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-af083dcc-f023-421c-a0f8-37b2f350ad21 req-591ca4ca-0208-483c-bb54-d23378ce129a service nova] Creating event network-changed:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch1-master-1 Feb 12 21:55:34.804833 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-af083dcc-f023-421c-a0f8-37b2f350ad21 req-591ca4ca-0208-483c-bb54-d23378ce129a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036994 Feb 12 21:55:34.805457 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3309/6747] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:55:34.934426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:55:34.942035 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6085f07e-f847-4671-9a54-ed3b0b8a73ed tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1560 microversion: 2.1 time: 0.180179 Feb 12 21:55:34.943522 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3439/6748] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:55:34 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:55:58.184869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:55:58.185896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:55:58.192353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:58.192800 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:58.193618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:55:58.194055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:55:58.244752 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-82a04e09-2030-42fe-847f-c5366e15b430 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action" status: 200 len: 24571 microversion: 2.1 time: 0.063911 Feb 12 21:55:58.245379 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3310/6749] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:55:58 2022] POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:56:09.231422 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:56:09.232396 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:09.238467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:09.238931 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:09.239754 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:09.240201 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:09.326921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:09.333417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Old instance type m1.heat2, new instance type m1.heat {{(pid=141727) resize /opt/stack/nova/nova/compute/api.py:4117}} Feb 12 21:56:09.339759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:56:09.340187 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:56:09.340672 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:56:09.341089 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:56:09.341538 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:56:09.558872 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b03275c-e6e4-4866-bd85-4dc84fa7dd5e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action" status: 202 len: 0 microversion: 2.1 time: 0.332019 Feb 12 21:56:09.559403 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3440/6750] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:56:09 2022] POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:56:09.568037 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:09.568750 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:09.576004 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:09.576450 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:09.577292 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:09.577751 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:09.720571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:09.729110 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f8d036f3-ca4f-4678-8677-9477737c7f74 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1688 microversion: 2.1 time: 0.165121 Feb 12 21:56:09.729730 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3311/6751] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:09 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:10.749905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:10.749905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:10.757045 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:10.757746 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:10.758558 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:10.759009 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:10.903764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:10.911414 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a321ecfb-e9b7-49a1-bf21-5cbb776aacb2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1688 microversion: 2.1 time: 0.168280 Feb 12 21:56:10.913656 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3441/6752] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:10 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:11.928991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:11.930174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:11.939754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:11.940213 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:11.941021 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:11.941499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:12.151411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:12.159392 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-cf73e9ba-3876-4338-800b-22696fcbc6da tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1688 microversion: 2.1 time: 0.234317 Feb 12 21:56:12.160031 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3312/6753] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:11 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1688 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:13.177867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:13.178489 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:13.186039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:13.186503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:13.187293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:13.187741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:13.631611 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:13.639692 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e7266b00-1625-43d4-ab01-2f3524da96d3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.465765 Feb 12 21:56:13.640252 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3442/6754] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:13 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:14.657133 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:14.657770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:14.664656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:14.665115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:14.665942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:14.666385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:14.805916 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:14.813288 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ea7c074d-50d4-484c-932c-3e33b3730fa2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.159918 Feb 12 21:56:14.813903 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3313/6755] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:14 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:15.831253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:15.831882 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:15.839973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:15.840444 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:15.841245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:15.841721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:15.977453 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:15.985060 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-77c6f9bd-5f50-4790-a7c3-944f5794681a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.157636 Feb 12 21:56:15.985678 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3443/6756] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:15 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:17.002420 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:17.002942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:17.011203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:17.011656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:17.012440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:17.012882 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:17.154723 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:17.162071 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e9368929-ee96-43bf-b8b5-6da0a4bc713d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.163616 Feb 12 21:56:17.162641 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3314/6757] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:16 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:18.180081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:18.180791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:18.187658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:18.188135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:18.189748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:18.190213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:18.333667 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:18.341335 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5c33cf51-eca0-4858-a30d-fac767a9db92 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.165937 Feb 12 21:56:18.341934 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3444/6758] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:18 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:19.359269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:19.359962 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:19.366714 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:19.367662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:19.368448 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:19.368891 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:19.508743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:19.516168 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a1657ec2-147c-47a0-94ad-8f0b3b6c3fb9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.160653 Feb 12 21:56:19.516746 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3315/6759] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:19 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:20.533888 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:20.534535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:20.541428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:20.541898 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:20.542688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:20.543142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:20.679858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:20.689870 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2d444557-ceb2-4e73-a557-b027d2e703d1 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.159757 Feb 12 21:56:20.690464 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3445/6760] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:20 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:21.707941 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:21.708604 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:21.715940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:21.718584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:21.718584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:21.718584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:21.857495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:21.864871 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aebfa4a8-14a4-4ed5-9f49-0d6045e61f8f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.160638 Feb 12 21:56:21.865462 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3316/6761] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:21 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:22.882133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:22.883409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:22.890058 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:22.890514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:22.891330 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:22.891764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:23.030473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:23.037890 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-04d53c6a-9419-4e92-a1c3-962f3c80c804 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.159449 Feb 12 21:56:23.038468 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3446/6762] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:22 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:24.056428 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:24.056991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:24.063912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:24.064362 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:24.065148 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:24.065622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:24.204792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:24.212329 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-27c0fded-a827-4cab-8d18-6b727c64efd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.160395 Feb 12 21:56:24.212905 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3317/6763] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:24 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:25.229827 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:25.230440 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:25.237026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:25.237534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:25.238328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:25.238784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:25.372811 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:25.381042 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ceac51c8-61ba-4822-abc7-3ad9c75e6b27 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.155263 Feb 12 21:56:25.382101 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3447/6764] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:25 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:26.399390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:26.399996 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:26.406894 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:26.407379 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:26.408177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:26.408618 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:26.547630 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:26.555320 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-edf13731-22e8-4e92-b2a4-98db8c335540 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.160322 Feb 12 21:56:26.555896 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3318/6765] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:26 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:27.572702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:27.573318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:27.580315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:27.580714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:27.581547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:27.582026 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:27.719436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:27.727645 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-916c6b2a-4a2f-4af8-84e8-9b6a1903b3ad tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.158941 Feb 12 21:56:27.728189 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3448/6766] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:27 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:28.746254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:28.746878 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:28.753823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:28.754282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:28.755084 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:28.755559 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:28.898411 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:28.905862 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-85302a25-216d-4636-a152-604b5df67c01 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.164585 Feb 12 21:56:28.906443 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3319/6767] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:28 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:29.923858 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:29.924439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:29.932186 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:29.932666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:29.933503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:29.933963 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:30.080303 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:30.089473 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-678d870b-5d6e-4f1a-9fc4-320b4c6bda89 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1693 microversion: 2.1 time: 0.169401 Feb 12 21:56:30.090109 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3449/6768] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:29 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:30.832128 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-85fa4ac8-e721-4fd8-b395-23d71e1eda0a req-95aceaff-e545-4085-b3ab-9b4368214202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "name": "network-vif-unplugged", "status": "completed", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:56:30.834328 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:56:30.834328 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:56:30.844380 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-85fa4ac8-e721-4fd8-b395-23d71e1eda0a req-95aceaff-e545-4085-b3ab-9b4368214202 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:30.844834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-85fa4ac8-e721-4fd8-b395-23d71e1eda0a req-95aceaff-e545-4085-b3ab-9b4368214202 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:30.857066 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-85fa4ac8-e721-4fd8-b395-23d71e1eda0a req-95aceaff-e545-4085-b3ab-9b4368214202 service nova] Creating event network-vif-unplugged:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch2-master-1 Feb 12 21:56:30.862348 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [req-85fa4ac8-e721-4fd8-b395-23d71e1eda0a req-95aceaff-e545-4085-b3ab-9b4368214202 service nova] Instance 5cccfe9f-b440-43e3-83a0-8877b9756506 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141726) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:56:30.873489 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-85fa4ac8-e721-4fd8-b395-23d71e1eda0a req-95aceaff-e545-4085-b3ab-9b4368214202 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045026 Feb 12 21:56:30.877138 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3320/6769] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:56:31.107491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:31.108439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:31.115255 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:31.115734 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:31.116594 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:31.117054 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:31.261773 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:31.269492 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d0297519-a0f6-476c-a6cb-007593bb8607 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1692 microversion: 2.1 time: 0.166310 Feb 12 21:56:31.270039 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3450/6770] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:31 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:32.288075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:32.288790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:32.295475 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:32.295929 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:32.296758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:32.297202 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:32.446893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:32.454898 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-46c56bf0-e646-43ba-ac99-4ec2c7c6867e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1690 microversion: 2.1 time: 0.171937 Feb 12 21:56:32.455476 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3321/6771] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:32 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:32.887836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-ac6b36a0-883d-4306-88e2-7cd4532d1c7a req-5a7818d9-7ae1-4890-9c77-04c0a0525eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:56:32.889416 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:56:32.889416 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:56:32.897376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac6b36a0-883d-4306-88e2-7cd4532d1c7a req-5a7818d9-7ae1-4890-9c77-04c0a0525eb5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:32.897840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-ac6b36a0-883d-4306-88e2-7cd4532d1c7a req-5a7818d9-7ae1-4890-9c77-04c0a0525eb5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:32.910391 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-ac6b36a0-883d-4306-88e2-7cd4532d1c7a req-5a7818d9-7ae1-4890-9c77-04c0a0525eb5 service nova] Creating event network-changed:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch2-master-1 Feb 12 21:56:32.916682 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-ac6b36a0-883d-4306-88e2-7cd4532d1c7a req-5a7818d9-7ae1-4890-9c77-04c0a0525eb5 service nova] Instance 5cccfe9f-b440-43e3-83a0-8877b9756506 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:56:32.927951 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-ac6b36a0-883d-4306-88e2-7cd4532d1c7a req-5a7818d9-7ae1-4890-9c77-04c0a0525eb5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043868 Feb 12 21:56:32.928550 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3451/6772] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:56:33.473055 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:33.473706 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:33.480717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:33.481182 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:33.482018 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:33.482462 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:33.865606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:33.874912 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-efdd5469-a3bd-46b2-9953-4c2dcf206450 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1690 microversion: 2.1 time: 0.405544 Feb 12 21:56:33.876195 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3322/6773] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:33 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1690 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:34.894346 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:34.895063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:34.902157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:34.907179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:34.907179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:34.907179 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.045046 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:35.052799 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cd803b89-002e-423d-9d97-9e4d1f2401f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1687 microversion: 2.1 time: 0.163409 Feb 12 21:56:35.053465 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3452/6774] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:34 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:35.069045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:56:35.069617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:35.076455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:35.076909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.077760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:35.078203 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.257086 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13c586c9-e184-4071-80d7-47c7e136db6a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action" status: 204 len: 0 microversion: 2.1 time: 0.191519 Feb 12 21:56:35.257757 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3323/6775] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:56:35 2022] POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:56:35.266842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:35.267642 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:35.273869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:35.274336 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.275781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:35.276234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.419147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:35.426927 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-275aabc3-e690-4c1f-8b0c-b826065dde98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1687 microversion: 2.1 time: 0.164379 Feb 12 21:56:35.427513 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3453/6776] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:35 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:56:35.443477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:35.444266 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:35.451181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:35.451641 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.452758 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:35.452871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:35.628535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:35.636784 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0d663d78-61a5-460c-a7b7-6ce9eec76783 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1687 microversion: 2.1 time: 0.197281 Feb 12 21:56:35.637490 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3324/6777] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:35 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:36.017146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-9d680e99-2d19-4dd0-b4a8-3b74c67ff297 req-10c0d31f-1911-4e8e-8cd7-0707835e4bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "name": "network-vif-plugged", "status": "completed", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:56:36.019391 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:56:36.019391 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:56:36.028221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9d680e99-2d19-4dd0-b4a8-3b74c67ff297 req-10c0d31f-1911-4e8e-8cd7-0707835e4bd5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:36.028688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-9d680e99-2d19-4dd0-b4a8-3b74c67ff297 req-10c0d31f-1911-4e8e-8cd7-0707835e4bd5 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:36.041151 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-9d680e99-2d19-4dd0-b4a8-3b74c67ff297 req-10c0d31f-1911-4e8e-8cd7-0707835e4bd5 service nova] Creating event network-vif-plugged:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch2-master-1 Feb 12 21:56:36.046862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [req-9d680e99-2d19-4dd0-b4a8-3b74c67ff297 req-10c0d31f-1911-4e8e-8cd7-0707835e4bd5 service nova] Instance 5cccfe9f-b440-43e3-83a0-8877b9756506 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=141727) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5737}} Feb 12 21:56:36.058410 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-9d680e99-2d19-4dd0-b4a8-3b74c67ff297 req-10c0d31f-1911-4e8e-8cd7-0707835e4bd5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045883 Feb 12 21:56:36.059131 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3454/6778] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:56:36.654873 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:36.655566 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:36.662394 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:36.662849 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:36.663638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:36.664082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:36.806832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:36.814349 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd5a642f-fa6d-4d2b-acd1-c2af82d748d2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1687 microversion: 2.1 time: 0.163224 Feb 12 21:56:36.814920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3325/6779] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:36 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:37.832654 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:56:37.833439 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:37.839991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:37.840467 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:37.841275 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:37.841763 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:37.977073 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:56:37.985302 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5276d30-9bc8-4925-abe3-1855a565598a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1679 microversion: 2.1 time: 0.157547 Feb 12 21:56:37.985910 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3455/6780] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:56:37 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:56:58.156656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:56:58.157597 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:56:58.163610 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:58.164059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:58.164832 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:56:58.165285 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:56:58.217800 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-bc8fad8d-f1fa-44b4-8a8d-3c61281ab186 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action" status: 200 len: 24572 microversion: 2.1 time: 0.064961 Feb 12 21:56:58.218435 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3326/6781] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:56:58 2022] POST /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506/action => generated 24572 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:57:05.882902 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:05.883843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:05.886743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2ef0e1b7-61c9-4c37-9ea2-cf5421b9cedf req-406e24df-852f-4ecc-b62a-ac20c4a71f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:05.888571 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:57:05.888571 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:57:05.891219 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:05.891788 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:05.892664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:05.893202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:05.898116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2ef0e1b7-61c9-4c37-9ea2-cf5421b9cedf req-406e24df-852f-4ecc-b62a-ac20c4a71f73 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:05.898575 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2ef0e1b7-61c9-4c37-9ea2-cf5421b9cedf req-406e24df-852f-4ecc-b62a-ac20c4a71f73 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:05.910780 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2ef0e1b7-61c9-4c37-9ea2-cf5421b9cedf req-406e24df-852f-4ecc-b62a-ac20c4a71f73 service nova] Creating event network-changed:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch2-master-1 Feb 12 21:57:05.916208 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2ef0e1b7-61c9-4c37-9ea2-cf5421b9cedf req-406e24df-852f-4ecc-b62a-ac20c4a71f73 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034674 Feb 12 21:57:05.917828 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3327/6782] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:57:05.921738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:57:06.206518 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bed13f34-4c58-4352-a993-4471ebd51d30 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 204 len: 0 microversion: 2.1 time: 0.327277 Feb 12 21:57:06.209558 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3456/6783] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:57:05 2022] DELETE /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:57:06.216792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:06.217942 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:06.225005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:06.225719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:06.226639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:06.227283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:06.508025 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:06.518084 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-09e337ff-1bdd-4e59-8b4e-67adcbb43eeb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1685 microversion: 2.1 time: 0.305866 Feb 12 21:57:06.519602 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3328/6784] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:06 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1685 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:07.539418 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:07.540162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:07.547799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:07.548273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:07.549076 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:07.549564 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:07.740995 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:07.750021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-01398af6-d19e-4d26-88e6-a1abd97b3002 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 200 len: 1566 microversion: 2.1 time: 0.214691 Feb 12 21:57:07.750608 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3457/6785] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:07 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:08.007295 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-d2a53379-c892-48dd-a92e-29bc777e2120 req-67b58507-0109-48ad-b98f-8865726246fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cccfe9f-b440-43e3-83a0-8877b9756506", "name": "network-vif-deleted", "tag": "005b3d19-baae-4d3d-a9e8-39e2bc1293d1"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:08.008813 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:57:08.008813 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:57:08.017271 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d2a53379-c892-48dd-a92e-29bc777e2120 req-67b58507-0109-48ad-b98f-8865726246fa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:08.019859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-d2a53379-c892-48dd-a92e-29bc777e2120 req-67b58507-0109-48ad-b98f-8865726246fa service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:08.028409 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-d2a53379-c892-48dd-a92e-29bc777e2120 req-67b58507-0109-48ad-b98f-8865726246fa service nova] Creating event network-vif-deleted:005b3d19-baae-4d3d-a9e8-39e2bc1293d1 for instance 5cccfe9f-b440-43e3-83a0-8877b9756506 on nch2-master-1 Feb 12 21:57:08.033231 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-d2a53379-c892-48dd-a92e-29bc777e2120 req-67b58507-0109-48ad-b98f-8865726246fa service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029552 Feb 12 21:57:08.033852 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3329/6786] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:57:08.766824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:08.767460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 5cccfe9f-b440-43e3-83a0-8877b9756506] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:08.774653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:08.775149 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:08.775950 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:08.776397 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:08.789896 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.wsgi [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] HTTP exception thrown: Instance 5cccfe9f-b440-43e3-83a0-8877b9756506 could not be found. Feb 12 21:57:08.790530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Returning 404 to user: Instance 5cccfe9f-b440-43e3-83a0-8877b9756506 could not be found. {{(pid=141727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:57:08.791421 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-73b7cd74-ff59-43c6-930d-41548c3857f7 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506" status: 404 len: 111 microversion: 2.1 time: 0.028419 Feb 12 21:57:08.791967 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3458/6787] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:08 2022] GET /compute/v2.1/servers/5cccfe9f-b440-43e3-83a0-8877b9756506 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:57:12.286747 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-60f428a2-c0da-4a5f-bd7c-c5fc6f22c12d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '.version_select at 0x7fa8fd901d30>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:12.367213 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-60f428a2-c0da-4a5f-bd7c-c5fc6f22c12d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-162633616" status: 202 len: 0 microversion: 2.1 time: 0.085246 Feb 12 21:57:12.367804 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3330/6788] 10.222.0.31 () {58 vars in 1280 bytes} [Sat Feb 12 21:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-162633616 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:57:12.394561 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8fdafc93-209e-490c-865f-064e47f761b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: .version_select at 0x7fa8fc67cee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1758803446"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:12.409708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8fdafc93-209e-490c-865f-064e47f761b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:57:12.414946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8fdafc93-209e-490c-865f-064e47f761b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:57:12.830173 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8fdafc93-209e-490c-865f-064e47f761b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:57:12.835471 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-8fdafc93-209e-490c-865f-064e47f761b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:57:12.851532 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8fdafc93-209e-490c-865f-064e47f761b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.460640 Feb 12 21:57:12.852145 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3459/6789] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:57:12 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:20.456114 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2013659933", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "3b6bd025-11b3-429c-8d31-8a97873c505e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1758803446", "security_groups": [{"name": "tempest-secgroup-smoke-72605576"}]}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:20.645251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.network.neutron [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] validate_networks() for [('3b6bd025-11b3-429c-8d31-8a97873c505e', None, None, None, None, None)] {{(pid=141726) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:57:21.062484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:57:21.062909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image limits 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:57:21.063385 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:57:21.063791 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image pref 0:0:0 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:57:21.064201 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.virt.hardware [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:57:21.073728 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:21.074309 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:21.075365 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:21.075899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:21.093134 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:57:21.098504 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:57:21.111287 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Going to run 1 instances... {{(pid=141726) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:57:21.113871 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:57:21.236892 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-66099358-17ea-40af-bb27-48adeb6b3f9a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.785568 Feb 12 21:57:21.246058 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3331/6790] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:57:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:57:21.252802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-331efaa3-25ca-4e4d-a9fb-49509f876406 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:21.258142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-331efaa3-25ca-4e4d-a9fb-49509f876406 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:21.401744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-331efaa3-25ca-4e4d-a9fb-49509f876406 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:21.408842 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-331efaa3-25ca-4e4d-a9fb-49509f876406 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1267 microversion: 2.1 time: 0.164684 Feb 12 21:57:21.417348 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3460/6791] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:21 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:57:22.437303 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:22.438703 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:22.445694 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:22.446145 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:22.447622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:22.448260 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:22.516140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:22.524531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2e062703-2fbe-4ad4-9d3f-42f337ef7807 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1263 microversion: 2.1 time: 0.096355 Feb 12 21:57:22.525349 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3332/6792] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:22 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:23.542431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:23.543235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:23.551082 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:23.551810 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:23.552645 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:23.553098 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:23.620781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:23.629051 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-68d6edb1-a3b6-4ba5-bf36-f05ceb38cb16 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1325 microversion: 2.1 time: 0.091240 Feb 12 21:57:23.629697 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3461/6793] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:23 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:24.647912 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:24.648541 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:24.655827 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:24.656282 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:24.657113 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:24.657599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:24.920928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:24.929085 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2c4e33f3-f5ea-4a2b-b968-0ee0188dbf97 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1391 microversion: 2.1 time: 0.284851 Feb 12 21:57:24.929718 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3333/6794] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:24 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:25.073643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-3fa5264f-166a-469f-85d3-73844d099dbd req-46be8fc4-0b40-4ed3-8619-fbb39c424d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4770aadc-4142-421e-8442-906d1b4f6cf2", "tag": "db967ea4-b6b7-444b-a9c6-d1681be19261"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:25.076188 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:57:25.076188 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:57:25.085131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3fa5264f-166a-469f-85d3-73844d099dbd req-46be8fc4-0b40-4ed3-8619-fbb39c424d44 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:25.085959 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-3fa5264f-166a-469f-85d3-73844d099dbd req-46be8fc4-0b40-4ed3-8619-fbb39c424d44 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:25.101439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-3fa5264f-166a-469f-85d3-73844d099dbd req-46be8fc4-0b40-4ed3-8619-fbb39c424d44 service nova] Creating event network-changed:db967ea4-b6b7-444b-a9c6-d1681be19261 for instance 4770aadc-4142-421e-8442-906d1b4f6cf2 on nch2-master-1 Feb 12 21:57:25.106861 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-3fa5264f-166a-469f-85d3-73844d099dbd req-46be8fc4-0b40-4ed3-8619-fbb39c424d44 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037708 Feb 12 21:57:25.107470 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3462/6795] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:57:25.945802 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:25.946479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:25.953483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:25.953933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:25.954748 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:25.955189 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:26.094120 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:26.101567 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7d41d6a1-abaa-45e0-b545-9e40f4a3652b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1391 microversion: 2.1 time: 0.159394 Feb 12 21:57:26.102145 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3334/6796] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:25 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:27.120955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:27.121643 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:27.127941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:27.128409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:27.129205 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:27.129692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:27.268852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:27.278529 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-16c21991-2799-44dd-970c-7129e8bc4dd2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1391 microversion: 2.1 time: 0.163002 Feb 12 21:57:27.279358 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3463/6797] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:27 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:28.296186 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:28.296759 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:28.304605 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:28.305059 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:28.305880 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:28.306455 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:28.445074 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:28.453133 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1e35f68a-661f-4022-88e6-83b7b0ce4569 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1391 microversion: 2.1 time: 0.161253 Feb 12 21:57:28.453749 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3335/6798] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:28 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:29.470488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:29.471109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:29.478104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:29.482534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:29.482534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:29.482534 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:29.616622 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:29.624984 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-76100ef2-5d07-4d1e-aebf-b874e91c0e13 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1391 microversion: 2.1 time: 0.158227 Feb 12 21:57:29.625726 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3464/6799] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:29 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:30.357926 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3dec8718-fca3-4e4d-a628-44480e74b1e3 req-f713b4ec-38b7-4dff-908f-517d8eb78c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4770aadc-4142-421e-8442-906d1b4f6cf2", "name": "network-vif-plugged", "status": "completed", "tag": "db967ea4-b6b7-444b-a9c6-d1681be19261"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:30.359506 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:57:30.359506 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:57:30.366399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3dec8718-fca3-4e4d-a628-44480e74b1e3 req-f713b4ec-38b7-4dff-908f-517d8eb78c60 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:30.366840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3dec8718-fca3-4e4d-a628-44480e74b1e3 req-f713b4ec-38b7-4dff-908f-517d8eb78c60 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:30.377931 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3dec8718-fca3-4e4d-a628-44480e74b1e3 req-f713b4ec-38b7-4dff-908f-517d8eb78c60 service nova] Creating event network-vif-plugged:db967ea4-b6b7-444b-a9c6-d1681be19261 for instance 4770aadc-4142-421e-8442-906d1b4f6cf2 on nch2-master-1 Feb 12 21:57:30.383688 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3dec8718-fca3-4e4d-a628-44480e74b1e3 req-f713b4ec-38b7-4dff-908f-517d8eb78c60 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105065 Feb 12 21:57:30.384305 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3336/6800] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:57:30.641953 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:30.642575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:30.649376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:30.649855 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:30.650690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:30.651146 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:30.792824 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:30.800319 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-47f2fcd7-170e-4cd6-a080-ae5cd4064c91 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1391 microversion: 2.1 time: 0.162051 Feb 12 21:57:30.800901 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3465/6801] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:30 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:31.821275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:31.822000 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:31.828696 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:31.829144 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:31.829950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:31.830386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:31.970946 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:31.978392 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-423e7490-e990-4bb9-af2b-6722e13bc5f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1563 microversion: 2.1 time: 0.164440 Feb 12 21:57:31.978958 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3337/6802] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:31 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:31.995061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:31.995726 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:32.002671 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:32.003085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:32.003893 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:32.004353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:32.140157 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:32.147724 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-9aaa877c-93d4-43a2-af0e-3d4b7135b385 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1563 microversion: 2.1 time: 0.156405 Feb 12 21:57:32.149548 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3466/6803] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:31 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:34.423851 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:57:34.424467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:34.430281 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-a9e60109-9307-438a-9a6d-101d19cb1994 req-f319276b-aa28-4cca-b36f-2d1f47033594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4770aadc-4142-421e-8442-906d1b4f6cf2", "tag": "db967ea4-b6b7-444b-a9c6-d1681be19261"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:34.431956 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:57:34.431956 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:57:34.432788 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:34.433247 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:34.434218 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:34.434869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:34.441571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a9e60109-9307-438a-9a6d-101d19cb1994 req-f319276b-aa28-4cca-b36f-2d1f47033594 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:34.442349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-a9e60109-9307-438a-9a6d-101d19cb1994 req-f319276b-aa28-4cca-b36f-2d1f47033594 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:34.456476 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-a9e60109-9307-438a-9a6d-101d19cb1994 req-f319276b-aa28-4cca-b36f-2d1f47033594 service nova] Creating event network-changed:db967ea4-b6b7-444b-a9c6-d1681be19261 for instance 4770aadc-4142-421e-8442-906d1b4f6cf2 on nch2-master-1 Feb 12 21:57:34.462076 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-a9e60109-9307-438a-9a6d-101d19cb1994 req-f319276b-aa28-4cca-b36f-2d1f47033594 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035832 Feb 12 21:57:34.463197 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3467/6804] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:57:34.671853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:57:34.679742 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-74f4df21-10de-4e24-8a0b-089715d4091f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1563 microversion: 2.1 time: 0.259541 Feb 12 21:57:34.680570 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3338/6805] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:57:34 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1563 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:57:56.996108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:57:56.997463 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:57:57.009125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:57.009125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:57.009125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:57:57.009125 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:57:57.056393 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-639c07aa-18c4-46f2-91c5-ea75f022840a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action" status: 200 len: 24569 microversion: 2.1 time: 0.064902 Feb 12 21:57:57.057330 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3468/6806] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:57:56 2022] POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action => generated 24569 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:58:03.463352 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed14c5a4-bcc7-4333-9911-f574dbf331cd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:03.469652 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed14c5a4-bcc7-4333-9911-f574dbf331cd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:03.470111 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed14c5a4-bcc7-4333-9911-f574dbf331cd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:03.491712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed14c5a4-bcc7-4333-9911-f574dbf331cd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Going to try to stop instance {{(pid=141726) force_stop /opt/stack/nova/nova/compute/api.py:2674}} Feb 12 21:58:03.694141 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed14c5a4-bcc7-4333-9911-f574dbf331cd tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action" status: 202 len: 0 microversion: 2.1 time: 0.234542 Feb 12 21:58:03.694946 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3339/6807] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:58:03 2022] POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:58:03.704248 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:03.705102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:03.712569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:03.713027 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:03.713913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:03.714369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:03.852825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:03.865340 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-733d5373-2ef3-47ed-b70d-5315f43b3283 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.165464 Feb 12 21:58:03.866022 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3469/6808] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:03 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:04.884147 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:04.884870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:04.891920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:04.892375 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:04.893155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:04.893628 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:05.035440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:05.043303 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a28f1b19-6eb5-4bb0-9777-1441c7a79d88 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.164001 Feb 12 21:58:05.044111 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3340/6809] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:04 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:06.061198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:06.061789 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:06.069474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:06.069940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:06.070732 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:06.071183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:06.207426 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:06.214844 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6df2dccd-b313-43cf-aa84-11becbbff490 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.158167 Feb 12 21:58:06.215609 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3470/6810] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:06 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:07.231742 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:07.232357 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:07.239435 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:07.239890 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:07.240680 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:07.241122 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:07.377677 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:07.385028 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6557294a-4bd1-4083-badc-dbad4f926aae tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.156950 Feb 12 21:58:07.385635 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3341/6811] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:07 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:08.402678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:08.403350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:08.410360 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:08.410825 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:08.411615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:08.412061 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:08.549407 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:08.557382 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-04500b8f-17eb-41c4-94d5-0b1e62f1a4ce tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.158364 Feb 12 21:58:08.557987 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3471/6812] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:08 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:09.574598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:09.575809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:09.582535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:09.582992 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:09.583783 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:09.584227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:09.718164 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:09.725572 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-52468474-3f9d-4374-a48e-999ebc10de68 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.154758 Feb 12 21:58:09.726246 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3342/6813] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:09 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:10.743093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:10.743770 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:10.753559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:10.754030 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:10.754835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:10.755284 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:10.894836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:10.902583 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-469653a5-8a71-48be-9c9e-0bb6afa4013f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.163176 Feb 12 21:58:10.903226 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3472/6814] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:10 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:11.919764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:11.920376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:11.927548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:11.928005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:11.928797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:11.929240 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:12.082867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:12.090255 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6d35ffcf-66c2-446c-80a3-fb0e5b4c0921 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.174214 Feb 12 21:58:12.092206 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3343/6815] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:11 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:13.107976 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:13.108582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:13.115395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:13.115860 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:13.116652 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:13.117105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:13.252587 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:13.260049 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3c94beeb-66fa-4f5f-869f-566ebd00cc1a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1692 microversion: 2.1 time: 0.155931 Feb 12 21:58:13.260626 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3473/6816] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:13 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:14.277812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:14.278409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:14.285640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:14.286096 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:14.286887 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:14.287330 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:14.427011 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:14.434617 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-acb91a07-b4b1-4a17-8e11-e87692c03887 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1669 microversion: 2.1 time: 0.160589 Feb 12 21:58:14.435218 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3344/6817] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:14 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:15.527657 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:15.528593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:15.535695 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:15.536168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:15.536973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:15.537461 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:15.586997 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58f3a8be-9430-4e1e-9829-09ad8d495286 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action" status: 200 len: 35989 microversion: 2.1 time: 0.062925 Feb 12 21:58:15.587637 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3474/6818] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:58:15 2022] POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action => generated 35989 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:58:15.598656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c0232da6-61cd-4091-adc9-11b6037b83f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:15.605620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0232da6-61cd-4091-adc9-11b6037b83f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:15.606097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0232da6-61cd-4091-adc9-11b6037b83f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:15.629205 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c0232da6-61cd-4091-adc9-11b6037b83f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Going to try to start instance {{(pid=141726) start /opt/stack/nova/nova/compute/api.py:2697}} Feb 12 21:58:15.785861 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c0232da6-61cd-4091-adc9-11b6037b83f5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action" status: 202 len: 0 microversion: 2.1 time: 0.190592 Feb 12 21:58:15.786495 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3345/6819] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:58:15 2022] POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:58:15.795301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:15.796554 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:15.803935 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:15.804429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:15.805328 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:15.805812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:15.953837 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:15.961332 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a0ebe097-0629-4a0c-b2cc-70a25ad15b35 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1678 microversion: 2.1 time: 0.170145 Feb 12 21:58:15.961939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3475/6820] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:15 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:58:16.980635 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:16.981376 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:16.987813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:16.988270 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:16.989053 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:16.989519 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:17.129909 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:17.137332 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7aad6565-d22c-442b-b7c2-8ec3ae0b180b tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1682 microversion: 2.1 time: 0.161642 Feb 12 21:58:17.137932 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3346/6821] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:16 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:58:41.320251 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:41.321183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:41.327866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:41.328331 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:41.329130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:41.329610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:41.380557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-826feb26-af7f-4e26-ac86-5d1f6d87f043 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action" status: 200 len: 60546 microversion: 2.1 time: 0.064042 Feb 12 21:58:41.381208 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3476/6822] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:58:41 2022] POST /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2/action => generated 60546 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:58:48.492869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:48.493422 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:48.496318 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-e4863589-1f59-48b1-b629-7bb8b99ac7c8 req-f9bd76c5-52bb-4204-b499-545cafb8b5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4770aadc-4142-421e-8442-906d1b4f6cf2", "tag": "db967ea4-b6b7-444b-a9c6-d1681be19261"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:48.498450 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:58:48.498450 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:58:48.499945 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:48.500403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:48.501188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:48.501648 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:48.508148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e4863589-1f59-48b1-b629-7bb8b99ac7c8 req-f9bd76c5-52bb-4204-b499-545cafb8b5e0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:48.508708 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-e4863589-1f59-48b1-b629-7bb8b99ac7c8 req-f9bd76c5-52bb-4204-b499-545cafb8b5e0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:48.521502 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-e4863589-1f59-48b1-b629-7bb8b99ac7c8 req-f9bd76c5-52bb-4204-b499-545cafb8b5e0 service nova] Creating event network-changed:db967ea4-b6b7-444b-a9c6-d1681be19261 for instance 4770aadc-4142-421e-8442-906d1b4f6cf2 on nch2-master-1 Feb 12 21:58:48.527156 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-e4863589-1f59-48b1-b629-7bb8b99ac7c8 req-f9bd76c5-52bb-4204-b499-545cafb8b5e0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035586 Feb 12 21:58:48.528042 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3477/6823] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:58:48.529083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 21:58:48.862869 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b97a4b42-cb80-4798-a704-b84eb3d10c3f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 204 len: 0 microversion: 2.1 time: 0.372813 Feb 12 21:58:48.863248 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3347/6824] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 21:58:48 2022] DELETE /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 21:58:48.872454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:48.873183 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:48.880723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:48.881194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:48.882835 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:48.883291 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:49.046516 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:49.055418 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-79d228d9-10ed-428f-ad9b-3a4de46ecd71 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1688 microversion: 2.1 time: 0.187446 Feb 12 21:58:49.056039 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3478/6825] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:48 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:58:50.074281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:50.074896 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:50.083047 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:50.083499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:50.084281 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:50.084717 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:50.223940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:50.231286 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a51b3a81-4f4e-4d49-a1ee-a97dada86a38 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1569 microversion: 2.1 time: 0.161144 Feb 12 21:58:50.231853 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3348/6826] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:50 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:51.248132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:51.248969 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:51.256791 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:51.257266 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:51.258107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:51.258626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:51.263573 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-61815544-db83-41c9-b4ea-609f1dbdccea req-8531f630-266e-4835-a220-206dea468248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4770aadc-4142-421e-8442-906d1b4f6cf2", "name": "network-vif-deleted", "tag": "db967ea4-b6b7-444b-a9c6-d1681be19261"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:51.265426 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:58:51.265426 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:58:51.274497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-61815544-db83-41c9-b4ea-609f1dbdccea req-8531f630-266e-4835-a220-206dea468248 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:51.275476 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-61815544-db83-41c9-b4ea-609f1dbdccea req-8531f630-266e-4835-a220-206dea468248 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:51.286027 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-61815544-db83-41c9-b4ea-609f1dbdccea req-8531f630-266e-4835-a220-206dea468248 service nova] Creating event network-vif-deleted:db967ea4-b6b7-444b-a9c6-d1681be19261 for instance 4770aadc-4142-421e-8442-906d1b4f6cf2 on nch2-master-1 Feb 12 21:58:51.291077 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-61815544-db83-41c9-b4ea-609f1dbdccea req-8531f630-266e-4835-a220-206dea468248 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Feb 12 21:58:51.292050 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3349/6827] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 21:58:51.324377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:58:51.335484 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b9cc839-c49f-4342-ac61-422679ea824e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 200 len: 1503 microversion: 2.1 time: 0.091094 Feb 12 21:58:51.336097 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3479/6828] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:51 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 1503 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:58:52.354209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:52.354913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: 4770aadc-4142-421e-8442-906d1b4f6cf2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:58:52.361467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:52.362423 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:52.363224 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:58:52.363684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:58:52.382050 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] HTTP exception thrown: Instance 4770aadc-4142-421e-8442-906d1b4f6cf2 could not be found. Feb 12 21:58:52.382656 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Returning 404 to user: Instance 4770aadc-4142-421e-8442-906d1b4f6cf2 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 21:58:52.383500 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-88af5e39-49e7-4cda-a6c2-fe1a17c2f2aa tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2" status: 404 len: 111 microversion: 2.1 time: 0.034856 Feb 12 21:58:52.384051 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3350/6829] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:58:52 2022] GET /compute/v2.1/servers/4770aadc-4142-421e-8442-906d1b4f6cf2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 21:58:56.318451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-565ab9b7-155e-4037-9523-0e25f860ae6f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '.version_select at 0x7fa8fc698940>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:58:56.406458 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-565ab9b7-155e-4037-9523-0e25f860ae6f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1758803446" status: 202 len: 0 microversion: 2.1 time: 0.091965 Feb 12 21:58:56.407062 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3480/6830] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 21:58:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1758803446 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:58:56.435969 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2fc94f99-6b58-46fe-b7be-5df293f1bb4a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: .version_select at 0x7fa8fcffd3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1548967171"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:58:56.450769 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2fc94f99-6b58-46fe-b7be-5df293f1bb4a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:58:56.456398 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2fc94f99-6b58-46fe-b7be-5df293f1bb4a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:58:56.889003 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2fc94f99-6b58-46fe-b7be-5df293f1bb4a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:58:56.894731 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-2fc94f99-6b58-46fe-b7be-5df293f1bb4a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:58:56.911756 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2fc94f99-6b58-46fe-b7be-5df293f1bb4a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.479657 Feb 12 21:58:56.912373 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3351/6831] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 21:58:56 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:59:04.794460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-313882856", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "networks": [{"uuid": "8b6e65d0-576b-4a33-97e6-9db053283936"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1548967171", "security_groups": [{"name": "tempest-secgroup-smoke-990591840"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:04.923329 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] validate_networks() for [('8b6e65d0-576b-4a33-97e6-9db053283936', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 21:59:05.447517 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 21:59:05.448161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 21:59:05.448722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 21:59:05.449218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 21:59:05.449745 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 21:59:05.461043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:05.462131 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:05.463224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:05.464050 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:05.490145 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 21:59:05.496130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Getting quotas for user ed62bb8899f0418881db75b06d6a8da1 and project dc7b3029bd844f88a4fe9146af00a270. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 21:59:05.510333 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 21:59:05.513728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 21:59:05.653021 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-be28097f-2f43-4704-8f20-f719079fed50 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.863101 Feb 12 21:59:05.659103 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3481/6832] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 21:59:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 21:59:05.664459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-90edb9c5-a3df-4d4c-b10e-924d3aa79389 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:05.665072 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-90edb9c5-a3df-4d4c-b10e-924d3aa79389 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:05.743416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-90edb9c5-a3df-4d4c-b10e-924d3aa79389 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:05.757311 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-90edb9c5-a3df-4d4c-b10e-924d3aa79389 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1266 microversion: 2.1 time: 0.095953 Feb 12 21:59:05.758730 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3352/6833] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:05 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:06.776243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:06.776869 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:06.784465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:06.784901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:06.785968 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:06.786429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:06.853316 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:06.862548 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-58b79195-0485-4a5d-9958-d0906bc944dc tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1270 microversion: 2.1 time: 0.090454 Feb 12 21:59:06.870209 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3482/6834] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:06 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:07.880910 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:07.881902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:07.889715 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:07.890173 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:07.891064 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:07.891400 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:07.964831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:07.973897 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-52947251-3ebe-447b-9286-02601b69ced9 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1336 microversion: 2.1 time: 0.096555 Feb 12 21:59:07.977571 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3353/6835] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:07 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:08.990784 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:08.991458 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:08.998501 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:08.998981 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:08.999793 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:09.000250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:09.159632 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:09.167688 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7dfebf54-aeba-4674-a458-930327f66482 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.180867 Feb 12 21:59:09.168281 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3483/6836] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:08 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:09.372383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-0299bfd5-0b3f-41ca-8075-5eaffbb06243 req-9a4d8bcb-278f-4b4a-ad5d-a5e268d71d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b707d568-3a1f-453a-992c-843df5ea9fe3", "tag": "0e3fdc25-e57c-4a03-a41b-119a4745debb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:09.373992 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:59:09.373992 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:59:09.382414 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0299bfd5-0b3f-41ca-8075-5eaffbb06243 req-9a4d8bcb-278f-4b4a-ad5d-a5e268d71d22 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:09.383012 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0299bfd5-0b3f-41ca-8075-5eaffbb06243 req-9a4d8bcb-278f-4b4a-ad5d-a5e268d71d22 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:09.395343 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-0299bfd5-0b3f-41ca-8075-5eaffbb06243 req-9a4d8bcb-278f-4b4a-ad5d-a5e268d71d22 service nova] Creating event network-changed:0e3fdc25-e57c-4a03-a41b-119a4745debb for instance b707d568-3a1f-453a-992c-843df5ea9fe3 on nch1-master-1 Feb 12 21:59:09.400189 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-0299bfd5-0b3f-41ca-8075-5eaffbb06243 req-9a4d8bcb-278f-4b4a-ad5d-a5e268d71d22 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032193 Feb 12 21:59:09.400794 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3354/6837] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:59:10.185479 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:10.186111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:10.193289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:10.193930 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:10.194725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:10.195174 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:10.336502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:10.343874 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c5b60922-8028-4973-81bb-256b2b709ab2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.162173 Feb 12 21:59:10.344441 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3484/6838] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:10 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:11.362141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:11.362840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:11.369028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:11.369638 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:11.370412 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:11.370854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:11.516172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:11.524024 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b0220312-13e5-40e7-b5ed-9b84380c979a tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.166792 Feb 12 21:59:11.524624 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3355/6839] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:11 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:12.541323 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:12.541975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:12.549722 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:12.552112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:12.552112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:12.552112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:12.686349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:12.695213 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2ad310fe-6f6e-4ac3-8974-7d93ada11de6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.157571 Feb 12 21:59:12.695939 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3485/6840] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:12 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:13.712139 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:13.712900 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:13.719689 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:13.720146 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:13.721507 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:13.721948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:13.858112 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:13.865589 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-570ef436-1aae-45b6-a3e6-16f250be5871 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.157140 Feb 12 21:59:13.866158 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3356/6841] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:13 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:14.882423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:14.883049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:14.889826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:14.892258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:14.892258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:14.892258 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:15.038109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:15.045495 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a5b39077-0cf1-4e5c-b5b2-d5907f79f781 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.166786 Feb 12 21:59:15.046087 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3486/6842] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:14 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:15.230793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6ce6049d-ce14-43b6-99b4-f37a2105584c req-b4c14fe1-0507-4898-8d4e-9a558181a81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b707d568-3a1f-453a-992c-843df5ea9fe3", "name": "network-vif-plugged", "status": "completed", "tag": "0e3fdc25-e57c-4a03-a41b-119a4745debb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:15.232543 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:59:15.232543 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 21:59:15.239711 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6ce6049d-ce14-43b6-99b4-f37a2105584c req-b4c14fe1-0507-4898-8d4e-9a558181a81b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:15.240161 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6ce6049d-ce14-43b6-99b4-f37a2105584c req-b4c14fe1-0507-4898-8d4e-9a558181a81b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:15.251594 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6ce6049d-ce14-43b6-99b4-f37a2105584c req-b4c14fe1-0507-4898-8d4e-9a558181a81b service nova] Creating event network-vif-plugged:0e3fdc25-e57c-4a03-a41b-119a4745debb for instance b707d568-3a1f-453a-992c-843df5ea9fe3 on nch1-master-1 Feb 12 21:59:15.257300 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6ce6049d-ce14-43b6-99b4-f37a2105584c req-b4c14fe1-0507-4898-8d4e-9a558181a81b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032448 Feb 12 21:59:15.257862 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3357/6843] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:59:16.062610 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:16.063454 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:16.070616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:16.071081 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:16.071881 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:16.072403 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:16.207287 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:16.214657 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cbaf7be3-c1d9-409e-9002-8f551251a7c0 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1391 microversion: 2.1 time: 0.155805 Feb 12 21:59:16.215227 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3487/6844] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:16 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:17.233396 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:17.234038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:17.240796 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:17.241250 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:17.242052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:17.242526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:17.384104 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:17.391507 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-56ca4f5e-493c-4dde-a0a7-9fef2aca2536 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1563 microversion: 2.1 time: 0.163118 Feb 12 21:59:17.392087 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3358/6845] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:17 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:17.407596 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:17.408818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:17.415631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:17.416094 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:17.416890 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:17.417343 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:17.555148 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:17.562617 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f1800147-b29d-4baa-8498-143c9db40343 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1563 microversion: 2.1 time: 0.158818 Feb 12 21:59:17.563186 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3488/6846] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:17 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:19.859036 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:19.859683 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:19.872892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:19.872892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:19.872892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:19.873225 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:19.951164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-2dea8aa4-d0c6-43e0-8609-f47147927bfe req-91321da6-b903-407a-afbb-37a53f36668e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b707d568-3a1f-453a-992c-843df5ea9fe3", "tag": "0e3fdc25-e57c-4a03-a41b-119a4745debb"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:19.953378 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 21:59:19.953378 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 21:59:19.960972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2dea8aa4-d0c6-43e0-8609-f47147927bfe req-91321da6-b903-407a-afbb-37a53f36668e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:19.961569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-2dea8aa4-d0c6-43e0-8609-f47147927bfe req-91321da6-b903-407a-afbb-37a53f36668e service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:19.973610 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-2dea8aa4-d0c6-43e0-8609-f47147927bfe req-91321da6-b903-407a-afbb-37a53f36668e service nova] Creating event network-changed:0e3fdc25-e57c-4a03-a41b-119a4745debb for instance b707d568-3a1f-453a-992c-843df5ea9fe3 on nch1-master-1 Feb 12 21:59:19.983120 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-2dea8aa4-d0c6-43e0-8609-f47147927bfe req-91321da6-b903-407a-afbb-37a53f36668e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129215 Feb 12 21:59:19.984058 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3489/6847] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 21:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 21:59:20.101970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:20.110531 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-4e392c96-bea3-4242-a95f-d07d1e21952e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1563 microversion: 2.1 time: 0.260828 Feb 12 21:59:20.111146 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3359/6848] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:19 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:43.355983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:43.357003 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:43.363761 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:43.364223 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:43.365049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:43.365529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:43.424164 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8b80bb1c-3348-46c9-8768-304964e5956d tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action" status: 200 len: 24564 microversion: 2.1 time: 0.072716 Feb 12 21:59:43.424805 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3490/6849] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:59:43 2022] POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action => generated 24564 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:59:54.517967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:54.518650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:54.524707 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:54.525155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:54.525956 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:54.526395 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:54.549276 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.objects.instance [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lazy-loading 'flavor' on Instance uuid b707d568-3a1f-453a-992c-843df5ea9fe3 {{(pid=141726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 21:59:54.824537 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c0759888-9f35-45a8-b4da-173976c8c670 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action" status: 202 len: 0 microversion: 2.1 time: 0.310474 Feb 12 21:59:54.825333 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3360/6850] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:59:54 2022] POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:59:54.833978 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:54.834785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:54.842692 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:54.843158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:54.843961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:54.844408 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:55.046495 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:55.055275 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3af2b78f-613c-4ef5-8147-7958217ccc41 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1689 microversion: 2.1 time: 0.225593 Feb 12 21:59:55.055852 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3491/6851] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:54 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:56.074954 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:56.075570 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:56.082499 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:56.082947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:56.083726 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:56.084159 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:56.340194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:56.348396 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ed7559a9-f49f-4f9f-991b-c431a1bc59c5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1672 microversion: 2.1 time: 0.278966 Feb 12 21:59:56.348973 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3361/6852] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:56 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1672 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 21:59:57.439627 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:57.440579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:57.448274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:57.448735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:57.449685 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:57.450136 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:57.508930 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-945461d4-e368-4db7-9922-b8a83dd692b3 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action" status: 200 len: 38392 microversion: 2.1 time: 0.072967 Feb 12 21:59:57.509888 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3492/6853] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:59:57 2022] POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action => generated 38392 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 21:59:57.521116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 21:59:57.521695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:57.528488 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:57.528940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:57.529749 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:57.530192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:57.707174 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7898219d-f639-44cd-bd10-20de8e05c4e5 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action" status: 202 len: 0 microversion: 2.1 time: 0.190155 Feb 12 21:59:57.707889 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3362/6854] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 21:59:57 2022] POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 21:59:57.716982 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:57.717936 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:57.727474 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:57.731668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:57.731668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:57.731668 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:57.969549 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:57.977816 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c78ae922-e312-4892-b96f-53170f7afb9f tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1678 microversion: 2.1 time: 0.265530 Feb 12 21:59:57.978631 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3493/6855] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:57 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1678 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 21:59:58.997221 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 21:59:58.998248 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 21:59:59.004799 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:59.005192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:59.006087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 21:59:59.006534 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 21:59:59.143639 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 21:59:59.150943 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2b791cb0-7d3b-4a10-b0c2-d33214b11b98 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1678 microversion: 2.1 time: 0.158739 Feb 12 21:59:59.151511 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3363/6856] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 21:59:58 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:00.168912 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:00.169688 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:00.176653 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:00.177135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:00.177973 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:00.178437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:00.317805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:00.325286 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-05e79bc3-d448-4ead-9674-2936264cf861 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1681 microversion: 2.1 time: 0.160271 Feb 12 22:00:00.325894 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3494/6857] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:00 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:00.416471 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:00.417449 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:00.424577 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:00.425048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:00.425857 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:00.426296 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:00.471915 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3632facf-a9d2-4170-a158-45a3c56a543e tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action" status: 200 len: 38392 microversion: 2.1 time: 0.058958 Feb 12 22:00:00.472575 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3364/6858] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 22:00:00 2022] POST /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3/action => generated 38392 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 22:00:01.584575 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:01.585099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:01.587171 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-86cdff11-3d82-44bd-b234-1820801aec2d req-2e1639dd-4118-4706-bfbd-5c614b924864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b707d568-3a1f-453a-992c-843df5ea9fe3", "tag": "0e3fdc25-e57c-4a03-a41b-119a4745debb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:01.588775 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:00:01.588775 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:00:01.592299 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:01.592778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:01.593782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:01.594252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:01.600020 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-86cdff11-3d82-44bd-b234-1820801aec2d req-2e1639dd-4118-4706-bfbd-5c614b924864 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:01.600841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-86cdff11-3d82-44bd-b234-1820801aec2d req-2e1639dd-4118-4706-bfbd-5c614b924864 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:01.612604 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-86cdff11-3d82-44bd-b234-1820801aec2d req-2e1639dd-4118-4706-bfbd-5c614b924864 service nova] Creating event network-changed:0e3fdc25-e57c-4a03-a41b-119a4745debb for instance b707d568-3a1f-453a-992c-843df5ea9fe3 on nch1-master-1 Feb 12 22:00:01.617955 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-86cdff11-3d82-44bd-b234-1820801aec2d req-2e1639dd-4118-4706-bfbd-5c614b924864 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Feb 12 22:00:01.618561 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3365/6859] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:00:01.623293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 22:00:01.917299 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8a10dfcf-8587-4236-b516-7146cb8829fb tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 204 len: 0 microversion: 2.1 time: 0.337534 Feb 12 22:00:01.918346 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3495/6860] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 22:00:01 2022] DELETE /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 22:00:01.928027 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:01.929467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:01.937778 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:01.938238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:01.939760 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:01.940446 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:02.177651 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:02.185552 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ae323647-cc2b-48f0-89fb-fc3ab30ab055 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1687 microversion: 2.1 time: 0.262585 Feb 12 22:00:02.186413 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3366/6861] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:01 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1687 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:03.205133 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:03.205832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:03.212626 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:03.213097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:03.213928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:03.214379 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:03.357243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:03.365634 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-01ca0cd8-dcda-4b67-9852-be9c734a0ef6 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1569 microversion: 2.1 time: 0.164788 Feb 12 22:00:03.366234 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3496/6862] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:03 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:04.329322 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-4f1442dd-2e3f-45ce-b6e7-cc3569b180ee req-f3fbc90b-94d5-45ef-bc29-2ea1f4f65304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b707d568-3a1f-453a-992c-843df5ea9fe3", "name": "network-vif-deleted", "tag": "0e3fdc25-e57c-4a03-a41b-119a4745debb"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:04.331185 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:00:04.331185 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:00:04.339899 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4f1442dd-2e3f-45ce-b6e7-cc3569b180ee req-f3fbc90b-94d5-45ef-bc29-2ea1f4f65304 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:04.340351 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-4f1442dd-2e3f-45ce-b6e7-cc3569b180ee req-f3fbc90b-94d5-45ef-bc29-2ea1f4f65304 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:04.350994 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-4f1442dd-2e3f-45ce-b6e7-cc3569b180ee req-f3fbc90b-94d5-45ef-bc29-2ea1f4f65304 service nova] Creating event network-vif-deleted:0e3fdc25-e57c-4a03-a41b-119a4745debb for instance b707d568-3a1f-453a-992c-843df5ea9fe3 on nch1-master-1 Feb 12 22:00:04.356293 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-4f1442dd-2e3f-45ce-b6e7-cc3569b180ee req-f3fbc90b-94d5-45ef-bc29-2ea1f4f65304 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086656 Feb 12 22:00:04.356899 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3367/6863] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:00:04.383908 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:04.384526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:04.391507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:04.391971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:04.392794 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:04.393240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:04.456459 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed62bb8899f0418881db75b06d6a8da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7b3029bd844f88a4fe9146af00a270', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:04.463839 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d27d82fb-28fd-47dd-96a5-0294317cb6c2 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 200 len: 1502 microversion: 2.1 time: 0.083719 Feb 12 22:00:04.464703 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3497/6864] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:04 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 1502 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:05.482300 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:05.482997 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] [instance: b707d568-3a1f-453a-992c-843df5ea9fe3] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:05.489525 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:05.489977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:05.490777 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:05.491214 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:05.504816 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] HTTP exception thrown: Instance b707d568-3a1f-453a-992c-843df5ea9fe3 could not be found. Feb 12 22:00:05.505451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Returning 404 to user: Instance b707d568-3a1f-453a-992c-843df5ea9fe3 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 22:00:05.506258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-92f1f86e-2fca-4064-8bc1-4f308e347006 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3" status: 404 len: 111 microversion: 2.1 time: 0.028852 Feb 12 22:00:05.506784 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3368/6865] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:05 2022] GET /compute/v2.1/servers/b707d568-3a1f-453a-992c-843df5ea9fe3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 22:00:09.341384 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d70b8840-eb75-480f-bad2-1ba2006a9942 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] Calling method '.version_select at 0x7fa8fc63f310>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:09.441124 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d70b8840-eb75-480f-bad2-1ba2006a9942 tempest-TestNetworkAdvancedServerOps-1700525136 tempest-TestNetworkAdvancedServerOps-1700525136-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1548967171" status: 202 len: 0 microversion: 2.1 time: 0.103394 Feb 12 22:00:09.441763 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3498/6866] 10.222.0.31 () {58 vars in 1283 bytes} [Sat Feb 12 22:00:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1548967171 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 22:00:11.912945 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:00:11.913390 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:00:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:00:24.719904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5cfb205a-ea19-48fd-96b7-2dece2451b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'create', calling method: .version_select at 0x7fa8fd06c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-2018846766"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:24.736194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5cfb205a-ea19-48fd-96b7-2dece2451b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:00:24.741239 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5cfb205a-ea19-48fd-96b7-2dece2451b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for user c00440dbf100416c83f80be418e2a05a and project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:00:25.472967 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5cfb205a-ea19-48fd-96b7-2dece2451b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:00:25.478757 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-5cfb205a-ea19-48fd-96b7-2dece2451b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for user c00440dbf100416c83f80be418e2a05a and project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:00:25.495334 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5cfb205a-ea19-48fd-96b7-2dece2451b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.940500 Feb 12 22:00:25.496143 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3369/6867] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 22:00:24 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:27.897705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1388593677", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2018846766", "security_groups": [{"name": "tempest-secgroup-smoke-817862586"}], "networks": [{"uuid": "7a1ae1e7-f563-4c07-9b35-0728ce6e4509"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:28.009600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] validate_networks() for [('7a1ae1e7-f563-4c07-9b35-0728ce6e4509', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 22:00:28.407861 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 22:00:28.408300 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 22:00:28.408822 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 22:00:28.409250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 22:00:28.409715 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 22:00:28.419215 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:28.419798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:28.420839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:28.421310 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:28.440170 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for project 707f6000ad794dbd92c57050b2f27387. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:00:28.445805 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for user c00440dbf100416c83f80be418e2a05a and project 707f6000ad794dbd92c57050b2f27387. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:00:28.458907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 22:00:28.461298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 22:00:28.572666 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82463416-d321-4bf0-99c7-62e308534469 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.679138 Feb 12 22:00:28.573265 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3499/6868] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 22:00:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 22:00:28.583709 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7fa00f27-bb41-4d9a-825f-c8759107a143 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:28.584325 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7fa00f27-bb41-4d9a-825f-c8759107a143 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:28.641302 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7fa00f27-bb41-4d9a-825f-c8759107a143 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:28.649277 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7fa00f27-bb41-4d9a-825f-c8759107a143 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1247 microversion: 2.1 time: 0.070019 Feb 12 22:00:28.649877 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3370/6869] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:28 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:29.667491 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:29.668118 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:29.674983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:29.677572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:29.677572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:29.677572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:29.741437 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:29.749316 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8261062a-7b5a-4758-a2c3-28698e8bbd11 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1251 microversion: 2.1 time: 0.086359 Feb 12 22:00:29.752407 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3500/6870] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:29 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1251 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:30.766606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:30.769950 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:30.774960 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:30.775417 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:30.776212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:30.776649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:30.840371 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:30.848497 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64afab3c-74c1-4164-89a6-6b0756b2f397 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1307 microversion: 2.1 time: 0.085604 Feb 12 22:00:30.849077 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3371/6871] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:30 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:31.865613 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:31.866235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:31.873509 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:31.873977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:31.874778 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:31.875226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:31.940382 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:31.952817 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1a02063c-64b4-4c7c-b55d-8cf36eacf237 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1305 microversion: 2.1 time: 0.091078 Feb 12 22:00:31.953593 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3501/6872] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:31 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:32.970646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:32.976923 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:32.979852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:32.980352 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:32.981168 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:32.981640 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:33.001323 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-be0eff59-d9d1-4ccf-8b86-b6455e701275 req-bea57aea-7c1c-49b7-8db6-edd64e9e1814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:33.009986 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:00:33.009986 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:00:33.021212 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-be0eff59-d9d1-4ccf-8b86-b6455e701275 req-bea57aea-7c1c-49b7-8db6-edd64e9e1814 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:33.022100 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-be0eff59-d9d1-4ccf-8b86-b6455e701275 req-bea57aea-7c1c-49b7-8db6-edd64e9e1814 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:33.036774 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-be0eff59-d9d1-4ccf-8b86-b6455e701275 req-bea57aea-7c1c-49b7-8db6-edd64e9e1814 service nova] Creating event network-changed:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:00:33.042471 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-be0eff59-d9d1-4ccf-8b86-b6455e701275 req-bea57aea-7c1c-49b7-8db6-edd64e9e1814 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110808 Feb 12 22:00:33.043380 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3372/6873] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:00:33.151010 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:33.159557 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0b78061f-030c-4713-9d60-c6b4bc750d42 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1372 microversion: 2.1 time: 0.192344 Feb 12 22:00:33.160243 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3502/6874] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:32 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:34.177564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:34.178192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:34.184649 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:34.185108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:34.185927 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:34.186366 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:34.322383 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:34.329786 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-7078d908-8f77-4daa-9f59-16ad2e3f24d2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1372 microversion: 2.1 time: 0.157439 Feb 12 22:00:34.330360 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3373/6875] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:34 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:35.346892 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:35.347530 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:35.354582 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:35.355066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:35.355842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:35.356298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:35.493049 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:35.500689 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-82a564a3-d0a7-4d9b-9e04-6e7a1c4d5ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1372 microversion: 2.1 time: 0.157533 Feb 12 22:00:35.501483 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3503/6876] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:35 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:36.518424 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:36.519184 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:36.526051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:36.526510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:36.527305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:36.527746 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:36.659297 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:36.666932 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e49d577c-deeb-4f4e-8d47-2dca7ced63db tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1372 microversion: 2.1 time: 0.152248 Feb 12 22:00:36.667497 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3374/6877] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:36 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:37.684999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:37.685948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:37.693893 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:37.694437 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:37.695283 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:37.695719 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:37.708884 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-75892d64-11ea-43fe-9ccb-32b957aec2bf req-2cf297b7-4103-4b03-8971-d0601ff46e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "name": "network-vif-plugged", "status": "completed", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:37.710626 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:00:37.710626 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 22:00:37.717840 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-75892d64-11ea-43fe-9ccb-32b957aec2bf req-2cf297b7-4103-4b03-8971-d0601ff46e10 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:37.718389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-75892d64-11ea-43fe-9ccb-32b957aec2bf req-2cf297b7-4103-4b03-8971-d0601ff46e10 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:37.729796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-75892d64-11ea-43fe-9ccb-32b957aec2bf req-2cf297b7-4103-4b03-8971-d0601ff46e10 service nova] Creating event network-vif-plugged:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:00:37.735171 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-75892d64-11ea-43fe-9ccb-32b957aec2bf req-2cf297b7-4103-4b03-8971-d0601ff46e10 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092902 Feb 12 22:00:37.735898 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3504/6878] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:00:37.898737 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:37.902533 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-19a7c70d-9f04-48d2-866f-cbf86a48f659 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1372 microversion: 2.1 time: 0.221805 Feb 12 22:00:37.903288 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3375/6879] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:37 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:38.921377 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:38.922129 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:38.929659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:38.930135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:38.930942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:38.931400 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:39.079817 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:39.088518 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3e6cdddb-6849-4473-bd0b-c2795c745cd9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1372 microversion: 2.1 time: 0.172030 Feb 12 22:00:39.097069 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3505/6880] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:38 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:40.105432 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:40.105993 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:40.112562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:40.113010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:40.113821 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:40.114255 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:40.253816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:40.262645 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f91f3341-2352-43fe-a105-0a6fdcd510bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1556 microversion: 2.1 time: 0.161030 Feb 12 22:00:40.263209 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3376/6881] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:40 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:40.279341 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:00:40.279972 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:00:40.286918 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:40.295130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:40.295130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:40.295130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:40.427405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:00:40.435806 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-043e8956-b12f-417c-8f4b-b9ad6bfc2e8e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1556 microversion: 2.1 time: 0.160186 Feb 12 22:00:40.436399 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3506/6882] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:00:40 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:00:42.579162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-323a96d3-e0d2-4986-ae6f-7eeb654ab701 req-3b9df727-b4ab-4eed-863f-f533f5cb8f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:00:42.580664 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:00:42.580664 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:00:42.587708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-323a96d3-e0d2-4986-ae6f-7eeb654ab701 req-3b9df727-b4ab-4eed-863f-f533f5cb8f2c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:00:42.588156 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-323a96d3-e0d2-4986-ae6f-7eeb654ab701 req-3b9df727-b4ab-4eed-863f-f533f5cb8f2c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:00:42.599190 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-323a96d3-e0d2-4986-ae6f-7eeb654ab701 req-3b9df727-b4ab-4eed-863f-f533f5cb8f2c service nova] Creating event network-changed:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:00:42.604555 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-323a96d3-e0d2-4986-ae6f-7eeb654ab701 req-3b9df727-b4ab-4eed-863f-f533f5cb8f2c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079192 Feb 12 22:00:42.605611 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3377/6883] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:02:39.876339 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef94dcc4-bafd-4b9b-ab8c-335e76b91c49] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 12 22:02:39.879916 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:02:39.880465 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:39.888921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:39.889431 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:39.890864 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:39.891488 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:39.916661 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lazy-loading 'flavor' on Instance uuid 0bf24184-6359-4a5f-b909-1735c681f918 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 22:02:40.422723 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-bc70d68c-7a68-428a-b0dc-9d29010287a9 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918/action" status: 202 len: 0 microversion: 2.1 time: 0.549320 Feb 12 22:02:40.423292 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3507/6884] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 22:02:39 2022] POST /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 22:02:40.431135 ncdv-master-1 devstack@n-api.service[141726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34bafd75-515e-4dd3-be09-1fa220e911b2] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 12 22:02:40.435524 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:40.436229 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:40.445634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:40.451141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:40.451141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:40.451141 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:40.592668 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:40.601242 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e88fb413-b08d-4f64-8e7b-75d2c6480891 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.173313 Feb 12 22:02:40.602011 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3378/6885] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:40 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:41.621731 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:41.622451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:41.632843 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef94dcc4-bafd-4b9b-ab8c-335e76b91c49] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45956. Feb 12 22:02:41.636906 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:41.637451 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:41.638280 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:41.638738 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:41.787816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:41.795441 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a73fcb25-40ef-4dc8-bd63-27f3085ff064 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.179095 Feb 12 22:02:41.796023 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3508/6886] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:41 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:42.812705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:42.813520 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:42.824240 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] [34bafd75-515e-4dd3-be09-1fa220e911b2] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45972. Feb 12 22:02:42.829939 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:42.837754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:42.837754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:42.837754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:42.969957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:42.977284 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3c013320-945c-4836-9f4d-6c08b3eae462 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.168834 Feb 12 22:02:42.977884 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3379/6887] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:42 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:43.995016 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:43.995572 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:44.002865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:44.003273 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:44.004086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:44.004540 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:44.146678 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:44.154344 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8d7326e0-25f3-4abd-9930-c2cbc56e2425 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.163150 Feb 12 22:02:44.154937 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3509/6888] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:43 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:45.173256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:45.173902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:45.180712 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:45.181442 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:45.182228 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:45.182670 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:45.317599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:45.325005 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-42cfaef7-6245-469d-9f10-82b2785b9443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.156114 Feb 12 22:02:45.325613 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3380/6889] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:45 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:46.342189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:46.342798 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:46.349697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:46.350164 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:46.350993 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:46.351442 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:46.487579 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:46.495170 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d1bfa31-eb34-4b9d-a8bc-779b96947507 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.156786 Feb 12 22:02:46.495739 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3510/6890] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:46 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:47.512812 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:47.513453 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:47.520770 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:47.521231 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:47.522045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:47.522486 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:47.658806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:47.666279 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0cf4f773-32df-417d-bfbc-ecc3d53d2127 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.157212 Feb 12 22:02:47.666856 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3381/6891] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:47 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:48.683741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:48.684350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:48.691958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:48.692423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:48.693416 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:48.693866 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:48.838535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:48.839616 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f2197fbf-5e2c-4f18-85bf-dff6f202eca6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.159594 Feb 12 22:02:48.840186 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3511/6892] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:48 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:49.857179 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:49.857839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:49.865010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:49.865501 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:49.866390 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:49.866823 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:50.004574 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:50.011909 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c0996e26-5237-4b83-b7cd-b10f5c7e6def tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.158413 Feb 12 22:02:50.012477 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3382/6893] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:49 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:51.029425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:51.030062 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:51.037536 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:51.038017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:51.038834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:51.039293 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:51.178389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:51.186010 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-75559e5e-a550-4ad1-94b0-e50b6400a7e5 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1702 microversion: 2.1 time: 0.160397 Feb 12 22:02:51.187378 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3512/6894] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:51 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1702 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 22:02:52.203163 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:52.203779 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:52.210526 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:52.210977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:52.211754 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:52.212188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:52.352705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:52.360938 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-80fc94f6-1318-45e7-bb9b-43c518816251 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1702 microversion: 2.1 time: 0.161577 Feb 12 22:02:52.361541 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3383/6895] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:52 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1702 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:53.378484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:53.379069 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:53.385848 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:53.386325 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:53.387107 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:53.387550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:53.526274 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:53.534501 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a19cdfba-69f3-48fa-8252-2a5b59d9e7c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.160032 Feb 12 22:02:53.535098 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3513/6896] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:53 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:54.551082 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:54.551620 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:54.558686 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:54.559479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:54.560515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:54.561256 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:55.090808 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:55.100292 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0b686309-8a88-4450-9a97-af730adb1670 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.553004 Feb 12 22:02:55.101631 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3384/6897] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:54 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:56.117457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:56.120358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:56.128252 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:56.129097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:56.130005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:56.130524 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:56.207443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "name": "network-vif-plugged", "status": "completed", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:02:56.210030 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:02:56.210030 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:02:56.226165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:56.226165 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:56.240273 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] Creating event network-vif-plugged:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:02:56.245096 ncdv-master-1 devstack@n-api.service[141726]: ERROR oslo.messaging._drivers.impl_rabbit [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] [5fdb2ccc-f4b5-493d-933b-d0fbe788cb1a] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:02:56.296630 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:56.308626 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a950709e-0c94-4cff-86aa-2e0bbe5b9378 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.195323 Feb 12 22:02:56.320085 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3514/6898] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:56 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:57.253791 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] [5fdb2ccc-f4b5-493d-933b-d0fbe788cb1a] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46026. Feb 12 22:02:57.258020 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-3bdd63e8-c185-4d2a-a79f-50a8fccb5891 req-74ce19a3-e7d0-4613-afb9-4c74c1cfe59b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.057141 Feb 12 22:02:57.258700 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3385/6899] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:02:57.331345 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:57.336213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:57.342405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:57.343218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:57.344066 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:57.344609 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:57.531315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:57.541242 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1718be2b-15a3-41ca-a8f8-b716c50131bb tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.216457 Feb 12 22:02:57.558411 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3515/6900] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:57 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:58.567991 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:58.569531 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:58.581017 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:58.583584 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:58.584669 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:58.585554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:58.756976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:58.769638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1d3b17e3-285c-4b94-90be-524687d4fa2e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.207596 Feb 12 22:02:58.770474 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3386/6901] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:58 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:02:59.787602 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:02:59.788236 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:02:59.796001 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:59.797040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:59.798250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:02:59.798723 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:02:59.954616 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:02:59.966641 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-42b48eaf-aac4-4606-9e9d-6c91d7fdaefa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.182835 Feb 12 22:02:59.967276 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3516/6902] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:02:59 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:00.988269 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:00.988867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:00.997399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:00.997399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:00.997399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:00.997399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:01.172306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:01.181422 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-999dc60c-c274-4b3c-a4c1-692fd5aa87d4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.197307 Feb 12 22:03:01.192155 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3387/6903] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:00 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:02.200065 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:02.200772 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:02.208466 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:02.208942 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:02.209782 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:02.210240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:02.375865 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:02.387531 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6ea38d4f-7263-464a-ae80-2ec283a1330f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.191082 Feb 12 22:03:02.398284 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3517/6904] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:02 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:03.406834 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:03.407600 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:03.414684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:03.415286 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:03.416416 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:03.416940 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:03.574032 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:03.583222 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-2ad23174-fa01-43ab-82a8-62fc76811a6e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.180970 Feb 12 22:03:03.583914 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3388/6905] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:03 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:04.603527 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:04.604161 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:04.610997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:04.611473 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:04.612279 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:04.612737 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:04.750680 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:04.758361 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-dcfce10f-eaaf-44ba-a7e8-6c905c89f750 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1697 microversion: 2.1 time: 0.158549 Feb 12 22:03:04.758945 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3518/6906] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:04 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:05.775875 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:05.776491 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:05.784174 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:05.784631 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:05.785477 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:05.785918 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:05.926482 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:05.934126 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5ca9b7da-ccad-4b8c-8f86-ed7bc7653443 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1679 microversion: 2.1 time: 0.161918 Feb 12 22:03:05.935430 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3389/6907] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:05 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:06.951816 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:06.953000 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:06.959941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:06.960405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:06.961312 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:06.961799 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:07.101269 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:07.108782 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4d11ef8a-ae25-46c3-b054-b8c1652c3e5e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1679 microversion: 2.1 time: 0.160701 Feb 12 22:03:07.109382 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3519/6908] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:06 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:08.126443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:08.127062 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:08.134002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:08.134454 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:08.135246 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:08.135684 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:08.143526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-40a4ae18-ed47-4c7f-82ab-02f9e26b4b36 req-fea7c8a7-62bb-4497-ac3f-0f03da298450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "name": "network-vif-unplugged", "status": "completed", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:03:08.145209 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:03:08.145209 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 22:03:08.153818 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-40a4ae18-ed47-4c7f-82ab-02f9e26b4b36 req-fea7c8a7-62bb-4497-ac3f-0f03da298450 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:08.156217 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-40a4ae18-ed47-4c7f-82ab-02f9e26b4b36 req-fea7c8a7-62bb-4497-ac3f-0f03da298450 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:08.167900 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.compute.server_external_events [req-40a4ae18-ed47-4c7f-82ab-02f9e26b4b36 req-fea7c8a7-62bb-4497-ac3f-0f03da298450 service nova] Unable to find a host for instance 0bf24184-6359-4a5f-b909-1735c681f918. Dropping event network-vif-unplugged {{(pid=141727) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 12 22:03:08.168791 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-40a4ae18-ed47-4c7f-82ab-02f9e26b4b36 req-fea7c8a7-62bb-4497-ac3f-0f03da298450 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029268 Feb 12 22:03:08.169655 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3520/6909] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 12 22:03:08.281451 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:08.289098 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e5c2aad2-f5e0-47d0-972a-eac487f399cc tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1682 microversion: 2.1 time: 0.167028 Feb 12 22:03:08.289711 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3390/6910] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:08 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:08.306836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:03:08.307449 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:08.314373 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:08.314842 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:08.315646 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:08.316099 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:08.570527 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [a72e85b0-f60e-468d-9ed6-d5aae93a2076] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:03:09.578634 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [a72e85b0-f60e-468d-9ed6-d5aae93a2076] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46078. Feb 12 22:03:09.581796 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-68da0a40-bc2e-4502-89f0-6e80eb00a7ba tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918/action" status: 202 len: 0 microversion: 2.1 time: 1.279058 Feb 12 22:03:09.582543 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3521/6911] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 22:03:08 2022] POST /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918/action => generated 0 bytes in 1280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 22:03:09.590143 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:09.591005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:09.598646 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:09.599116 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:09.599917 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:09.600360 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:09.745438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:09.754179 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-6cace271-0da8-4aa9-8735-f7f347f13de3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1630 microversion: 2.1 time: 0.167617 Feb 12 22:03:09.754778 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3391/6912] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:09 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1630 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:10.772804 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:10.773469 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:10.781006 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:10.781759 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:10.782583 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:10.783039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:10.924338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:10.932145 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f91e8699-4e6e-4318-96ae-8e6e991edf2d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1630 microversion: 2.1 time: 0.164034 Feb 12 22:03:10.932717 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3522/6913] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:10 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1630 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:11.949790 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:11.950809 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:11.958892 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:11.959353 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:11.960153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:11.960588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:12.181978 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:12.190003 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-58f8232d-2ae6-4a6a-a3b8-ca51d797f0a7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.244241 Feb 12 22:03:12.190587 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3392/6914] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:11 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:13.213130 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:13.214560 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:13.224350 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:13.224871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:13.225852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:13.226298 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:13.394395 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:13.403008 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b10d135b-50c8-47e7-89ee-4834d9e4b505 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.198346 Feb 12 22:03:13.403923 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3523/6915] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:13 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:14.420674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:14.422901 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:14.429839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:14.430798 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:14.432129 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:14.432935 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:14.588310 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:14.596751 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a54f7731-8f35-4c37-b04f-e1c1debe5acd tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.179768 Feb 12 22:03:14.597369 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3393/6916] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:14 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:15.615063 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:15.615666 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:15.622569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:15.623039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:15.623845 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:15.624873 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:15.777684 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:15.788488 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-817c064f-95ca-4512-aba7-dfbe7edaa605 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.176764 Feb 12 22:03:15.790294 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3524/6917] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:15 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:16.806582 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:16.807634 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:16.815258 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:16.815855 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:16.816773 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:16.817284 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:16.971824 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:16.979272 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-29bd3e9d-fa4a-4af4-ac16-db6305b4b1c2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.176650 Feb 12 22:03:16.980096 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3394/6918] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:16 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:17.996806 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:17.997679 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:18.005924 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:18.006126 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:18.006897 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:18.007419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:18.161315 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:18.169062 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-870b491b-a285-41a9-b97a-74176c3b309f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.176708 Feb 12 22:03:18.169681 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3525/6919] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:17 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:19.187865 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:19.192083 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:19.196244 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:19.196705 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:19.197535 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:19.197975 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:19.353194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:19.361645 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-d87323a4-d1f3-4859-9bc1-0e2ab3f4293e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.177860 Feb 12 22:03:19.362506 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3395/6920] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:19 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:20.379162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:20.379826 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:20.386823 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:20.387292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:20.388119 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:20.388573 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:20.636815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:20.645635 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-2ce95afd-bc77-4f8a-9274-25d908fecc7f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.270161 Feb 12 22:03:20.646227 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3526/6921] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:20 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:21.663580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:21.664216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:21.671793 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:21.672251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:21.673028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:21.673496 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:21.810546 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:21.819137 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f30ab109-9986-4703-aa96-3d834373b9fe tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.159266 Feb 12 22:03:21.819707 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3396/6922] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:21 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:22.836512 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:22.837132 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:22.844697 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:22.845162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:22.847178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:22.847178 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:22.986991 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:22.994462 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-39dee99a-f64f-41af-b314-bce9ff1cb1fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.161728 Feb 12 22:03:22.995025 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3527/6923] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:22 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:24.011674 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:24.012238 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:24.020226 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:24.020692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:24.021532 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:24.021977 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:24.302078 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:24.306971 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-aa408ad1-bb92-4da2-92f7-6240a09cf629 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.298842 Feb 12 22:03:24.307563 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3397/6924] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:24 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:25.325193 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:25.325781 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:25.332836 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:25.333301 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:25.334218 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:25.334670 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:25.469286 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:25.476644 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a66a64fa-2f7e-46ee-907d-a68229ea1e7c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.155365 Feb 12 22:03:25.477218 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3528/6925] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:25 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:26.261110 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-5da7d86d-e466-4e9b-b575-37c8050c7413 req-15d47eec-9f50-43f0-bfe1-b26572e43dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "name": "network-vif-plugged", "status": "completed", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:03:26.266556 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:03:26.266556 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:03:26.271846 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5da7d86d-e466-4e9b-b575-37c8050c7413 req-15d47eec-9f50-43f0-bfe1-b26572e43dae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:26.272294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-5da7d86d-e466-4e9b-b575-37c8050c7413 req-15d47eec-9f50-43f0-bfe1-b26572e43dae service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:26.284023 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-5da7d86d-e466-4e9b-b575-37c8050c7413 req-15d47eec-9f50-43f0-bfe1-b26572e43dae service nova] Creating event network-vif-plugged:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:03:26.289100 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-5da7d86d-e466-4e9b-b575-37c8050c7413 req-15d47eec-9f50-43f0-bfe1-b26572e43dae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031834 Feb 12 22:03:26.289732 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3398/6926] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:03:26.493239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:26.494553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:26.502728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:26.503369 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:26.504198 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:26.504658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:26.648238 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:26.655743 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f463fd20-c377-46ce-969f-9b2f0b040f5a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.166452 Feb 12 22:03:26.656470 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3529/6927] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:26 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:27.675293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:27.676015 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:27.682785 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:27.683251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:27.684058 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:27.684506 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:27.827576 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:27.835617 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-34945707-6fe2-4726-ac0b-4394bfa95ed7 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.167138 Feb 12 22:03:27.844447 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3399/6928] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:27 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:28.854470 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:28.855096 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:28.861958 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:28.862423 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:28.863212 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:28.863659 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:29.005071 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:29.012681 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d3753f79-29e7-4e08-b0fc-82b95651f023 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1688 microversion: 2.1 time: 0.161908 Feb 12 22:03:29.021888 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3530/6929] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:28 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:03:30.029888 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:03:30.030440 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:03:30.037636 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:30.038089 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:30.038870 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:03:30.039305 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:03:30.180470 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:03:30.188109 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-223e221c-abd7-4422-a9c7-4e67835f4d7d tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1675 microversion: 2.1 time: 0.161988 Feb 12 22:03:30.188674 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3400/6930] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:03:30 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 22:03:31.799850 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:03:31.800367 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:03:31.922132 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:03:31.922547 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:04:43.013841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:43.014376 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:43.021019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:43.021520 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:43.022362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:43.022794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-fbcbe6fb-34ed-49d9-8d72-7cb50addf5b7 req-d29ececa-2a25-428a-bdc0-2cdabcea9b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:04:43.023270 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:43.024296 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:04:43.024296 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:04:43.031181 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fbcbe6fb-34ed-49d9-8d72-7cb50addf5b7 req-d29ececa-2a25-428a-bdc0-2cdabcea9b10 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:43.031627 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-fbcbe6fb-34ed-49d9-8d72-7cb50addf5b7 req-d29ececa-2a25-428a-bdc0-2cdabcea9b10 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:43.043524 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-fbcbe6fb-34ed-49d9-8d72-7cb50addf5b7 req-d29ececa-2a25-428a-bdc0-2cdabcea9b10 service nova] Creating event network-changed:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:04:43.048702 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-fbcbe6fb-34ed-49d9-8d72-7cb50addf5b7 req-d29ececa-2a25-428a-bdc0-2cdabcea9b10 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031475 Feb 12 22:04:43.049290 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3401/6931] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:04:43.049621 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 22:04:43.311721 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-81ff05f6-5af3-4157-8d0d-b4667a647e2c tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 204 len: 0 microversion: 2.1 time: 0.302332 Feb 12 22:04:43.321877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:43.322591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:43.325166 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3531/6932] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 22:04:43 2022] DELETE /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 22:04:43.328869 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:43.329328 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:43.330794 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:43.331263 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:43.553460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:43.563321 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-33ef915d-5004-4360-85d7-f292baa0f5f1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1681 microversion: 2.1 time: 0.245528 Feb 12 22:04:43.563912 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3402/6933] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:43 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:04:44.582245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:44.582997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:44.589984 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:44.590505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:44.591309 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:44.591764 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:44.729956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:44.737591 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-283c86f2-1f66-409b-9fac-299c693400c4 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1562 microversion: 2.1 time: 0.159421 Feb 12 22:04:44.738873 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3532/6934] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:44 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 22:04:45.358999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-1e1c76d7-d7b2-49da-9314-6d3305789ccc req-04d21720-19c1-4aa2-b348-16735f5c3054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf24184-6359-4a5f-b909-1735c681f918", "name": "network-vif-deleted", "tag": "b118d26d-2022-431d-8757-5b0450be7d0a"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:04:45.360625 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:04:45.360625 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:04:45.369841 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1e1c76d7-d7b2-49da-9314-6d3305789ccc req-04d21720-19c1-4aa2-b348-16735f5c3054 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:45.373814 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-1e1c76d7-d7b2-49da-9314-6d3305789ccc req-04d21720-19c1-4aa2-b348-16735f5c3054 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:45.382085 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-1e1c76d7-d7b2-49da-9314-6d3305789ccc req-04d21720-19c1-4aa2-b348-16735f5c3054 service nova] Creating event network-vif-deleted:b118d26d-2022-431d-8757-5b0450be7d0a for instance 0bf24184-6359-4a5f-b909-1735c681f918 on nch1-master-1 Feb 12 22:04:45.387477 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-1e1c76d7-d7b2-49da-9314-6d3305789ccc req-04d21720-19c1-4aa2-b348-16735f5c3054 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Feb 12 22:04:45.391098 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3403/6935] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:04:45.755507 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:45.756139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:45.763244 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:45.763719 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:45.764545 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:45.765004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:45.797389 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:45.797871 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:45.798338 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lazy-loading 'fault' on Instance uuid 0bf24184-6359-4a5f-b909-1735c681f918 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 22:04:45.842566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:45.850000 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-0e512753-9ab7-47b4-866e-ca3f81a7c757 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 200 len: 1337 microversion: 2.1 time: 0.098755 Feb 12 22:04:45.850574 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3533/6936] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:45 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:04:46.868052 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:46.868786 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 0bf24184-6359-4a5f-b909-1735c681f918] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:46.875734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:46.876183 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:46.876959 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:46.877431 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:46.891279 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] HTTP exception thrown: Instance 0bf24184-6359-4a5f-b909-1735c681f918 could not be found. Feb 12 22:04:46.891862 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Returning 404 to user: Instance 0bf24184-6359-4a5f-b909-1735c681f918 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 22:04:46.892676 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-39a45e91-6574-45fd-b161-e061ecd5c3e8 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918" status: 404 len: 111 microversion: 2.1 time: 0.029195 Feb 12 22:04:46.893197 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3404/6937] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:46 2022] GET /compute/v2.1/servers/0bf24184-6359-4a5f-b909-1735c681f918 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 22:04:47.099955 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c57c913-3b80-4cb9-84b5-4a76236f1b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '.version_select at 0x7fa8fc6dec10>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:47.175033 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c57c913-3b80-4cb9-84b5-4a76236f1b1e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018846766" status: 202 len: 0 microversion: 2.1 time: 0.079598 Feb 12 22:04:47.175627 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3534/6938] 10.222.0.31 () {58 vars in 1253 bytes} [Sat Feb 12 22:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018846766 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 22:04:47.195720 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-64aae4e9-705a-40a0-97e8-d8b7e8bba4a1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'create', calling method: .version_select at 0x7fa8fcf884c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-898738509"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:04:47.212913 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-64aae4e9-705a-40a0-97e8-d8b7e8bba4a1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:04:47.217867 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-64aae4e9-705a-40a0-97e8-d8b7e8bba4a1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for user c00440dbf100416c83f80be418e2a05a and project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:04:47.407490 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-64aae4e9-705a-40a0-97e8-d8b7e8bba4a1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:04:47.412845 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-64aae4e9-705a-40a0-97e8-d8b7e8bba4a1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for user c00440dbf100416c83f80be418e2a05a and project 707f6000ad794dbd92c57050b2f27387. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:04:47.427930 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-64aae4e9-705a-40a0-97e8-d8b7e8bba4a1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.236068 Feb 12 22:04:47.428554 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3405/6939] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 22:04:47 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:04:54.653843 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1077793581", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-898738509", "security_groups": [{"name": "tempest-secgroup-smoke-774342948"}], "networks": [{"uuid": "7a1ae1e7-f563-4c07-9b35-0728ce6e4509"}], "block_device_mapping_v2": [{"uuid": "0e5e96c8-86e8-46c4-8182-fceff0f56d54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:04:54.767795 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] validate_networks() for [('7a1ae1e7-f563-4c07-9b35-0728ce6e4509', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 22:04:55.140307 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 22:04:55.140748 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 22:04:55.141237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 22:04:55.141706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 22:04:55.142134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 22:04:55.154108 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:55.154571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:55.155402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:55.155852 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:55.175264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for project 707f6000ad794dbd92c57050b2f27387. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:04:55.180486 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Getting quotas for user c00440dbf100416c83f80be418e2a05a and project 707f6000ad794dbd92c57050b2f27387. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:04:55.236358 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 22:04:55.238528 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e5e96c8-86e8-46c4-8182-fceff0f56d54',volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 22:04:55.620369 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d4fe9ac7-4374-4c17-ba3e-00ab6fce872e tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.970467 Feb 12 22:04:55.621014 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3535/6940] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 22:04:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 22:04:55.632564 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a20c5b89-5bea-4964-b5b9-b1739c8421fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:55.633172 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a20c5b89-5bea-4964-b5b9-b1739c8421fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:55.743318 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a20c5b89-5bea-4964-b5b9-b1739c8421fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:55.750363 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a20c5b89-5bea-4964-b5b9-b1739c8421fa tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1088 microversion: 2.1 time: 0.123190 Feb 12 22:04:55.751142 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3406/6941] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:55 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1088 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:04:56.769593 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:56.770228 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:56.776481 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:56.777005 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:56.777979 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:56.778441 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:56.892185 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:56.899932 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-49122171-ccee-4f41-a7e6-e75af37e4104 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1130 microversion: 2.1 time: 0.135054 Feb 12 22:04:56.900543 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3536/6942] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:56 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1130 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:04:57.918640 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:57.919542 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:57.926530 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:57.926936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:57.927739 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:57.928185 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:58.000948 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:58.009207 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e3c47b2f-bbda-423c-811f-9864191b04c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1204 microversion: 2.1 time: 0.094280 Feb 12 22:04:58.009827 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3407/6943] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:57 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 22:04:59.027673 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:04:59.028660 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:04:59.051721 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:59.052294 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:59.053122 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:59.053664 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:59.094358 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-b88fe083-4369-4f75-b34d-24eae7d68d38 req-ce4779ae-db07-4809-897d-9c0154cd34e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2679f865-5dbf-424a-9051-7dd547dbb5d2", "tag": "cadb59ef-0dcf-411c-b2c9-4e86beceb5f5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:04:59.097986 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:04:59.097986 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:04:59.111152 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b88fe083-4369-4f75-b34d-24eae7d68d38 req-ce4779ae-db07-4809-897d-9c0154cd34e8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:04:59.112140 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-b88fe083-4369-4f75-b34d-24eae7d68d38 req-ce4779ae-db07-4809-897d-9c0154cd34e8 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:04:59.140690 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-b88fe083-4369-4f75-b34d-24eae7d68d38 req-ce4779ae-db07-4809-897d-9c0154cd34e8 service nova] Creating event network-changed:cadb59ef-0dcf-411c-b2c9-4e86beceb5f5 for instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 on nch1-master-1 Feb 12 22:04:59.158727 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-b88fe083-4369-4f75-b34d-24eae7d68d38 req-ce4779ae-db07-4809-897d-9c0154cd34e8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067702 Feb 12 22:04:59.162160 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3408/6944] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:04:59.321239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:04:59.332105 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e694c536-eb4e-41c4-88c8-55b854eec211 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1271 microversion: 2.1 time: 0.308418 Feb 12 22:04:59.333743 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3537/6945] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:04:59 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:00.352115 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:00.352722 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:00.358934 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:00.359388 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:00.360162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:00.360598 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:00.500002 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:00.508123 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b3cf99f7-97de-44af-8189-ae5e9a6768ad tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.161544 Feb 12 22:05:00.508767 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3409/6946] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:00 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:01.525079 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:01.525727 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:01.532452 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:01.532921 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:01.533753 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:01.534203 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:01.939365 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:01.946838 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-96b21f38-f345-4cce-8766-cd557b523bc2 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.425460 Feb 12 22:05:01.947404 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3538/6947] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:01 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:02.963373 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:02.964005 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:02.970792 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:02.971254 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:02.972045 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:02.972489 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:03.111166 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:03.119316 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f35627a2-3c42-4c20-ad26-f777bc4ec3df tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.159701 Feb 12 22:05:03.119885 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3410/6948] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:02 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:04.136043 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:04.136669 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:04.143736 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:04.144213 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:04.145083 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:04.145571 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:04.278631 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:04.286380 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-71252e52-2b28-4a11-888c-50a076245ff0 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.154052 Feb 12 22:05:04.286946 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3539/6949] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:04 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:05.304591 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:05.305177 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:05.312094 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:05.312545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:05.313367 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:05.313816 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:05.450051 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:05.457537 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-e92ce607-3484-479f-83e2-dc4103aa8a6a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.157275 Feb 12 22:05:05.458119 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3411/6950] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:05 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:06.474970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:06.475724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:06.482526 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:06.482997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:06.483830 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:06.484290 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:06.623514 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:06.630883 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce0fd06e-9eff-4497-b159-960df149253f tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.159704 Feb 12 22:05:06.631450 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3540/6951] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:06 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:06.982438 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-a4440867-4a16-4b8f-8c9f-fc74bb842f20 req-0e9a5912-081b-43b5-b897-0f68f1b864c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2679f865-5dbf-424a-9051-7dd547dbb5d2", "name": "network-vif-plugged", "status": "completed", "tag": "cadb59ef-0dcf-411c-b2c9-4e86beceb5f5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:05:06.983961 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:05:06.983961 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:05:06.992557 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a4440867-4a16-4b8f-8c9f-fc74bb842f20 req-0e9a5912-081b-43b5-b897-0f68f1b864c0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:06.992999 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-a4440867-4a16-4b8f-8c9f-fc74bb842f20 req-0e9a5912-081b-43b5-b897-0f68f1b864c0 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:07.003877 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-a4440867-4a16-4b8f-8c9f-fc74bb842f20 req-0e9a5912-081b-43b5-b897-0f68f1b864c0 service nova] Creating event network-vif-plugged:cadb59ef-0dcf-411c-b2c9-4e86beceb5f5 for instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 on nch1-master-1 Feb 12 22:05:07.008887 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-a4440867-4a16-4b8f-8c9f-fc74bb842f20 req-0e9a5912-081b-43b5-b897-0f68f1b864c0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Feb 12 22:05:07.009502 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3412/6952] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:05:07.647878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:07.648505 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:07.655282 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:07.655752 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:07.656559 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:07.657019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:08.110106 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:08.117739 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b696ab9d-e069-4bb2-aadf-23eaffa362c3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1259 microversion: 2.1 time: 0.474147 Feb 12 22:05:08.118307 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3541/6953] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:07 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1259 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:09.135922 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:09.136629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:09.142949 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:09.143615 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:09.144188 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:09.144626 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:09.282797 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:09.290328 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0f0e35f8-41e3-4bfe-a488-293bec6ae258 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1443 microversion: 2.1 time: 0.160003 Feb 12 22:05:09.290897 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3413/6954] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:09 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:09.306786 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:05:09.307421 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:05:09.314450 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:09.314928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:09.315741 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:09.316202 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:09.450362 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:05:09.457891 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3dc321b9-dc0e-4059-b343-168b63abeac1 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1443 microversion: 2.1 time: 0.155541 Feb 12 22:05:09.458455 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3542/6955] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:05:09 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:05:11.395556 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-94d0b65a-ed68-436b-ba98-fb19dbca8797 req-b9d9c44d-f48d-4604-966e-fbe80b4df0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2679f865-5dbf-424a-9051-7dd547dbb5d2", "tag": "cadb59ef-0dcf-411c-b2c9-4e86beceb5f5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:05:11.397114 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:05:11.397114 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:05:11.405485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-94d0b65a-ed68-436b-ba98-fb19dbca8797 req-b9d9c44d-f48d-4604-966e-fbe80b4df0a6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:05:11.405938 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-94d0b65a-ed68-436b-ba98-fb19dbca8797 req-b9d9c44d-f48d-4604-966e-fbe80b4df0a6 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:05:11.420708 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-94d0b65a-ed68-436b-ba98-fb19dbca8797 req-b9d9c44d-f48d-4604-966e-fbe80b4df0a6 service nova] Creating event network-changed:cadb59ef-0dcf-411c-b2c9-4e86beceb5f5 for instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 on nch1-master-1 Feb 12 22:05:11.426046 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-94d0b65a-ed68-436b-ba98-fb19dbca8797 req-b9d9c44d-f48d-4604-966e-fbe80b4df0a6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034044 Feb 12 22:05:11.432057 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3414/6956] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:06:51.494025 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:06:51.494634 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:06:51.931632 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:06:51.932801 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:07:25.709218 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:07:25.709853 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:07:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:08:29.328263 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d7d7afd-6304-4f9f-9067-9828ae16576e] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 12 22:08:29.329187 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef94dcc4-bafd-4b9b-ab8c-335e76b91c49] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 12 22:08:29.384937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:08:29.385983 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:29.393144 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:29.393729 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:29.394569 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:29.395029 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:30.337593 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d7d7afd-6304-4f9f-9067-9828ae16576e] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46616. Feb 12 22:08:30.338360 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef94dcc4-bafd-4b9b-ab8c-335e76b91c49] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46618. Feb 12 22:08:30.343030 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6573c983-c2d6-41f5-ab67-4691e7e16560 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "POST /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2/action" status: 200 len: 24569 microversion: 2.1 time: 1.016501 Feb 12 22:08:30.343679 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3543/6957] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 22:08:29 2022] POST /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2/action => generated 24569 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 12 22:08:31.306213 ncdv-master-1 devstack@n-api.service[141726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [53d814be-33f3-43f3-aead-508654f49779] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:08:31.307031 ncdv-master-1 devstack@n-api.service[141726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34bafd75-515e-4dd3-be09-1fa220e911b2] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:08:31.311192 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:31.311877 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:31.319813 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:31.320272 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:31.321075 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:31.321548 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:31.351227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Going to try to terminate instance {{(pid=141726) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 22:08:31.368320 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-31f4c84b-1403-4d70-a7de-ca0bd3b409fb req-3ae48660-6e0c-4433-8198-a5c01d4ce2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2679f865-5dbf-424a-9051-7dd547dbb5d2", "tag": "cadb59ef-0dcf-411c-b2c9-4e86beceb5f5"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:08:31.369920 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:08:31.369920 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 22:08:31.380725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-31f4c84b-1403-4d70-a7de-ca0bd3b409fb req-3ae48660-6e0c-4433-8198-a5c01d4ce2a1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:31.381224 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-31f4c84b-1403-4d70-a7de-ca0bd3b409fb req-3ae48660-6e0c-4433-8198-a5c01d4ce2a1 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:31.393621 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-31f4c84b-1403-4d70-a7de-ca0bd3b409fb req-3ae48660-6e0c-4433-8198-a5c01d4ce2a1 service nova] Creating event network-changed:cadb59ef-0dcf-411c-b2c9-4e86beceb5f5 for instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 on nch1-master-1 Feb 12 22:08:31.399072 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-31f4c84b-1403-4d70-a7de-ca0bd3b409fb req-3ae48660-6e0c-4433-8198-a5c01d4ce2a1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092239 Feb 12 22:08:31.399994 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3544/6958] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:08:31.739605 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-59527171-a601-4d10-9347-14edf3b52ed3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 204 len: 0 microversion: 2.1 time: 0.435161 Feb 12 22:08:31.740460 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3415/6959] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 22:08:31 2022] DELETE /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 22:08:31.749971 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:31.759949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:31.759949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:31.759949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:31.759949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:31.759949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:31.913728 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:08:31.922097 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-b1cb4d77-1297-4d4b-b3b5-d2df3150c4c6 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1567 microversion: 2.1 time: 0.176550 Feb 12 22:08:31.922666 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3545/6960] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:08:31 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 22:08:32.941583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:32.942293 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:32.951038 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:32.951495 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:32.952294 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:32.952734 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:32.967659 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] [34bafd75-515e-4dd3-be09-1fa220e911b2] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46638. Feb 12 22:08:32.978052 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] [53d814be-33f3-43f3-aead-508654f49779] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46636. Feb 12 22:08:33.104856 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:08:33.112571 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9c24ad6e-bedd-490d-bc96-2076dfe20450 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1449 microversion: 2.1 time: 0.175586 Feb 12 22:08:33.113143 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3416/6961] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:08:32 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:08:34.130326 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:34.131053 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:34.141402 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:34.142167 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:34.143253 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:34.143938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:34.219306 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:08:34.228594 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-e3a57878-8050-4ca7-9f35-ee46366cb422 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1382 microversion: 2.1 time: 0.102040 Feb 12 22:08:34.229166 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3546/6962] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:08:34 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1382 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:08:34.252730 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ea66de08-1ca5-4d98-889b-6d0566e733e0 req-78ecf03e-7641-4125-b6a4-06ae1aad6fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2679f865-5dbf-424a-9051-7dd547dbb5d2", "name": "network-vif-deleted", "tag": "cadb59ef-0dcf-411c-b2c9-4e86beceb5f5"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:08:34.254343 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:08:34.254343 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:08:34.261204 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ea66de08-1ca5-4d98-889b-6d0566e733e0 req-78ecf03e-7641-4125-b6a4-06ae1aad6fc3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:34.263653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ea66de08-1ca5-4d98-889b-6d0566e733e0 req-78ecf03e-7641-4125-b6a4-06ae1aad6fc3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:34.273049 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ea66de08-1ca5-4d98-889b-6d0566e733e0 req-78ecf03e-7641-4125-b6a4-06ae1aad6fc3 service nova] Creating event network-vif-deleted:cadb59ef-0dcf-411c-b2c9-4e86beceb5f5 for instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 on nch1-master-1 Feb 12 22:08:34.278150 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ea66de08-1ca5-4d98-889b-6d0566e733e0 req-78ecf03e-7641-4125-b6a4-06ae1aad6fc3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080406 Feb 12 22:08:34.278766 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3417/6963] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:08:35.246351 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:35.247970 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:35.253862 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:35.254393 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:35.255194 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:35.255644 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:35.286937 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:35.287405 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:35.287870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lazy-loading 'fault' on Instance uuid 2679f865-5dbf-424a-9051-7dd547dbb5d2 {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 22:08:35.328776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00440dbf100416c83f80be418e2a05a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f6000ad794dbd92c57050b2f27387', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:08:35.336249 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-a8defafd-33ae-47b1-83ae-dc8fe1ddb8ae tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 200 len: 1224 microversion: 2.1 time: 0.093855 Feb 12 22:08:35.339221 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3547/6964] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:08:35 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:08:36.357087 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:36.357830 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] [instance: 2679f865-5dbf-424a-9051-7dd547dbb5d2] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:08:36.364216 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:36.364695 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:36.365510 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:08:36.365951 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:08:36.379047 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] HTTP exception thrown: Instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 could not be found. Feb 12 22:08:36.379658 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Returning 404 to user: Instance 2679f865-5dbf-424a-9051-7dd547dbb5d2 could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 22:08:36.380506 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-ee8bc325-5b46-4c5e-a06b-25221e0e2e4a tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2" status: 404 len: 111 microversion: 2.1 time: 0.029086 Feb 12 22:08:36.381033 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3418/6965] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:08:36 2022] GET /compute/v2.1/servers/2679f865-5dbf-424a-9051-7dd547dbb5d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 22:08:36.653429 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-92b153d6-8ba1-4061-8a05-fb914c1877b3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] Calling method '.version_select at 0x7fa8fc6d6f70>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:08:36.751914 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-92b153d6-8ba1-4061-8a05-fb914c1877b3 tempest-TestShelveInstance-1948701693 tempest-TestShelveInstance-1948701693-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-898738509" status: 202 len: 0 microversion: 2.1 time: 0.102879 Feb 12 22:08:36.752510 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3548/6966] 10.222.0.31 () {58 vars in 1250 bytes} [Sat Feb 12 22:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-898738509 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 22:08:59.242583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-76de4bfb-462e-4b9f-8e96-8df630546ff5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Action: 'create', calling method: .version_select at 0x7fa8fd01f670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1926653448"}} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:08:59.257650 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-76de4bfb-462e-4b9f-8e96-8df630546ff5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for project e4478103245a48d4b592326ffaeae599. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:08:59.266545 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-76de4bfb-462e-4b9f-8e96-8df630546ff5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for user a88db2b4d5084b5caf1b28198f462bed and project e4478103245a48d4b592326ffaeae599. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:08:59.570571 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-76de4bfb-462e-4b9f-8e96-8df630546ff5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for project e4478103245a48d4b592326ffaeae599. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:08:59.576585 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.quota [None req-76de4bfb-462e-4b9f-8e96-8df630546ff5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for user a88db2b4d5084b5caf1b28198f462bed and project e4478103245a48d4b592326ffaeae599. Resources: {'key_pairs'} {{(pid=141726) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:08:59.593822 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-76de4bfb-462e-4b9f-8e96-8df630546ff5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.524144 Feb 12 22:08:59.594563 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3419/6967] 10.222.0.31 () {60 vars in 1157 bytes} [Sat Feb 12 22:08:59 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:02.295355 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-432741242", "imageRef": "4a11baa3-e49c-4bef-9cb0-43274e3b71c9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1926653448", "security_groups": [{"name": "tempest-secgroup-smoke-516380945"}], "networks": [{"uuid": "9d2dbd66-a345-4bf6-ac86-0fc3cb73587e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:09:02.404428 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] validate_networks() for [('9d2dbd66-a345-4bf6-ac86-0fc3cb73587e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 22:09:02.899456 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 22:09:02.899905 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 22:09:02.900406 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 22:09:02.900841 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 22:09:02.901278 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 22:09:02.910941 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:02.911412 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:02.912263 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:02.912896 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:02.932085 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for project e4478103245a48d4b592326ffaeae599. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:09:02.938550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for user a88db2b4d5084b5caf1b28198f462bed and project e4478103245a48d4b592326ffaeae599. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:09:02.953314 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 22:09:02.955851 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a11baa3-e49c-4bef-9cb0-43274e3b71c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 22:09:03.119449 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-3542793e-59ea-4f8e-bf10-8302e0c1ebf1 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828604 Feb 12 22:09:03.120223 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3549/6968] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 22:09:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 22:09:03.133010 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0fe46002-973e-406b-9b8a-cff36a687750 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:03.134106 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0fe46002-973e-406b-9b8a-cff36a687750 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:03.194572 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0fe46002-973e-406b-9b8a-cff36a687750 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:03.202205 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0fe46002-973e-406b-9b8a-cff36a687750 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1248 microversion: 2.1 time: 0.074469 Feb 12 22:09:03.202785 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3420/6969] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:03 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:04.220020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-054d16c6-7616-4393-83ef-1f5515429125 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:04.220650 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-054d16c6-7616-4393-83ef-1f5515429125 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:04.279342 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-054d16c6-7616-4393-83ef-1f5515429125 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:04.286311 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-054d16c6-7616-4393-83ef-1f5515429125 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1248 microversion: 2.1 time: 0.071140 Feb 12 22:09:04.286875 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3550/6970] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:04 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:05.303167 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:05.303806 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:05.311853 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:05.312314 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:05.313421 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:05.313859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:05.376060 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:05.383819 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f4c91503-55a9-414a-9734-ec1987e5e295 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1300 microversion: 2.1 time: 0.084240 Feb 12 22:09:05.384383 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3421/6971] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:05 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:06.402162 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:06.402891 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:06.411515 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:06.411949 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:06.412849 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:06.413313 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:06.565041 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:06.572534 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-86852ca6-fb93-45b5-8ae3-8bb101001130 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.174345 Feb 12 22:09:06.573275 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3551/6972] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:06 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:07.243467 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-71db990d-b06b-466e-ab0d-6b0b7e459677 req-2094e7a0-cd2a-4309-b3a5-9efe39f3c94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:09:07.245155 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:09:07.245155 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:09:07.257904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-71db990d-b06b-466e-ab0d-6b0b7e459677 req-2094e7a0-cd2a-4309-b3a5-9efe39f3c94c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:07.257904 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-71db990d-b06b-466e-ab0d-6b0b7e459677 req-2094e7a0-cd2a-4309-b3a5-9efe39f3c94c service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:07.268520 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-71db990d-b06b-466e-ab0d-6b0b7e459677 req-2094e7a0-cd2a-4309-b3a5-9efe39f3c94c service nova] Creating event network-changed:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:09:07.274039 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-71db990d-b06b-466e-ab0d-6b0b7e459677 req-2094e7a0-cd2a-4309-b3a5-9efe39f3c94c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035183 Feb 12 22:09:07.274644 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3422/6973] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:09:07.591383 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:07.592023 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:07.598940 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:07.599419 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:07.600240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:07.600705 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:07.744139 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:07.752076 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1caf732a-f7f0-4672-a34e-5951db8d9998 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.164952 Feb 12 22:09:07.752671 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3552/6974] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:07 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:08.770275 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:08.770980 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:08.777552 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:08.778306 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:08.779219 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:08.779659 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:08.919970 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:08.927212 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-1776b3ef-d93b-4c36-9fb9-1c3e0fe533c5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.162039 Feb 12 22:09:08.927788 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3423/6975] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:08 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:09.944551 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:09.946938 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:09.952919 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:09.953425 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:09.954243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:09.954706 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:10.099354 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:10.107374 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6bb0c4dc-35b1-42db-b0dd-5a0cae0b44ff tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.166553 Feb 12 22:09:10.107956 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3553/6976] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:09 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:11.124594 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:11.125208 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:11.131928 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:11.132382 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:11.133162 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:11.133622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:11.273333 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:11.280954 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b98ef709-c594-424c-9a27-f90626ec4ee7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.160214 Feb 12 22:09:11.281534 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3424/6977] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:11 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:12.076150 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-fa7814ae-1fa4-426c-9c8f-c0fe472853b9 req-b43b7452-c664-48e1-a162-8dee669a71a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "name": "network-vif-plugged", "status": "completed", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:09:12.078023 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:09:12.078023 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 22:09:12.085409 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fa7814ae-1fa4-426c-9c8f-c0fe472853b9 req-b43b7452-c664-48e1-a162-8dee669a71a3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:12.085951 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-fa7814ae-1fa4-426c-9c8f-c0fe472853b9 req-b43b7452-c664-48e1-a162-8dee669a71a3 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:12.098238 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-fa7814ae-1fa4-426c-9c8f-c0fe472853b9 req-b43b7452-c664-48e1-a162-8dee669a71a3 service nova] Creating event network-vif-plugged:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:09:12.103477 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-fa7814ae-1fa4-426c-9c8f-c0fe472853b9 req-b43b7452-c664-48e1-a162-8dee669a71a3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091912 Feb 12 22:09:12.104380 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3554/6978] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:09:12.298123 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:12.298745 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:12.305601 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:12.306066 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:12.306858 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:12.307304 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:12.446835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:12.455285 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-52fd0dde-9f74-40fc-9580-d016211e212f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.161554 Feb 12 22:09:12.455864 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3425/6979] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:12 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:13.473914 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:13.474547 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:13.480863 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:13.481977 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:13.482946 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:13.483404 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:13.623724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:13.631273 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-6fda807b-3a7f-43f3-afd8-304fb572cc5c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1373 microversion: 2.1 time: 0.162575 Feb 12 22:09:13.631849 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3555/6980] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:13 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:14.647971 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:14.648589 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:14.656251 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:14.656766 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:14.657588 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:14.658029 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:14.794108 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:14.801775 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dd1b533e-a40c-4795-9447-94c3a944cc32 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1558 microversion: 2.1 time: 0.157665 Feb 12 22:09:14.802409 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3426/6981] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:14 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:14.818112 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:09:14.818739 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:09:14.826237 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:14.826702 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:14.827690 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:14.828171 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:14.966834 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:09:14.974516 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7798a683-bd72-4ef6-a99e-298d74104e0f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1558 microversion: 2.1 time: 0.160193 Feb 12 22:09:14.975096 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3556/6982] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:09:14 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:09:16.942710 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-11939d2d-037b-4513-9f25-488b0bbf79d3 req-82430feb-bd7f-4f6f-8e23-33eeee6bb93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:09:16.944226 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:09:16.944226 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:09:16.953236 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-11939d2d-037b-4513-9f25-488b0bbf79d3 req-82430feb-bd7f-4f6f-8e23-33eeee6bb93f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:09:16.953708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-11939d2d-037b-4513-9f25-488b0bbf79d3 req-82430feb-bd7f-4f6f-8e23-33eeee6bb93f service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:09:16.965612 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-11939d2d-037b-4513-9f25-488b0bbf79d3 req-82430feb-bd7f-4f6f-8e23-33eeee6bb93f service nova] Creating event network-changed:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:09:16.971942 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-11939d2d-037b-4513-9f25-488b0bbf79d3 req-82430feb-bd7f-4f6f-8e23-33eeee6bb93f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032756 Feb 12 22:09:16.972723 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3427/6983] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:10:11.942224 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:10:11.946133 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:11:13.461111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-832249726"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:13.462221 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:13.468371 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:13.468832 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:13.470147 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:13.470785 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:14.118098 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe9bf71c-d8d4-47b9-9898-820b6edadd16 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "POST /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d/action" status: 202 len: 0 microversion: 2.1 time: 0.661956 Feb 12 22:11:14.118740 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3557/6984] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 22:11:13 2022] POST /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 22:11:18.620844 ncdv-master-1 devstack@n-api.service[141726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34bafd75-515e-4dd3-be09-1fa220e911b2] AMQP server on 10.222.0.31:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 12 22:11:18.623377 ncdv-master-1 devstack@n-api.service[141726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [53d814be-33f3-43f3-aead-508654f49779] AMQP server on 10.222.0.31:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 12 22:11:18.627923 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-6e9e86d5-e25c-4c35-a13c-87a25c71ac6e req-27a9339c-3780-4928-b3ff-aa287b925f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "name": "network-vif-plugged", "status": "completed", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:18.629787 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:11:18.629787 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:11:18.637554 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e9e86d5-e25c-4c35-a13c-87a25c71ac6e req-27a9339c-3780-4928-b3ff-aa287b925f54 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:18.638049 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-6e9e86d5-e25c-4c35-a13c-87a25c71ac6e req-27a9339c-3780-4928-b3ff-aa287b925f54 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:18.649818 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-6e9e86d5-e25c-4c35-a13c-87a25c71ac6e req-27a9339c-3780-4928-b3ff-aa287b925f54 service nova] Creating event network-vif-plugged:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:11:18.655118 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-6e9e86d5-e25c-4c35-a13c-87a25c71ac6e req-27a9339c-3780-4928-b3ff-aa287b925f54 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037405 Feb 12 22:11:18.655738 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3428/6985] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:11:29.753262 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-657842659", "imageRef": "661635e5-c2c1-43f9-b22c-a5d9cbb89dcf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1926653448", "security_groups": [{"name": "tempest-secgroup-smoke-516380945"}], "networks": [{"uuid": "9d2dbd66-a345-4bf6-ac86-0fc3cb73587e"}]}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:29.861483 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.network.neutron [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] validate_networks() for [('9d2dbd66-a345-4bf6-ac86-0fc3cb73587e', None, None, None, None, None)] {{(pid=141727) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 12 22:11:30.239039 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Flavor limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 12 22:11:30.239519 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Image limits 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 12 22:11:30.240011 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Flavor pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 12 22:11:30.240460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Image pref 0:0:0 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 12 22:11:30.240886 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.virt.hardware [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=141727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 12 22:11:30.250074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:30.250539 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:30.252019 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:30.252508 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:30.268765 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for project e4478103245a48d4b592326ffaeae599. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 12 22:11:30.273819 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.quota [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Getting quotas for user a88db2b4d5084b5caf1b28198f462bed and project e4478103245a48d4b592326ffaeae599. Resources: {'instances', 'ram', 'cores'} {{(pid=141727) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 12 22:11:30.286055 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Going to run 1 instances... {{(pid=141727) _provision_instances /opt/stack/nova/nova/compute/api.py:1370}} Feb 12 22:11:30.288541 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='661635e5-c2c1-43f9-b22c-a5d9cbb89dcf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=141727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1777}} Feb 12 22:11:30.374221 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [a72e85b0-f60e-468d-9ed6-d5aae93a2076] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:11:31.381762 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [a72e85b0-f60e-468d-9ed6-d5aae93a2076] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47118. Feb 12 22:11:31.385653 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5f278a68-75dc-4fe6-a657-2cfbf70112b5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.638034 Feb 12 22:11:31.386298 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3558/6986] 10.222.0.31 () {60 vars in 1146 bytes} [Sat Feb 12 22:11:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 12 22:11:31.398653 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-b5291d9d-0724-40e9-80f2-024236a5e9b2 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:31.399350 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-b5291d9d-0724-40e9-80f2-024236a5e9b2 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:31.411787 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] [53d814be-33f3-43f3-aead-508654f49779] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47124. Feb 12 22:11:31.413548 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] [34bafd75-515e-4dd3-be09-1fa220e911b2] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47122. Feb 12 22:11:31.513606 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-b5291d9d-0724-40e9-80f2-024236a5e9b2 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:31.521707 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-b5291d9d-0724-40e9-80f2-024236a5e9b2 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1248 microversion: 2.1 time: 0.128684 Feb 12 22:11:31.522294 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3429/6987] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:31 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1248 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:32.541502 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:32.542143 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:32.549097 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:32.552925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:32.552925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:32.552925 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:32.625189 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:32.633148 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-4bc861f2-7463-425b-acb4-6b85dc278865 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1252 microversion: 2.1 time: 0.096098 Feb 12 22:11:32.633500 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3559/6988] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:32 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:32.641555 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-bb1f297b-412b-4ced-b811-ef00934f786c req-d71dbee5-b23d-498c-a20c-6dfe5face2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "name": "network-vif-unplugged", "status": "completed", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:32.644464 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:11:32.644464 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:11:32.652897 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bb1f297b-412b-4ced-b811-ef00934f786c req-d71dbee5-b23d-498c-a20c-6dfe5face2bc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:32.653460 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-bb1f297b-412b-4ced-b811-ef00934f786c req-d71dbee5-b23d-498c-a20c-6dfe5face2bc service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:32.665459 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-bb1f297b-412b-4ced-b811-ef00934f786c req-d71dbee5-b23d-498c-a20c-6dfe5face2bc service nova] Creating event network-vif-unplugged:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:11:32.670716 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-bb1f297b-412b-4ced-b811-ef00934f786c req-d71dbee5-b23d-498c-a20c-6dfe5face2bc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032989 Feb 12 22:11:32.671393 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3430/6989] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:11:33.650417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:33.651040 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:33.658529 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:33.659109 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:33.660283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:33.660735 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:33.731417 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:33.739922 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6ce6cb4-1e52-4df8-91e7-47e4c8e5295b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1306 microversion: 2.1 time: 0.093248 Feb 12 22:11:33.740492 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3560/6990] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:33 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:34.757976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:34.758829 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:34.766920 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:34.768321 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:34.769386 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:34.770044 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:34.940831 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:34.950599 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-0c814ab6-004a-4e0b-b04e-ccaf0edef57e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.196515 Feb 12 22:11:34.955256 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3431/6991] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:34 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:35.968484 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:35.969413 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:35.976762 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:35.977235 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:35.978152 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:35.978605 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:36.142802 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:36.151890 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8c244b0f-51c9-455e-bfc3-0ca005ab8ffe tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.187184 Feb 12 22:11:36.162930 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3561/6992] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:35 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:37.169692 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:37.170399 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:37.178505 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:37.179209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:37.180349 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:37.180839 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:37.341484 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:37.349035 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-690e7c3c-f5b4-4341-8153-86368267dbca tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.183166 Feb 12 22:11:37.349633 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3432/6993] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:37 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:38.367998 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:38.368624 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:38.375638 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:38.376105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:38.377134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:38.377615 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:38.532503 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:38.540755 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-ce9a1ff5-34e6-481f-988f-90b602f03e54 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.176391 Feb 12 22:11:38.541446 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3562/6994] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:38 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:39.558327 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:39.559028 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:39.568483 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:39.568947 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:39.570063 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:39.570521 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:39.719485 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:39.727651 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-dba5c687-3701-49a9-989b-552366704ca3 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.173040 Feb 12 22:11:39.728435 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3433/6995] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:39 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:40.746142 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:40.746867 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:40.754857 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:40.755327 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:40.756226 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:40.757036 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:40.911289 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:40.918949 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8df5749e-608d-45b3-a234-6befe55d1d5d tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.176915 Feb 12 22:11:40.919526 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3563/6996] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:40 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:41.935936 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:41.936551 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:41.943599 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:41.944048 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:41.944840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:41.945277 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:42.181702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:42.189136 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-5ec080dc-0be7-47b4-a96f-e1041a6a2144 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.256727 Feb 12 22:11:42.190751 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3434/6997] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:41 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:42.837913 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [req-4904ed6b-facb-4b2f-a483-d637548d6dd2 req-c02f5263-cfd6-497d-ac63-9974ab4dbc93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a6504-60cf-4579-8e9c-b25c2ef344ff", "tag": "7c437c05-3700-4145-aad8-1b34ce7933fa"}]} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:42.841319 ncdv-master-1 devstack@n-api.service[141727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:11:42.841319 ncdv-master-1 devstack@n-api.service[141727]: warnings.warn(msg) Feb 12 22:11:42.853105 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4904ed6b-facb-4b2f-a483-d637548d6dd2 req-c02f5263-cfd6-497d-ac63-9974ab4dbc93 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:42.853694 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [req-4904ed6b-facb-4b2f-a483-d637548d6dd2 req-c02f5263-cfd6-497d-ac63-9974ab4dbc93 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:42.870781 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.compute.server_external_events [req-4904ed6b-facb-4b2f-a483-d637548d6dd2 req-c02f5263-cfd6-497d-ac63-9974ab4dbc93 service nova] Creating event network-changed:7c437c05-3700-4145-aad8-1b34ce7933fa for instance 227a6504-60cf-4579-8e9c-b25c2ef344ff on nch2-master-1 Feb 12 22:11:42.876238 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [req-4904ed6b-facb-4b2f-a483-d637548d6dd2 req-c02f5263-cfd6-497d-ac63-9974ab4dbc93 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046441 Feb 12 22:11:42.877300 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3564/6998] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:11:43.206662 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:43.207403 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:43.213743 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:43.214194 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:43.214976 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:43.215409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:43.450708 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:43.458397 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-f3ec6c62-d2d9-48ca-b613-e1bfa7e9687c tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.255310 Feb 12 22:11:43.458920 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3435/6999] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:43 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:44.475928 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:44.476568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:44.483634 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:44.484102 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:44.484907 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:44.485436 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:44.624767 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:44.632333 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8ae38447-28d3-4c00-8c83-859f3f462cb7 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.160707 Feb 12 22:11:44.632907 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3565/7000] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:44 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:45.649200 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:45.649836 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:45.656702 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:45.657151 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:45.657983 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:45.658415 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:45.797206 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:45.804668 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-c83076e5-9a43-4d72-82f6-09240a5a9380 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.159278 Feb 12 22:11:45.805244 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3436/7001] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:45 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:46.821901 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:46.822566 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:46.830176 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:46.830744 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:46.831563 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:46.832017 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:46.972004 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:46.979469 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-1f5f6fea-03d9-402c-b80b-7dfe31b84f40 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.161370 Feb 12 22:11:46.980049 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3566/7002] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:46 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:47.995818 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:48.005558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:48.005558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:48.005558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:48.005558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:48.005558 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:48.152852 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:48.161226 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-3ea07b29-369b-439d-b920-bfada88d7b6b tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.169021 Feb 12 22:11:48.161907 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3437/7003] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:47 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:49.178349 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:49.178975 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:49.185813 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:49.186283 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:49.187086 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:49.187550 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:49.321895 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:49.329293 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-5fd870c4-9caf-4ae9-8a1b-8dca5c9d9245 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.154769 Feb 12 22:11:49.330051 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3567/7004] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:49 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:49.928511 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-52ea4a6f-ffab-4c9e-9f76-6df4c7e18e1f req-40ece925-adcd-4aeb-9701-c44341c67904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a6504-60cf-4579-8e9c-b25c2ef344ff", "name": "network-vif-plugged", "status": "completed", "tag": "7c437c05-3700-4145-aad8-1b34ce7933fa"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:49.930655 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:11:49.930655 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:11:49.938441 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-52ea4a6f-ffab-4c9e-9f76-6df4c7e18e1f req-40ece925-adcd-4aeb-9701-c44341c67904 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:49.938902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-52ea4a6f-ffab-4c9e-9f76-6df4c7e18e1f req-40ece925-adcd-4aeb-9701-c44341c67904 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:49.950199 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-52ea4a6f-ffab-4c9e-9f76-6df4c7e18e1f req-40ece925-adcd-4aeb-9701-c44341c67904 service nova] Creating event network-vif-plugged:7c437c05-3700-4145-aad8-1b34ce7933fa for instance 227a6504-60cf-4579-8e9c-b25c2ef344ff on nch2-master-1 Feb 12 22:11:49.955626 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-52ea4a6f-ffab-4c9e-9f76-6df4c7e18e1f req-40ece925-adcd-4aeb-9701-c44341c67904 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Feb 12 22:11:49.956379 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3438/7005] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:11:50.346714 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:50.347245 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:50.354068 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:50.354535 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:50.355322 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:50.355776 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:50.493812 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:50.501296 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-7fb9125e-367b-4aaa-a85d-1a85d2315104 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1373 microversion: 2.1 time: 0.158727 Feb 12 22:11:50.502445 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3568/7006] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:50 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:51.504341 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:11:51.504906 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:11:51.520459 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:51.521155 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:51.527389 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:51.527835 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:51.528611 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:51.529121 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:51.667979 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:51.675657 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-357efc53-bf5e-4573-8aaf-9ccb67335d4e tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1558 microversion: 2.1 time: 0.160546 Feb 12 22:11:51.676168 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3439/7007] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:51 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:51.692658 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:11:51.693292 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:11:51.700317 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:51.700801 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:51.701651 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:51.702111 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:51.815414 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:11:51.815906 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:11:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:11:51.843693 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:11:51.851426 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-fe7676d6-d8e4-4895-820f-a31e778eeceb tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1558 microversion: 2.1 time: 0.163591 Feb 12 22:11:51.852013 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3569/7008] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:11:51 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:11:54.108583 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-2d241089-d6f6-4c93-8428-b30005b342dc req-af2ef9d5-60b7-41aa-a0af-21cbe28f6d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a6504-60cf-4579-8e9c-b25c2ef344ff", "tag": "7c437c05-3700-4145-aad8-1b34ce7933fa"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:11:54.110118 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:11:54.110118 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:11:54.117966 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2d241089-d6f6-4c93-8428-b30005b342dc req-af2ef9d5-60b7-41aa-a0af-21cbe28f6d76 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:11:54.118409 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-2d241089-d6f6-4c93-8428-b30005b342dc req-af2ef9d5-60b7-41aa-a0af-21cbe28f6d76 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:11:54.130051 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-2d241089-d6f6-4c93-8428-b30005b342dc req-af2ef9d5-60b7-41aa-a0af-21cbe28f6d76 service nova] Creating event network-changed:7c437c05-3700-4145-aad8-1b34ce7933fa for instance 227a6504-60cf-4579-8e9c-b25c2ef344ff on nch2-master-1 Feb 12 22:11:54.135151 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-2d241089-d6f6-4c93-8428-b30005b342dc req-af2ef9d5-60b7-41aa-a0af-21cbe28f6d76 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030300 Feb 12 22:11:54.135864 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3440/7009] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:13:25.256250 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-758736737"}} {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:13:25.257296 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:25.263600 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:25.264070 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:25.264870 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:25.265332 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:25.700190 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-cc47aead-d93f-4af4-931c-b23f79d17d91 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "POST /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff/action" status: 202 len: 0 microversion: 2.1 time: 0.448782 Feb 12 22:13:25.700845 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3570/7010] 10.222.0.31 () {60 vars in 1277 bytes} [Sat Feb 12 22:13:25 2022] POST /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Feb 12 22:13:30.379931 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-0c9492cf-96a2-46f3-99b3-6e8bb07a45b8 req-2c6da187-81b1-415d-858a-32a5236e1244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a6504-60cf-4579-8e9c-b25c2ef344ff", "name": "network-vif-plugged", "status": "completed", "tag": "7c437c05-3700-4145-aad8-1b34ce7933fa"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:13:30.382592 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:13:30.382592 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:13:30.391933 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0c9492cf-96a2-46f3-99b3-6e8bb07a45b8 req-2c6da187-81b1-415d-858a-32a5236e1244 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:30.392593 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-0c9492cf-96a2-46f3-99b3-6e8bb07a45b8 req-2c6da187-81b1-415d-858a-32a5236e1244 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:30.405538 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-0c9492cf-96a2-46f3-99b3-6e8bb07a45b8 req-2c6da187-81b1-415d-858a-32a5236e1244 service nova] Creating event network-vif-plugged:7c437c05-3700-4145-aad8-1b34ce7933fa for instance 227a6504-60cf-4579-8e9c-b25c2ef344ff on nch2-master-1 Feb 12 22:13:30.411720 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-0c9492cf-96a2-46f3-99b3-6e8bb07a45b8 req-2c6da187-81b1-415d-858a-32a5236e1244 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Feb 12 22:13:30.412691 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3441/7011] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:13:31.950054 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:13:31.950743 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:13:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:13:41.969608 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0d7d7afd-6304-4f9f-9067-9828ae16576e] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:13:41.971034 ncdv-master-1 devstack@n-api.service[141727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef94dcc4-bafd-4b9b-ab8c-335e76b91c49] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 12 22:13:41.976271 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:41.976889 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:41.984134 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:41.984614 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:41.985446 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:41.986088 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:42.015074 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 22:13:42.042515 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-36155102-23f1-4ae0-bf2d-48f7474e87bb req-7924e41f-9c4a-4e00-bd77-df87a4677129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227a6504-60cf-4579-8e9c-b25c2ef344ff", "tag": "7c437c05-3700-4145-aad8-1b34ce7933fa"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:13:42.044000 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:13:42.044000 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:13:42.051713 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-36155102-23f1-4ae0-bf2d-48f7474e87bb req-7924e41f-9c4a-4e00-bd77-df87a4677129 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:42.052153 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-36155102-23f1-4ae0-bf2d-48f7474e87bb req-7924e41f-9c4a-4e00-bd77-df87a4677129 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:42.063638 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-36155102-23f1-4ae0-bf2d-48f7474e87bb req-7924e41f-9c4a-4e00-bd77-df87a4677129 service nova] Creating event network-changed:7c437c05-3700-4145-aad8-1b34ce7933fa for instance 227a6504-60cf-4579-8e9c-b25c2ef344ff on nch2-master-1 Feb 12 22:13:42.068962 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-36155102-23f1-4ae0-bf2d-48f7474e87bb req-7924e41f-9c4a-4e00-bd77-df87a4677129 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099893 Feb 12 22:13:42.069749 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3442/7012] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:13:42.258698 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-d6e6d64c-d8c5-4a18-9f03-35f1012c0934 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "DELETE /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 204 len: 0 microversion: 2.1 time: 0.290373 Feb 12 22:13:42.259779 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3571/7013] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 22:13:41 2022] DELETE /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 22:13:42.268902 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:42.269840 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:42.280170 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:42.280622 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:42.281492 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:42.282097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:42.877527 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:13:42.886412 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-a9b40251-ef54-4229-bb4e-1ef0fc7f90b0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1682 microversion: 2.1 time: 0.620676 Feb 12 22:13:42.887305 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3443/7014] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:42 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1682 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:13:43.905264 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:43.906020 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:43.915247 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:43.915725 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:43.916553 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:43.917158 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:43.923315 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] [0d7d7afd-6304-4f9f-9067-9828ae16576e] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47474. Feb 12 22:13:43.934856 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef94dcc4-bafd-4b9b-ab8c-335e76b91c49] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47476. Feb 12 22:13:44.068457 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:13:44.077245 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-492c58b9-1983-4a9e-89ca-d173c3c6548f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1564 microversion: 2.1 time: 0.176658 Feb 12 22:13:44.077922 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3572/7015] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:43 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:13:44.424771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-ed4022c0-a8db-4457-925a-c4ef3fbf4cdb req-b5cd3a9e-387d-4f9b-87f6-385bd9d59791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227a6504-60cf-4579-8e9c-b25c2ef344ff", "name": "network-vif-deleted", "tag": "7c437c05-3700-4145-aad8-1b34ce7933fa"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:13:44.426472 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:13:44.426472 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:13:44.434056 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ed4022c0-a8db-4457-925a-c4ef3fbf4cdb req-b5cd3a9e-387d-4f9b-87f6-385bd9d59791 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:44.434497 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-ed4022c0-a8db-4457-925a-c4ef3fbf4cdb req-b5cd3a9e-387d-4f9b-87f6-385bd9d59791 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:44.447272 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-ed4022c0-a8db-4457-925a-c4ef3fbf4cdb req-b5cd3a9e-387d-4f9b-87f6-385bd9d59791 service nova] Creating event network-vif-deleted:7c437c05-3700-4145-aad8-1b34ce7933fa for instance 227a6504-60cf-4579-8e9c-b25c2ef344ff on nch2-master-1 Feb 12 22:13:44.452429 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-ed4022c0-a8db-4457-925a-c4ef3fbf4cdb req-b5cd3a9e-387d-4f9b-87f6-385bd9d59791 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085222 Feb 12 22:13:44.453507 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3444/7016] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:13:45.095460 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:45.096093 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:45.102961 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:45.103435 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:45.104243 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:45.104712 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:45.136878 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:45.137344 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:45.137839 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lazy-loading 'fault' on Instance uuid 227a6504-60cf-4579-8e9c-b25c2ef344ff {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 22:13:45.180080 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:13:45.187946 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-c35b28cc-dd68-46a5-b368-1a85e6b0be27 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 200 len: 1338 microversion: 2.1 time: 0.096196 Feb 12 22:13:45.188462 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3573/7017] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:45 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:13:46.206988 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:46.207771 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 227a6504-60cf-4579-8e9c-b25c2ef344ff] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:46.215410 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:46.215854 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:46.216629 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:46.217065 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:46.230765 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] HTTP exception thrown: Instance 227a6504-60cf-4579-8e9c-b25c2ef344ff could not be found. Feb 12 22:13:46.231443 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Returning 404 to user: Instance 227a6504-60cf-4579-8e9c-b25c2ef344ff could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 22:13:46.232258 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-023031d9-5ba9-412b-abf0-175c9358dda8 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff" status: 404 len: 111 microversion: 2.1 time: 0.029341 Feb 12 22:13:46.232807 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3445/7018] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:46 2022] GET /compute/v2.1/servers/227a6504-60cf-4579-8e9c-b25c2ef344ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 12 22:13:48.439724 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:48.440239 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:48.442041 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-96984904-188d-4d39-a8ef-4bfa50fa4c61 req-7e43a0d9-c69b-47e5-8989-1f68b4548a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:13:48.443964 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:13:48.443964 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:13:48.456192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:48.456192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:48.456192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:48.456192 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:48.456562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-96984904-188d-4d39-a8ef-4bfa50fa4c61 req-7e43a0d9-c69b-47e5-8989-1f68b4548a27 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:48.456562 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-96984904-188d-4d39-a8ef-4bfa50fa4c61 req-7e43a0d9-c69b-47e5-8989-1f68b4548a27 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:48.468107 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-96984904-188d-4d39-a8ef-4bfa50fa4c61 req-7e43a0d9-c69b-47e5-8989-1f68b4548a27 service nova] Creating event network-changed:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:13:48.473908 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-96984904-188d-4d39-a8ef-4bfa50fa4c61 req-7e43a0d9-c69b-47e5-8989-1f68b4548a27 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036200 Feb 12 22:13:48.474519 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3446/7019] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 12 22:13:48.480240 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Going to try to terminate instance {{(pid=141727) delete /opt/stack/nova/nova/compute/api.py:2634}} Feb 12 22:13:48.733477 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-472124f9-9d9f-4661-b821-43cd131006fd tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 204 len: 0 microversion: 2.1 time: 0.297545 Feb 12 22:13:48.734423 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3574/7020] 10.222.0.31 () {58 vars in 1238 bytes} [Sat Feb 12 22:13:48 2022] DELETE /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 12 22:13:48.743067 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:48.745342 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:48.757580 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:48.758209 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:48.759091 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:48.759617 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:49.173097 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.policy [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141726) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:13:49.179042 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-13e73b8c-3a47-4415-bb34-2714fa8e25f0 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1682 microversion: 2.1 time: 0.440113 Feb 12 22:13:49.179625 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3447/7021] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:48 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1682 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 12 22:13:50.198703 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:50.199438 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:50.206478 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:50.206956 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:50.207771 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:50.208234 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:50.351104 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:13:50.359439 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-8cc03f98-0565-48a2-b98e-cd4674023ffa tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1564 microversion: 2.1 time: 0.165504 Feb 12 22:13:50.360021 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3575/7022] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:50 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:13:51.066227 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [req-422c010c-05e4-4053-94d3-3a4251bf55e5 req-82d6f690-6762-47c8-82cb-e5ad0f413ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d1c53ca-cd3e-4349-aa4a-6f40cfac223d", "name": "network-vif-deleted", "tag": "08015281-df68-4d32-b747-98c9683b5e87"}]} {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 12 22:13:51.068095 ncdv-master-1 devstack@n-api.service[141726]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 22:13:51.068095 ncdv-master-1 devstack@n-api.service[141726]: warnings.warn(msg) Feb 12 22:13:51.077503 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-422c010c-05e4-4053-94d3-3a4251bf55e5 req-82d6f690-6762-47c8-82cb-e5ad0f413ec9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:51.077957 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [req-422c010c-05e4-4053-94d3-3a4251bf55e5 req-82d6f690-6762-47c8-82cb-e5ad0f413ec9 service nova] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:51.089032 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.compute.server_external_events [req-422c010c-05e4-4053-94d3-3a4251bf55e5 req-82d6f690-6762-47c8-82cb-e5ad0f413ec9 service nova] Creating event network-vif-deleted:08015281-df68-4d32-b747-98c9683b5e87 for instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d on nch1-master-1 Feb 12 22:13:51.094243 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [req-422c010c-05e4-4053-94d3-3a4251bf55e5 req-82d6f690-6762-47c8-82cb-e5ad0f413ec9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031647 Feb 12 22:13:51.094953 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3448/7023] 10.222.0.31 () {64 vars in 1317 bytes} [Sat Feb 12 22:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 12 22:13:51.378568 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:51.379353 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.compute.api [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141727) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:51.387364 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:51.392135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:51.392135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:51.392135 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:51.423927 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:51.424399 ncdv-master-1 devstack@n-api.service[141727]: DEBUG oslo_concurrency.lockutils [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:51.424872 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.objects.instance [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lazy-loading 'fault' on Instance uuid 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d {{(pid=141727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 12 22:13:51.466997 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.policy [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a88db2b4d5084b5caf1b28198f462bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4478103245a48d4b592326ffaeae599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=141727) authorize /opt/stack/nova/nova/policy.py:199}} Feb 12 22:13:51.474943 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-f260adf9-2e28-4d3c-9193-4e6ed2f8762f tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 200 len: 1338 microversion: 2.1 time: 0.100901 Feb 12 22:13:51.475524 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3576/7024] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:51 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 12 22:13:52.494764 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '>' {{(pid=141726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:52.495479 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.compute.api [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] [instance: 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d] Fetching instance by UUID {{(pid=141726) get /opt/stack/nova/nova/compute/api.py:2885}} Feb 12 22:13:52.502517 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:52.502974 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:52.503772 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 12 22:13:52.504217 ncdv-master-1 devstack@n-api.service[141726]: DEBUG oslo_concurrency.lockutils [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Lock "e4e1dc5c-1eb5-43f7-a3f8-a4cbd1857e4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=141726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 12 22:13:52.517240 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.wsgi [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] HTTP exception thrown: Instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d could not be found. Feb 12 22:13:52.517859 ncdv-master-1 devstack@n-api.service[141726]: DEBUG nova.api.openstack.wsgi [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Returning 404 to user: Instance 3d1c53ca-cd3e-4349-aa4a-6f40cfac223d could not be found. {{(pid=141726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 12 22:13:52.518677 ncdv-master-1 devstack@n-api.service[141726]: INFO nova.api.openstack.requestlog [None req-9a6a71c1-255c-435f-84fb-6ac9b8ec7cc6 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d" status: 404 len: 111 microversion: 2.1 time: 0.028814 Feb 12 22:13:52.519203 ncdv-master-1 devstack@n-api.service[141726]: [pid: 141726|app: 0|req: 3449/7025] 10.222.0.31 () {58 vars in 1235 bytes} [Sat Feb 12 22:13:52 2022] GET /compute/v2.1/servers/3d1c53ca-cd3e-4349-aa4a-6f40cfac223d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 12 22:13:52.749815 ncdv-master-1 devstack@n-api.service[141727]: DEBUG nova.api.openstack.wsgi [None req-30656d14-2bfd-4e61-af8b-60a0f21e56a5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] Calling method '.version_select at 0x7fa8fde825e0>' {{(pid=141727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 12 22:13:52.813687 ncdv-master-1 devstack@n-api.service[141727]: INFO nova.api.openstack.requestlog [None req-30656d14-2bfd-4e61-af8b-60a0f21e56a5 tempest-TestSnapshotPattern-1482541270 tempest-TestSnapshotPattern-1482541270-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1926653448" status: 202 len: 0 microversion: 2.1 time: 0.068648 Feb 12 22:13:52.814278 ncdv-master-1 devstack@n-api.service[141727]: [pid: 141727|app: 0|req: 3577/7026] 10.222.0.31 () {58 vars in 1256 bytes} [Sat Feb 12 22:13:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1926653448 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 12 22:15:11.824571 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:15:11.825124 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:16:51.520711 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:16:51.521331 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:16:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:16:51.624350 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:16:51.624507 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:16:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:16:51.959851 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:16:51.960403 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:16:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:16:55.160316 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:16:55.160919 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:16:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:18:31.832984 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:18:31.833642 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:19:05.726831 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:19:05.727340 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:20:11.528617 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:20:11.529447 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:20:11.631933 ncdv-master-1 devstack@n-api.service[141727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:20:11.632088 ncdv-master-1 devstack@n-api.service[141727]: Sat Feb 12 22:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:20:11.969591 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:20:11.970139 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:20:15.168441 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:20:15.169054 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 12 22:21:51.841471 ncdv-master-1 devstack@n-api.service[141726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 12 22:21:51.842138 ncdv-master-1 devstack@n-api.service[141726]: Sat Feb 12 22:21:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!